Easily Ingest Data using Open-Source Data Ingestion Tool: AWS Logstash – Part 2

Posted on November 9, 2022 by Suraj Srinivas | Comments(0)

Well-structured logs are the foundation for effective log analysis. Whatever logging tool you choose, the structure makes it easier for you to find, analyze, and visualize the data. Additionally, the structure provides context for your data. This structure should, if possible, be customized for the application-level logs. In other situations, such as infrastructure and system logs, you are responsible for giving logs shape through processing.

Continue Reading…


Amazon’s New OpenSource Service: AWS Elasticsearch – Part 1

Posted on November 9, 2022 by Suraj Srinivas | Comments(0)

Developed in Java, Elasticsearch is a distributed, open-source search and analytics engine based on Apache Lucene. It began as a scalable version of the Lucene open-source search platform and later included support for scaling Lucene indices horizontally. With the help of Elasticsearch, you can store, search, and analyze massive amounts of data fast and in close to real-time, with results arriving in milliseconds.

Continue Reading…


AWS Athena: Serverless, Interactive Data Manipulation Service by Amazon

Posted on November 9, 2022 by Kashyap Nitinbhai Shani | Comments(0)

Amazon Athena is an interactive query service offered by Amazon that makes it easy to explore data directly in the Amazon S3 bucket using standard SQL. Athena is serverless, so there is no infrastructure to manage, and we only pay for the queries we run. Athena is easy to use. It simply directs the data that is present in an S3 bucket and starts querying the data using standard SQL. Most results are delivered within seconds.

Continue Reading…



Deliver High Performance using Data Warehousing Tool – Amazon Redshift

Posted on November 9, 2022 by Lakshmi P Vardhini | Comments(0)

In the present business world, abundant data is being generated within seconds, which is a valuable asset to work with and is stored in multiple sources. Here is the best solution to get all this data stored and organized in the data warehouse. In traditional databases, we store data in small tables which are joined to form another table. The feasible solution to this problem is AWS Redshift. Data Warehouse is more efficient because it can convert data from multiple sources into a predictable format.

Continue Reading…


Plan your AWS Career

Posted on October 17, 2022 by Bhavesh Goswami | Comments(2)

Amazon Web Services has been the market leader in providing Cloud offerings for almost a decade now. At the moment, there are almost 100 services as part of AWS offering which spans from Storage and Compute services to AI and Machine Learning oriented service.

Continue reading…


Taking up an AWS Career? Know the Whys & Hows

Posted on October 14, 2022 by Bhavesh Goswami | Comments(0)

Since 2011, which was an era when Cloud had started to skyrocket into the IT market; job postings for engineers and professionals having work experience with Amazon Web Services have increased by more than 1500%. For almost a decade, billions of dollars have been spent on providing and utilizing Cloud resources and services across the globe.

Continue reading…


How to Migrate Microsoft SQL Server database on EC2 to Amazon Aurora

Posted on October 13, 2022 by Rashmi D | Comments(3)

Assume, an E-commerce application is running on an EC2 instance with the Microsoft SQL Server database. But having the Microsoft SQL Server database on EC2 is an unmanaged solution and with this database management becomes a tedious task for the database administrators and they need a managed solution for smooth operation. Database migration involves multiple complex steps, but two fundamental steps are the conversion of schema and code and the migration of data. In this blog, we discuss Data Migration Service (DMS), Schema Conversion Tool, and steps to convert automated data migration from Microsoft SQL Server to Amazon Aurora (MySQL).

Continue Reading…

What is “The Weight of Data Gravity” Issue and How to Use it with AWS Modern Data Architecture

Posted on October 9, 2022 by Muhammad Imran | Comments(3)

Data is the “Gold” that is getting generated and is also flowing exponentially. However, as mentioned, the rate of volume with which “Data” is exploding has increased the probability of falling down under this gravity wherein organizations have to face challenges to meet scalability, easy access, rich analytics, customer preferences, market dynamics, data security, privacy, compliance among other challenges. AWS helps organizations tackle this “Weight of Data Gravity” by offering a suite of rich data stores and purpose-built analytics services while integrating the pieces in such a way that enables reinvention, innovation, and analytical goals. To know how this is made possible, read this blog post.

Continue Reading…