Lagging Behind Because of Logs? ELK Stack to the Rescue!

Posted on November 22, 2016 by Priya Panke | Comments(0)

One of the common mistakes done by most of the professionals is not using valuable data called ‘Logs’. Because of the quantity of logs generated, the chances of using them becomes very less. Logs are used only to debug in case of failure or issues, but it can be used for much more For Example: Monitor processes Finding the root cause of the issue being faced Analyze flow and performance of processes and many more The collections and analyzing of the log becomes extremely difficult because of the diversity generated. For example we have access logs, error logs, application logs etc. which are associated with an application or a server. In this blog, I will be demonstrating how to install and configure ELK Stack. ELK stands for: Elasticsearch, Logstash and Kibana. Before we begin, let’s have a quick overview of the overall architecture with their components, followed by the implementation procedure.   Architecture of ELK Stack:   ElasticSearch: It is an Indexing, Storage and Retrieval engine Powerful open-source full-text search library A Document is the unit of search and index Fast search against large volumes De-normalized document storage: Fast, direct access to the data Broadly distributed and highly scalable Logstash:

Continue reading…

Why do we opt for AWS Mumbai Region as an Indian cloud customer?

Posted on September 9, 2016 by Amrendra Kumar | Comments(0)

Are you an Indian AWS (Amazon Web Services) Cloud Customer? Do you want to adopt AWS Mumbai Region for your production? Then we have an analysis for you which will help you to decide whether to go for AWS Mumbai Region or not. In this blog, we’ll look at aspects like “cost comparison, services availability, S3 object download speed test, latency check, compliance” between near and famous regions. For those who are not familiar to AWS, a region in AWS is a term which describes a set of AWS resources within a geographic area. Each region contains multiple, isolated locations calledAvailability Zones (AZ). In June 2016, AWS announced Asia Pacific (Mumbai) Region as 13th AWS Region. Now, AWS provides 35 AZs across 13 regions globally. There are more than 75,000 India-based customers who are already using other AWS Regions to save costs, accelerate innovation, and widen their geographic reach in minutes. What does Mumbai region mean to all the hitherto existing customers or new customer? Mumbai Region allows global and India-based developers, start-ups, enterprises, government organisations and non-profits to leverage the AWS Cloud to run their applications from India and provide even lower latency to India-based end users. Two separate

Continue reading…

2016 IT Skills and Salary Report

Posted on September 7, 2016 by Bhavesh Goswami | Comments(0)

  We recently had Global Knowledge 2016 IT Skills and Salary Report published. This report proves that with fast moving technology landscape, trainings are becoming more important than ever before. Training remains one of the most important aspect of global workforce, especially when reports like Zinnov’s prediction that 25% of global IT workforce will become redundant in few years. Below are some of the important findings of the report. Existing skill gaps increase stress on employees Cybersecurity, cloud computing and networking skills are in demand Building new skills is the top driver for professional development 21% of the responders got raise greater than 11% because they “Developed new skills that were of added value“ AWS Certified Solutions Architect – Associate is the second highest paid certification. What are you waiting for to get certified? I am surprised to NOT see any Azure certifications in top 20. We see huge demand, and I am sure Azure 70-534, Azure 70-533, Azure 70-473 Certifications will be there next year. These certifications are hard, and my guess is there are not enough participants with these certifications, so they are missing from the list. Out of more than 10K people who were surveyed, only 35 were AWS Solutions Architect – Professional Level Certified. We see

Continue reading…

Still Wondering, Why to Opt for Docker?

Posted on July 15, 2016 by Abhisek Dey | Comments(0)

When I first started learning about Docker few months back, I had just got transferred from my companies AWS team and to be honest I was a little skeptical about technology but thankfully, my manager was an expert in the field and I attended one of his trainings to get an overview of Docker. Soon, we started containerizing our AWS environment with Amazon ECS. So, I finally surrendered to containers and found that they solve a lot of real world problems and have a lot of advantages. I think this is a good place to start. Over this series of blog posts I’ll be covering ways to use Docker, Importance of Docker, real life use cases in solving problem while moving to production, etc. The buzzword Docker is the most talked about in today’s IT world. If I get down to the nuts and bolts, Docker allows a number of advantages, which allow you to run multiple containers to run on single host and are light weight than virtual machines. In today’s post, we will discuss why is Docker a game changer and why you should go with Docker. First we will see some of the advantages of docker and

Continue reading…

Postfix Email Server integration with SES

Posted on July 7, 2016 by Sherin Shahanas | Comments(1)

Have you ever gone thought of setting up a web or application server with your own mail server? Have you ever tried to do so and stuck at some point? Well, when you host a website or your application it is likely to have your own mail server to handle incoming and outgoing mail to your domain. Before I get into my topic, I assume that you have got basic knowledge on AWS. For any kind of cloud training please visit Here, I’m going to explain you how to setup a simple postfix email server with AWS SES to handle all your email needs of the application. AWS SES (Simple Email service) is a cost effective email service built on AWS cloud. You will be launching an Amazon EC2 machine to setup your email server. Let me put it in this way. We have got two phases in this implementation. Configure SES with your Domain Integrate postfix with SES on an EC2 machine Configure SES with your Domain Domain name is essentially the name given to your website, which helps the visitors to remember the site. For example, we have got a domain and we have the websites like

Continue reading…

CloudWatch Custom Metrics for Windows Server

Posted on June 2, 2016 by Richa Pathak | Comments(0)

It’s not rare that users having requirements of sending custom metrics to CloudWatch. These metrics can be application based or server based. There are different ways we can send these metrics to CloudWatch like writing a simple PowerShell script and scheduling it in Task Scheduler to run periodically. Alternate way to accomplish this, which I personally find very easy is by making simple changes in EC2ConfigService in your windows instance. ADVANTAGES: It is very easy to implement. There is no need to write scripts which sometimes can be really lengthy. Task Scheduler is not required which in turn can save memory. Most Importantly, margin of making error is very less. Let’s take an example that you want to send Free disk and Memory utilization metrics to CloudWatch. PREREQUISITES: EC2Config version should be 2.2.5 or later. Create IAM user with following permissions. IMPLEMENTATION: 1. RDP into your windows instance and from the Start menu, click All Programs, and then click EC2ConfigService Settings. 2. Enable CloudWatch Logs Integration and click OK. 3. Go to C:\Program Files\Amazon\Ec2ConfigService\Settings\AWS.EC2.Windows.CloudWatch.json and replace below code in the file. 4. Go to Control Panel\System and Security\Administrative Tools\Settings and restart EC2 Config service. And It’s done. You

Continue reading…

Getting Started with Kinesis Firehose

Posted on June 1, 2016 by Roopa K | Comments(1)

       In this fast growing world, humongous amount of data is being produced from all sources in every part of the world. It can be anything like logs from the machines, data produced from the traffic signals, data from the IoT devices, smart devices installed in homes/IT industries and a lot of other sources. After production of this vast amount of data, another problem arises of storing, configuring, managing and streaming of data. How to manage data which occupies storage, utilizes compute power, used for analysis is an important aspect for decision making? AWS has a solution to it. Amazon Kinesis streams is the service that you are looking for to stream the data.        Kinesis Streams will collect data form the source and stream to application for further analysis. The data is replicated across availability zones   for high availability and reliability of data. It can scale based on the incoming data. It can scale from megabytes to terabytes while streaming data. It loads data into stream using HTTPs, Kinesis Producer library, Kinesis Client Library and Kinesis Agent. Basically in Kinesis Streams the data is available up to 24 hours and can also be extended up till 7 days. Kinesis Streams resolved the problem of analysis, compute power and decision making. But, we still have a problem of storing the data. Since Kinesis Streams can only save data up to 24Hrs initially and can be saved till 7 days. What if we need to store the data for long??? What

Continue reading…