Data Analytics Ecosystem – AWS & Azure (Part 1)

Posted on April 11, 2017 by Sankeerth Reddy | Comments(2)

In the past decade, technologies around data analytics and business intelligence have seen a tremendous growth in number and reach. The emergence of Cloud has undoubtedly been a catalyst to this growth. Amazon Web Services and Microsoft Azure have both been working towards offering services for Collecting, Uploading, Storing and processing for Data. Below is an attempt to bring both the ecosystems forward into a comparative study of their services for various stages of Data Analytics. In a broad sense, the lifecycle of data to be analyzed goes through the below stages – Data Ingestion Preservation of Original Data Source LifeCycle Management and Cold Storage Metadata Capture Managing Governance, Security and Privacy Self-Service Discovery, Search and Access Managing Data Quality Preparing for Analytics Orchestration and Job Scheduling Capturing Data Change In this Part 1 of the blog, I would be exploring the first 5 stages of Data and how do both AWS and Azure serve the purpose. Data Ingestion Both AWS and Azure provide REST support so that users need to only perform HTTP(s) calls to be able to upload data onto their Cloud. Azure offers few connectors to migrate data to Databases, but currently doesn’t offer any specialized services to perform

Continue reading…

Zabbix- A Simpler way of Monitoring

Posted on March 8, 2017 by Sherin Shahanas | Comments(6)

Today, applications have evolved from standalone to the client-server model and ultimately to the cloud-based elastic application. Application performance can directly affect a business, hurting the revenue as customer struggle to complete the process. It’s always been difficult to see what’s going on inside the system. And doing so has become an essential part. Having a good monitoring tool will help us to understand the system status and determine when they are behaving normally and when they are behaving abnormally. When something goes wrong, the tool alerts quickly and then we can act on it and fix it without affecting customers. Zabbix is a well-known tool to do that for you. Why do we need Application Monitoring? Information gathering Large application produces a humongous number of data that should be monitored and analyzed for the performance and improvement of product and thereby better business. Around the clock monitoring Humans will never be able to monitor each server 24 X 7. But it is very crucial that any unexpected incident on the servers should be notified and act on it immediately. Pre-emptive Alerting Monitoring tool is an invisible team member who will alert you about unexpected things in the system. What

Continue reading…

AWS CodeBuild: A Fully Managed Build Tool

Posted on February 16, 2017 by Sherin Shahanas | Comments(1)

Integrate Code, Build Artifact, Manage release. If you know the pain of these processes you might need to look at AWS CodeBuild. Maintaining a project developed by many team members concurrently which is composed of different functions, environment, and languages, AWS CodeBuild is here to help you. AWS CodeBuild is a fully managed service that compiles your source code and gives you a software package which you can directly deploy into your servers. Instead of setting up and scaling your own build server fleet, you can use CodeBuild to streamline your development process. AWS CodeBuild is elastic, scalable, and easy to use. For each build, it launches a fresh, Isolated container-based environment and terminates it after the build process ends. You can also use CodeBuild as AWS CodePipeline Build Provider. Let’s look at the major Terminologies of AWS CodeBuild. • Source Repository – Location of your source code. • Build Environment – Your runtime environment. • IAM Role – Grants CodeBuild permission to access to specific AWS services and resources. • Build Spec – Build commands. • Compute Type – Amount of memory and compute power required. AWS CodeBuild uses Docker containers to build your code depending on your environment.

Continue reading…

Ramifications of Microsoft Azure’s Strategic Shift towards Cloud Solutions Provider (CSP) Partners

Posted on February 8, 2017 by Bhavesh Goswami | Comments(2)

Microsoft Azure is giving a tough fight to AWS in the public cloud market. Its no secret that AWS, with its 6 years of headstart in IaaS segment has more market share and more services. The latest announcement by Microsoft about Azure pay-as-you-go model not available in the MPSA licensing model gives us a hint on the strategic initiative by Microsoft Azure to capture more market share. Before we begin, let me share few licensing models with which microsoft sells Azure. Microsoft Online Subscription Program (MOSP) This licensing model is the subscription based model which is the default option when you go to the Azure portal and create an account using your credit card. You can also use this model to procure products like office 365, Dynamic CRM, etc. Most small and medium business, and individual developers procure Azure in this fashion. This is the classic Pay-as-you-go model with no prepaid commitments. Enterprise Agreement (EA) EA is a volume licensing package offered by Microsoft which primarily targets large organizations that have 500 or more personal computers. Although this is primarly used to buy software like Windows and SharePoint, Azure can be bought with this licensing model. There is usually some

Continue reading…

Why do we opt for AWS Mumbai Region as an Indian cloud customer?

Posted on September 9, 2016 by Amrendra Kumar | Comments(0)

Are you an Indian AWS (Amazon Web Services) Cloud Customer? Do you want to adopt AWS Mumbai Region for your production? Then we have an analysis for you which will help you to decide whether to go for AWS Mumbai Region or not. In this blog, we’ll look at aspects like “cost comparison, services availability, S3 object download speed test, latency check, compliance” between near and famous regions. For those who are not familiar to AWS, a region in AWS is a term which describes a set of AWS resources within a geographic area. Each region contains multiple, isolated locations calledAvailability Zones (AZ). In June 2016, AWS announced Asia Pacific (Mumbai) Region as 13th AWS Region. Now, AWS provides 35 AZs across 13 regions globally. There are more than 75,000 India-based customers who are already using other AWS Regions to save costs, accelerate innovation, and widen their geographic reach in minutes. What does Mumbai region mean to all the hitherto existing customers or new customer? Mumbai Region allows global and India-based developers, start-ups, enterprises, government organisations and non-profits to leverage the AWS Cloud to run their applications from India and provide even lower latency to India-based end users. Two separate

Continue reading…

Postfix Email Server integration with SES

Posted on July 7, 2016 by Sherin Shahanas | Comments(1)

Have you ever  thought of setting up a web or application server with your own mail server? Have you ever tried to do so and stuck at some point? Well, when you host a website or your application it is likely to have your own mail server to handle incoming and outgoing mail to your domain. Before I get into my topic, I assume that you have got basic knowledge on AWS. For any kind of cloud training please visit Here, I’m going to explain you how to setup a simple postfix email server with AWS SES to handle all your email needs of the application. AWS SES (Simple Email service) is a cost effective email service built on AWS cloud. You will be launching an Amazon EC2 machine to setup your email server. Let me put it in this way. We have got two phases in this implementation. Configure SES with your Domain Integrate postfix with SES on an EC2 machine Configure SES with your Domain Domain name is essentially the name given to your website, which helps the visitors to remember the site. For example, we have got a domain and we have the websites like,

Continue reading…

CloudWatch Custom Metrics for Windows Server

Posted on June 2, 2016 by Richa Pathak | Comments(0)

It’s not rare that users having requirements of sending custom metrics to CloudWatch. These metrics can be application based or server based. There are different ways we can send these metrics to CloudWatch like writing a simple PowerShell script and scheduling it in Task Scheduler to run periodically. Alternate way to accomplish this, which I personally find very easy is by making simple changes in EC2ConfigService in your windows instance. ADVANTAGES: It is very easy to implement. There is no need to write scripts which sometimes can be really lengthy. Task Scheduler is not required which in turn can save memory. Most Importantly, margin of making error is very less. Let’s take an example that you want to send Free disk and Memory utilization metrics to CloudWatch. PREREQUISITES: EC2Config version should be 2.2.5 or later. Create IAM user with following permissions. IMPLEMENTATION: 1. RDP into your windows instance and from the Start menu, click All Programs, and then click EC2ConfigService Settings. 2. Enable CloudWatch Logs Integration and click OK. 3. Go to C:Program FilesAmazonEc2ConfigServiceSettingsAWS.EC2.Windows.CloudWatch.json and replace below code in the file. 4. Go to Control PanelSystem and SecurityAdministrative ToolsSettings and restart EC2 Config service. And It’s done. You

Continue reading…

Install WordPress using AWS Codepipeline

Posted on May 17, 2016 by Amrendra Kumar | Comments(3)

In this blog we are going to show how we can install a WordPress with AWS Codepipeline. Before we begin the demo, let us brief you about the services which will be used. Amazon Web Services (AWS) is providing three services namely CodeCommit, CodeDeploy, CodePipeline as Developer Tools for the developers, which lets them to focus more on their application rather than deployment. CodeCommit hosts private Git repositories, lets we to store code securely. You can store anything, anytime and integrate with other AWS & third-party services. Files can be easily migrated from any Git-based repository to AWS CodeComit. CodeDeploy is developers service, which allows the users to deploy application (contains content such as code, web, scripts, etc). It helps in automated deployments, reduces downtime, have centralized control and easy to adopt. CodePipeline is a continuous delivery service, which lets you to automate your release process using your favorite tools such as Amazon S3, CodeCommit, AWS Elastic Beanstalk, AWS CodeDeploy and Jenkins as well. You can view the progress at a glance. It helps in speeding up delivery while improving quality. It contains many stages to test your code before releasing. Let’s begin with pre-requisites Working knowledge of Linux, Amazon EC2,

Continue reading…

10 Trial Questions for AWS SysOps Administrator – Associate Certification

Posted on May 5, 2016 by Sandhiya Mohandas | Comments(1)

Disclaimer: These are not the original questions from the AWS certification, but are some question we designed to help you check your knowledge for this certification.   Amazon Web Services (AWS) Certification is fast becoming the must have certificates for any IT professional working with AWS. AWS SysOps Certification has attained as the most recommended certification for any System Administrator especially working with AWS.It is meant to be the perfect validation of technical expertise of system administration in AWS. This certification approves the experience of provisioning, operating and maintaining the AWS infrastructure. Here are some sample questions for AWS Certified SysOps Administrator – Associate. Answers and explanation are provided for each question. If you need more clarification on the questions, feel free to comment below the post. Questions: 1)You have an Auto Scaling group associated with an Elastic Load Balancer (ELB). Instances launched via Auto Scaling group are being marked unhealthy by the ELB, but these unhealthy instances are not being terminated. What do you need to modify to ensure these instances marked unhealthy by ELB will be terminated and replaced? A. Change the thresholds set on the Auto Scaling group health check B. Add an Elastic Load Balancer health

Continue reading…

Schedule and Configure Lambda to Notify you..

Posted on April 8, 2016 by Ashwin Ram | Comments(0)

In the era of Dev-ops, continuous integration and deployment,  AWS Lambda provides you with various features, that will help you automate your needs. Lambda  is a compute service from Amazon Web Services, which performs actions on various available services of AWS, based on the program code that you upload for execution. It can be triggered by events or with a scheduled event provided by CloudWatch. In this blog, we are going to see step-by-step process of Creating Lambda Function Integrating Lambda With CloudWatch (Scheduled Event) Creating SNS Topic and Subscriptions Integrating CloudWatch With SNS for Notification Why use Lambda? Lambda will be an effective solution, when there are events that are need to be performed in a periodic manner. It will also help in infrastructure automation. Example Use Cases. Taking AMIs or Snapshots in a regular interval of time. Adding 2 servers morning at 8.00am when no of servers running is lesser than 30. etc,. Cost Comparision For a scheduled running of a program that triggers the API’s, a dedicated Linux Cron machine is commonly used. Though the program runs few times a day, the instance must be running throughout the year. Cost of a (t1.micro) EC2 machine running for a

Continue reading…