Get a DemoStart Free TrialSign In

Amazon EC2

Ship Amazon EC2 Instance metrics to logstash using the logstash Cloudwatch plugin

Send Your DataLogsAWSAmazon EC2 Guide

Follow this step by step guide to get 'logs' from your system to Logit.io:

Step 1 - Create IAM Policy

In the top left corner of your aws console you will notice a services drop down arrow. Open it and from that menu choose IAM.

Select IAM on the left of the menu

Now in the left hand menu you want to select policies. Once you have reached the policies page you want to hit the Create Policy that appears towards the top of the page.

Policies

Creating a policy is essentially defining permissions that you can then assign to an identity (user, group or roles.)

On the create policy screen choose the json tab and enter the following:

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "Stmt1444715676000",
            "Effect": "Allow",
            "Action": [
                "cloudwatch:GetMetricStatistics",
                "cloudwatch:ListMetrics"
            ],
            "Resource": "*"
        },
        {
            "Sid": "Stmt1444716576170",
            "Effect": "Allow",
            "Action": [
                "ec2:DescribeInstances"
            ],
        "Resource": "*"
        }
    ]
}

Create policies editor

At the bottom of the page select review policy and finally on the next page you need to give your policy a name, now hit create policy.

Fill in new policy details

Step 2 - Create IAM User

You are now going to need to create a new user so that you can attach the policy you created in step one, this will outline the responsibilities of this user.

While on the IAM page, in the left hand menu choose users.

Now at the top of the page select Add User.

Add user

Enter a username and make sure to check Programmatic Access, continue onto the next page of creation.

Enter user details

In the next section you want to attach an existing policy. Highlight attach exisiting policies and search the policy list below for your newly created policy.

Attach policies

Continue onwards to the next step, you can choose to set any Tags here but they aren't necessary. Continue onto the User Review, check all settings are correct and select create user.

On the next screen you will be given your Access Key ID and Secret Access Key. You will need to make a note of these or alternatively download the .csv file provided.

View access key ID

Step 3 - Confirm EC2 Instance (Optional)

If you already have an EC2 Instance running you can skip this step.

The easiest way to for the new user to generate some data is to create an EC2 instance so that it can gather the metrics. Select the services drop down and look for EC2, it should come under the heading Compute. On the left hand menu select instances and choose to create a new instance and follow the steps provided.

Once you've created your instance you can move onto the next step.

Step 4 - Configuring Logstash

To finishing setting up your Amazon Cloudwatch input Logit.io will need the following details.

namespace => "AWS/EC2"
region => The Region of your EC2 Instance.
secret_access_key => The Secret Access Key of the user you created.
access_key_id => The Access Key of the user you created.

Logit.io will verify your input before it is applied this should be actioned in less than 24 hours, contact our support team by visiting our dedicated Help Centre or via live chat & we'll be happy to assist.

Step 5 - Check Logit.io for your logs

Now you should view your data:

View my data

If you don't see logs take a look at How to diagnose no data in Stack below for how to diagnose common issues.

Step 6 - Amazon EC2 Overview

Amazon EC2 (also known as Amazon Elastic Compute Cloud) is a cloud computing platform that allows users to rent virtual machines (instances) & provides resizable compute capacity in the cloud.

Our platform can easily collect, parse and analyze your AWS EC2 app & system metrics for Linux & Windows in one centralized location.

To ensure the security of your data on AWS EC2 instances, Logit.io provides you with the ability to tail & filter logs & generate Kibana dashboards on vital metrics including user activity, system audits and allow you to maintain compliance for ISO, GDPR & HIPAA.

Logit.io makes performing troubleshooting and fault monitoring for applications running on AWS EC2 cloud infrastructure easier in comparison to dealing with the complexity associated with distributed cloud services & cloud monitoring topic environments.

Our platform as a service (PaaS) offering is able to fully support a whole host of AWS metrics including those from Kinesis, ELB Applications, VPC, Cloudwatch, CloudTrail, & Amazon RDS.

Return to Search
Sign Up

© 2023 Logit.io Ltd, All rights reserved.