VPC Flow Log Setup
Ship logs from VPC to logstash
Configure S3 to send VPC flow logs to Logstash & Elasticsearch with our config example.
Follow this step by step guide to get 'logs' from your system to Logit.io:
Step 1 - Confirm S3 Bucket
Ensure your logs are being sent to an S3 bucket. The following guide from Amazon will help you achieve this if you are not doing this already, you can choose the best way to achieve this, but cloudwatch or cloudtrail are a great place to start:
Step 2 - Ensure Adequate Bucket Permissions
The following permissions applied to the AWS IAM Policy being used:
s3:ListBucket
to check if the S3 bucket exists and list objects in it.s3:GetObject
to check object metadata and download objects from S3 buckets.
Below is how your permissions should appear:
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "SidID",
"Effect": "Allow",
"Action": [
"s3:GetObject",
"s3:ListBucket"
],
"Resource": [
"arn:aws:s3:::your-bucket/*"
]
}
]
}
Step 3 - Start Sending Logs to a Stack
To start sending logs from VPC Flow to your stack you need to setup and apply an AWS input on an available stack.
Logit.io will verify your input before it is applied this should be actioned in less than 24 hours, we will contact you to verify.
Step 4 - Check Logit.io for your logs
Now you should view your data:
If you don't see logs take a look at How to diagnose no data in Stack below for how to diagnose common issues.
Step 5 - how to diagnose no data in Stack
If you don't see data appearing in your Stack after following the steps, visit the Help Centre guide for steps to diagnose no data appearing in your Stack or Chat to support now.
Step 6 - VPC Flow Logs Overview
Sending data from your Amazon VPC to Logit.io is a streamlined process that enhances your AWS ecosystem's visibility and analytical capabilities. Logit.io's robust integration solutions make it effortless to consolidate logs and metrics, providing invaluable insights into your infrastructure's performance and security. With this integration, you can centralize your data, enabling efficient monitoring and troubleshooting while leveraging Logit.io's powerful analytics tools. Additionally, for in-depth insights into AWS EKS it is well worth exploring this dedicated integration. These resources will help empower you to optimize your data analytics capabilities and make informed decisions about your AWS environment. Logit.io's service for AWS logging is renowned for its fully scalable operations, thanks to these integrations.