Kubernetes Logging

Ship Kubernetes container logs to your hosted Logstash instance at Logit

Filebeat is a lightweight shipper that enables you to send your Kubernetes logs to Logstash and Elasticsearch. Configure Filebeat using the pre-defined examples below to start sending and analysing your Kubernetes logs.

Step 1 - Download Manifest

Download the filebeat Kubernetes deploy manifest using the link below:

Click to download filebeat-kubernetes.yaml

Step 2 - Insert Stack Details

Open the manifest and around line 76 you should see the environment variables controlling the logging destination. You need to update them to point to your stack.

env:
- name: LOGSTASH_HOST
  value: "your-logstash-host"
- name: BEATS_PORT
  value: "your-ssl-port"

Step 3 - Deploy Pod

Now your deployment manifest is updated, you can deploy it using.

kubectl apply -f filebeat-kubernetes.yaml

Step 4 - Confirm Completed Deployment

kubectl --namespace=kube-system get ds/filebeat

kubectl --namespace=kube-system get pods

You should see a pod for each kubernetes node with a name similar to filebeat-abcde listed. The pods should work though from Pending to Running within a couple of minutes as the containers are downloaded and started.

Step 5 - Kubernetes Logging Overview

Kubernetes was open-sourced in 2014 by Google and has quickly become one of the most popular container management tools on the market as it helps to significantly lower the cost of cloud computing & provides a resilient framework for deploying applications.

A common challenge for effective Kubernetes log aggregation is that during spikes data can easily be lost and not accounted for without a scalable logging solution such as Logit. Our platform also provides log tailing for real-time monitoring of your Kubernetes metrics.

This provides many advantages over the commonly used Kubectl. Kubectl requires having direct access to your clusters and is prone to security and compliance issues that do not occur through the use of our platform.

Logit’s container monitoring platform is built to collect, parse, and transform application logs from your Kubernetes clusters within a few steps using the power of the managed Elastic Stack. Monitor across 1,000s of containers, layers, logs levels, and data types, in one centralised logging platform & save hours on monthly maintenance to support the ELK Stack.

If you need any further help with migrating your Kubernetes log files using Filebeat we're here to help. Feel free to get in contact with our support team via live chat & we'll be happy to assist.

Expand View