Fluent Bit

Ship Fluent Bit events and metrics

Fluent Bit is an open source data collector which can be used to collect event logs from multiple sources. It filters, buffers and transforms the data before forwarding to one or more destinations, including Logstash.

Step 1 - Commandline Example

Example commandline configuration to send CPU metrics from Fluent Bit to logstash

docker run -it fluent/fluent-bit:1.8 /fluent-bit/bin/fluent-bit -i cpu -o tcp://your-logstash-host: -p format=json_lines -p json_date_format=iso8601 [email protected]

Step 2 - Example Output Config

If using a configuration file, then add the following to your Fluent Bit config

[OUTPUT]
    Host your-logstash-host
    Port 
    Format json_lines
    json_date_format iso8601
    json_date_key @timestamp

Step 3 - Check Logit.io for your logs

Now you should view your logs:

Launch Dashboard

If you don't see logs take a look at How to diagnose no data in Stack below for how to diagnose common issues.

Step 4 - how to diagnose no data in Stack

If you don't see data appearing in your Stack after following the steps, visit the Help Centre guide for steps to diagnose no data appearing in your Stack or Chat to support now.

Step 5 - Fluent Bit Logging Overview

Fluent Bit often draws comparisons with Logstash as both log collectors share some similarities especially when it comes to platform compatibility.

Where these tools differ though can be seen clearly across their configuration difficulty & performance (Logstash is notably easier to configure).

Fluent Bit on the other hand is known for requiring minimal system resources for more lightweight method of forwarding your data.

For this configuration guide, we’ve covered using both Logstash & Fluent Bit together for forwarding your data for further log analysis and processing using ELK (Elasticsearch, Logstash & Kibana).

The Logit.io platform is built to allow you to drive data-driven insights from your logs & brings together Fluent Bit & Logstash for full observability of your logs in a single centralised platform. Our platform offers a complete solution for centralising your log files from multiple applications and servers and provides a Fluent Bit log analyser as standard.

If you need any more help with migrating your Fluent Bit to Logstash the Logit.io team are here to help. Feel free to visit our Help Centre or get in contact with our support team by sending us a message via live chat & we'll be happy to assist.

Expand View