Get a DemoStart Free TrialSign In


Ship Fluentd events

Fluentd is an open source data collector which can be used to collect event logs from multiple sources. It filters, buffers and transforms the data before forwarding to one or more destinations, including Logstash.

Follow this step by step guide to get 'logs' from your system to

Step 1 - Install the output plugin

Our fluentd output plugin is available as a gem on RubyGems.
gem install fluent-plugin-logit

Step 2 - Configure the output plugin

Add the following to your fluentd configuration.

<match **>
  @type logit
  port "Port not found, contact support"
  buffer_type file
  buffer_path /tmp/
  flush_interval 2s

Ensure the match clause is correct for the events you wish to send to Buffering is optional but recommended.

Step 3 - Check for your logs

Data should now have been sent to your Stack.

View my data

If you don't see logs take a look at How to diagnose no data in Stack below for how to diagnose common issues.

Step 4 - how to diagnose no data in Stack

If you don't see data appearing in your Stack after following the steps, visit the Help Centre guide for steps to diagnose no data appearing in your Stack or Chat to support now.

Step 5 - Fluentd Logging Overview

Fluentd was developed by Treasure Data & initially released in 2011. Fluentd often draws comparisons with Logstash as both log collectors share some similarities especially when it comes to platform compatibility.

Where these tools differ though can be seen clearly across their configuration difficulty & performance (Logstash is notably easier to configure).

Fluentd on the other hand is known for requiring minimal system resources & can be used with Fluent Bit for an even more lightweight method of forwarding your data.

Fluentd is used by many of the world's biggest technology companies, including Atlassian, Microsoft & AWS.

For this configuration guide, we’ve covered using both Logstash & Fluentd together for forwarding your data for further log analysis and processing using ELK (Elasticsearch, Logstash & Kibana).

Fluentd is also often used alongside Bigquery as a scalable method of performing queries against log data from Google Cloud. A centralised platform for log management can easily prove a more than suitable replacement for this, such as the platform we have here at Logit.

The platform is built to allow you to drive data-driven insights from your logs & brings together Fluentd & Logstash for full observability of your logs in a single centralised platform. Our platform offers a complete solution for centralising your log files from multiple applications and servers and provides a Fluentd log analyser as standard.

If you need any more help with migrating your Fluentd to Logstash the team are here to help. Feel free to visit our Help Centre or get in contact with our support team by sending us a message via live chat & we'll be happy to assist.

Return to Search
Sign Up

© 2024 Ltd, All rights reserved.