Get a DemoStart Free TrialSign In

HTTP Metrics

Collect and ship HTTP endpoint server metrics to Logstash and Elasticsearch.

Metricbeat is a lightweight shipper that helps you monitor your servers by collecting HTTP endpoint server metrics. Configure Metricbeat using the pre-defined examples below to collect and ship abitrary HTTP endpoint server metrics and statistics to Logstash or Elasticsearch.

Follow this step by step guide to get 'logs' from your system to Logit.io:

Step 1 - Install Metricbeat

To get started first follow the steps below:

Older versions can be found here metricbeat 7, metricbeat 6, metricbeat 5

Step 2 - Copy configuration file

The configuration file below is pre-configured to send data to your Logit.io Stack via Logstash.

Copy the configuration file below and overwrite the contents of metricbeat.yml.

###################### Logit.io Metricbeat Configuration #######################
# =========================== Modules configuration ============================

metricbeat.config.modules:
  # Glob pattern for configuration loading
  path: ${path.config}/modules.d/*.yml

  # Set to true to enable config reloading
  reload.enabled: false

  # Period on which files under path should be checked for changes
  #reload.period: 10s
# ======================= Elasticsearch template setting =======================
setup.template.settings:
  index.number_of_shards: 1
  index.codec: best_compression
  #_source.enabled: false

# ================================== Outputs ===================================
# ------------------------------ Logstash Output -------------------------------
<div class="sw-warning">
    <div>
        <img src="/images/source-wizard/warning-triangle.svg">
    </div>
    <div>
       <b>No input available! </b> Your stack is missing the required input for this data source <a href="#" onclick="Intercom('showNewMessage')" class="btn btn-info btn-sm">Talk to support to add the input</a>
    </div>
</div> 

Step 3 - Enable module

There are several built in metricbeat modules you can use. To enable the HTTP module run.

deb/rpm

metricbeat modules list
metricbeat modules enable http

macOS

./metricbeat modules list
./metricbeat modules enable http

Windows

PS > .\metricbeat.exe modules enable http

Step 4 - Configure module

Each module has its own configuration file where different metricsets can be enabled / disabled. Locate the configuration file for the HTTP module.

deb/rpm /etc/metricbeat/modules.d/http.yml

mac/win ~/<EXTRACTED_ARCHIVE>/modules.d/http.yml

By default the HTTP json and server metricsets are disabled. To enable or disable a metric simply comment or uncomment the line out.

- module: http
  #metricsets:
  #  - json
  period: 10s
  hosts: ["localhost:80"]
  namespace: "json_namespace"
  path: "/"
  #body: ""
  #method: "GET"
  #username: "user"
  #password: "secret"
  #request.enabled: false
  #response.enabled: false
  #json.is_array: false
  #dedot.enabled: false

- module: http
  #metricsets:
  #  - server
  host: "localhost"
  port: "8080"
  enabled: false
  #paths:
  #  - path: "/foo"
  #    namespace: "foo"
  #    fields: # added to the the response in root. overwrites existing fields
  #      key: "value"

Step 5 - Start Metricbeat

Start or restart metricbeat to apply the configuration changes.

Step 6 - Check Logit.io for your logs

Data should now have been sent to your Stack.

View my data

If you don't see logs take a look at How to diagnose no data in Stack below for how to diagnose common issues.

Step 7 - how to diagnose no data in Stack

If you don't see data appearing in your Stack after following the steps, visit the Help Centre guide for steps to diagnose no data appearing in your Stack or Chat to support now.

Step 8 - HTTP Metricbeat Module Overview

The Metricbeat Module for HTTPHTTP is a meticulously designed solution for monitoring services by collecting metrics via HTTP endpoints. Those already acquainted with Metricbeat's broad capabilities in data collection will find its application to HTTP monitoring both intuitive and exceptionally versatile.

HTTP, the foundation of data communication for the World Wide Web, facilitates the transfer of data across web servers and clients. The Metricbeat Module for HTTP leverages this protocol to fetch metrics from specified endpoints, enabling the monitoring of a wide array of services and applications through their HTTP interfaces. This module supports both GET and POST requests, allowing for the retrieval of metrics in various formats such as JSON, XML, or plain text.

This module is invaluable for developers, system administrators, and DevOps professionals who require a flexible solution to monitor the health, performance, and availability of services exposed via HTTP. Our platform extends robust support for the Metricbeat Module for HTTP, offering centralized management of metrics for simplified analysis and active monitoring. This support effectively mitigates the challenges associated with manually collecting and analyzing metrics from various HTTP endpoints.

Should you require assistance with configuring the Metricbeat Module for HTTP or have questions about monitoring your services via HTTP, the Logit.io team is prepared to assist. We encourage you to visit our Help Centre or contact our support team via live chat & we'll be happy to assist.

Return to Search
Sign Up

© 2024 Logit.io Ltd, All rights reserved.