Start your 14-day free trial today & Get 20% Off All Annual Managed ELK Plans

No Credit Card Required

Try Free

Already have an account? Sign In

Send data via Google Cloud Load Balancing to your Logstash instance provided by

Google Cloud Load Balancing

Ship Google Cloud platform load balancing logs from Pub/Sub to Logstash

Step 1 - Confirm Google Cloud Load Balancing LogsCopy

If you already have logging enabled for your Google Cloud load balancing you can skip to step 2. Instructions on how to configure Google Cloud load balancing can be found here.

Google Cloud provides a basic log viewer, in order to get the logs into your Stack we need to configure a Pub/Sub sink, from where Logstash can collect the logs.

Step 2 - Export Logs to Google Pub/SubCopy

Having located the logs you wish to export, choose the option to CREATE SINK. You will be prompted with the following options. Choose the Cloud PubSub topic option.

You will be then be prompted for:

  • Sink name
  • Sink Service (choose Pub/Sub)
  • Sink Destination (choose create new Cloud Pub/Sub topic)

Once you've entered these details choose create sink. This will ensure that the logs you have specified are directed to the Pub/Sub sink

Step 3 - Create Google Pub/SubCopy

Locate your newly created Pub/Sub topic.

On your topic, click the ellipsis to the right.

Enter a suitable subscription ID and make sure delivery type is set to pull.

Scroll to the bottom of the page and press create.

Step 4 - Create Service AccountCopy

Visit service accounts and choose the project you want to add the service account to. This will be used to retrieve logs from the GooglePubSub and send to Logstash.

Select create a new service account.

Give your service account a name and add the relevant Pub/Sub permissions for the service account.

Now we need to create a key for the service account, this will be used by Logstash to access the service account in order to retrieve logs.

Click into the newly created service account.

Choose the option to a add key and then select create a key option, remember to download the service key as json when prompted.

Step 5 - Configuring LogstashCopy

To start pulling Logs from the Google Cloud Platform pub/sub to your Stack a Logit engineer will configure the Logstash input for you. You can share the following details with our engineers securely over intercom using the button below.

project_id => The complete ID of your project
topic => The name of the topic you created
subscription => The name of the subscription you created
json_key_file => The json key file for your service account.

request input

Toggle View

Expand View

Return to Search