meta-description - If you happen to have your VPC logs or Load Balancer logs getting collected in your AWS S3 and you want a unified platform to visualize them?, In this tutorial, you will configure how you can send any kind of logs to SigNoz otel collector endpoint from your S3 bucket using…

url - send-logs-via-http

author - priyansh

If you happen to have your VPC logs or Load Balancer logs getting collected in your AWS S3 and you want a unified platform to visualize them?, In this tutorial, you will configure how you can send any kind of logs to SigNoz otel collector endpoint from your S3 bucket using Lambda function

png-

[IMG]

jpeg-

[IMG]

Here’s a quick summary of what we’ll be doing in this detailed article.

Have some data in your S3 bucket → make a lambda function in AWS → add trigger to the lamba function (your S3 bucket, set trigger as PUT/All object creation) → add required policy so you can run the function → Load the objects from S3 → perform log parsing and convert them to JSON dictionary → send them to SigNoz otel-collector endpoint.

Assumptions

1. You have already installed SigNoz using HELM (or Docker) or using SigNoz cloud edition.
2. You have an AWS account with admin privileges.

Creating / Configuring your S3 bucket

Create an S3 bucket if you don’t already have one and upload some data to it. It’s fairly easy to do this, just create a S3 bucket and upload some .json, .csv, .log, or any format you wish (even .gz and .zip).