Send Data to an Amazon S3 Archive using Pipeline Builder
Ent+Beta
Note
This feature is available as an add-on for the Honeycomb Enterprise plan.
This feature is in beta.
Please contact your Honeycomb account team for details.
If you have configured an Amazon S3 bucket as an archive for unsampled OpenTelemetry trace and log data in Honeycomb, you can configure your telemetry pipeline to export data to that archive with the Send To S3 Archive component.
Navigate to Manage Data in the left navigation menu.
Select Pipelines.
Select your target Pipeline.
To update your current pipeline configuration, select Edit as draft, or to create a new draft, go to the Drafts tab and select New draft.
On the Pipeline Builder canvas, add the Send To S3 Archive output to your configuration by dragging the component onto the canvas or by selecting the plus button ().
Select the Send To S3 Archive component and set the following properties in the view on the right:
Bucket: The Amazon S3 bucket to store the data.
Region: The AWS region to store the data. For example, us-east-1.
Prefix (optional): A prefix to use when writing files to S3. For example traces-logs-directory.
PartitionFormat (optional): By default, organizes subdirectories with minute resolution.
Timeout: 30s
Marshaler: otlp_proto
BatchTimeout: 30s
BatchSize: 500000
QueueSize: 500000
Next, connect your intended receiver or processor component to your newly-created Send To S3 Archive component by selecting and dragging the traces and logs connections between each component.
).
