1. Docs
2. Send Data to Honeycomb
3. Honeycomb Telemetry Pipeline
4. Pipeline Manager Processors

Pipeline Manager Processors

Ent+

What are Processors? 

Processors can be inserted into your telemetry pipeline to transform your data before it arrives at your destination. Adding attributes, filtering, and converting logs to metrics are all the types of transformations we can do using processors in the Honeycomb Telemetry Pipeline Manager.

Available Processors for the Honeycomb Telemetry Pipeline Manager 

Data Transformation Processors 

Processor	Metrics	Logs	Traces	Description
Add Fields	✓	✓	✓	Add attributes, resources, and log record body keys
Copy Field	✓	✓	✓	Copy values from one field to another
Delete Empty Values	✓	✓	✓	Remove fields with empty or null values
Delete Fields	✓	✓	✓	Remove specific fields from telemetry
Move Field	✓	✓	✓	Move values between different field types
Rename Fields	✓	✓	✓	Rename fields and attributes
Rename Metric	✓			Rename metric names
Split	✓	✓		Split telemetry records into multiple records
Transform	✓	✓	✓	Transform telemetry using custom OTTL statements
Unroll		✓		Expand arrays into separate log records

Parsing Processors 

Processor	Metrics	Logs	Traces	Description
Parse CSV	✓	✓	✓	Parse CSV-formatted strings into structured data
Parse JSON	✓	✓	✓	Parse JSON strings into structured data
Parse Key Value	✓	✓	✓	Parse key-value pairs from strings
Parse Severity		✓		Extract and standardize log severity levels
Parse Timestamp	✓	✓	✓	Parse timestamps from various formats
Parse with Regex	✓	✓	✓	Extract data using regular expressions
Parse XML	✓	✓	✓	Parse XML strings into structured data

Filtering & Sampling Processors 

Processor	Metrics	Logs	Traces	Description
Filter by Condition	✓	✓	✓	Filter based on OTTL conditions
Filter by Field	✓	✓	✓	Filter based on field values
Filter by Regex		✓		Filter using regular expressions
Filter HTTP Status		✓		Filter logs based on HTTP status codes
Filter Metric Name	✓			Filter metrics by name patterns
Filter Severity		✓		Filter logs by severity level
Log Sampling		✓		Sample logs to reduce volume
Deduplicate Logs		✓		Remove duplicate log entries

Data Enrichment Processors 

Processor	Metrics	Logs	Traces	Description
Coalesce	✓	✓	✓	Combine multiple fields into a single field
Group by Attributes	✓	✓	✓	Group telemetry by attribute values
Lookup Fields	✓	✓	✓	Enrich data using lookup tables
Resource Detection	✓	✓	✓	Automatically detect and add resource information
Redact Sensitive Data	✓	✓	✓	Redact sensitive data in telemetry
Rewrite Timestamp	✓	✓	✓	Modify timestamp values

Aggregation & Statistics Processors 

Processor	Metrics	Logs	Traces	Description
Batch	✓	✓	✓	Batch telemetry for efficient processing
Compute Metric Statistics	✓			Calculate statistics from metric data
Count Telemetry	✓	✓	✓	Count telemetry records and generate metrics
Extract Metric		✓		Extract metrics from log data

Specialized Processors 

Processor	Metrics	Logs	Traces	Description
Concat	✓	✓	✓	Concatenate multiple fields into a single field
Custom	✓	✓	✓	Custom OpenTelemetry processor configuration
Google SecOps Standardization		✓		Standardize logs for Google Security Operations
Marshal		✓		Marshal data into specific formats