This feature is available as an add-on for the Honeycomb Enterprise plan.
Please contact your Honeycomb account team for details.
What are Processors?
Processors can be inserted into your telemetry pipeline to transform your data before it arrives at your destination. Adding attributes, filtering, and converting logs to metrics are all the types of transformations we can do using processors in the Honeycomb Telemetry Pipeline Manager.Available Processors for the Honeycomb Telemetry Pipeline Manager
Data Transformation Processors
| Processor | Metrics | Logs | Traces | Description |
|---|---|---|---|---|
| Add Fields | ✓ | ✓ | ✓ | Add attributes, resources, and log record body keys |
| Copy Field | ✓ | ✓ | ✓ | Copy values from one field to another |
| Delete Empty Values | ✓ | ✓ | ✓ | Remove fields with empty or null values |
| Delete Fields | ✓ | ✓ | ✓ | Remove specific fields from telemetry |
| Move Field | ✓ | ✓ | ✓ | Move values between different field types |
| Rename Fields | ✓ | ✓ | ✓ | Rename fields and attributes |
| Rename Metric | ✓ | Rename metric names | ||
| Split | ✓ | ✓ | Split telemetry records into multiple records | |
| Transform | ✓ | ✓ | ✓ | Transform telemetry using custom OTTL statements |
| Unroll | ✓ | Expand arrays into separate log records |
Parsing Processors
| Processor | Metrics | Logs | Traces | Description |
|---|---|---|---|---|
| Parse CSV | ✓ | ✓ | ✓ | Parse CSV-formatted strings into structured data |
| Parse JSON | ✓ | ✓ | ✓ | Parse JSON strings into structured data |
| Parse Key Value | ✓ | ✓ | ✓ | Parse key-value pairs from strings |
| Parse Severity | ✓ | Extract and standardize log severity levels | ||
| Parse Timestamp | ✓ | ✓ | ✓ | Parse timestamps from various formats |
| Parse with Regex | ✓ | ✓ | ✓ | Extract data using regular expressions |
| Parse XML | ✓ | ✓ | ✓ | Parse XML strings into structured data |
Filtering & Sampling Processors
| Processor | Metrics | Logs | Traces | Description |
|---|---|---|---|---|
| Filter by Condition | ✓ | ✓ | ✓ | Filter based on OTTL conditions |
| Filter by Field | ✓ | ✓ | ✓ | Filter based on field values |
| Filter by Regex | ✓ | Filter using regular expressions | ||
| Filter HTTP Status | ✓ | Filter logs based on HTTP status codes | ||
| Filter Metric Name | ✓ | Filter metrics by name patterns | ||
| Filter Severity | ✓ | Filter logs by severity level | ||
| Log Sampling | ✓ | Sample logs to reduce volume | ||
| Deduplicate Logs | ✓ | Remove duplicate log entries |
Data Enrichment Processors
| Processor | Metrics | Logs | Traces | Description |
|---|---|---|---|---|
| Coalesce | ✓ | ✓ | ✓ | Combine multiple fields into a single field |
| Group by Attributes | ✓ | ✓ | ✓ | Group telemetry by attribute values |
| Lookup Fields | ✓ | ✓ | ✓ | Enrich data using lookup tables |
| Resource Detection | ✓ | ✓ | ✓ | Automatically detect and add resource information |
| Redact Sensitive Data | ✓ | ✓ | ✓ | Redact sensitive data in telemetry |
| Rewrite Timestamp | ✓ | ✓ | ✓ | Modify timestamp values |
Aggregation & Statistics Processors
| Processor | Metrics | Logs | Traces | Description |
|---|---|---|---|---|
| Batch | ✓ | ✓ | ✓ | Batch telemetry for efficient processing |
| Compute Metric Statistics | ✓ | Calculate statistics from metric data | ||
| Count Telemetry | ✓ | ✓ | ✓ | Count telemetry records and generate metrics |
| Extract Metric | ✓ | Extract metrics from log data |
Specialized Processors
| Processor | Metrics | Logs | Traces | Description |
|---|---|---|---|---|
| Concat | ✓ | ✓ | ✓ | Concatenate multiple fields into a single field |
| Custom | ✓ | ✓ | ✓ | Custom OpenTelemetry processor configuration |
| Google SecOps Standardization | ✓ | Standardize logs for Google Security Operations | ||
| Marshal | ✓ | Marshal data into specific formats |