Send Metrics to Honeycomb - Honeycomb Docs

Metrics are well suited to giving a picture of the general health of a host or resource. Honeycomb can consume and display metrics in addition to tracing and telemetry data. These instructions will walk you through working with metric data in Honeycomb.

Send metric data to Honeycomb
Query your metric data
Correlate metric queries with additional data to enhance your insights

Step 1: Send Metric Data To Honeycomb

There are several ways to send metric data to Honeycomb. In general, we recommend that you send metric data to its own dataset.

Send host metrics to Honeycomb with an OpenTelemetry Collector running as an agent on each host
Send metrics from a Prometheus Client
Send AWS metrics from AWS CloudWatch metric streams
An OpenTelemetry SDK can send metrics from within an application

Step 2: Query Your Metric Data

You can query metrics just like any other data in Honeycomb. Metric resources and attributes are simply stored as fields and can be used in WHERE and GROUP BY clauses to plot specific timeseries. Learn more about writing queries for metrics data. Because metric data arrives at known, regular intervals, you may find that your metrics graphs have a spiky appearance where after each metric, the line graph drops to zero before plotting the next point. Some people prefer a continuous line graph, without the drops to zero, because it is easier to identify trends in the data. There are two ways to achieve this continuous line graph:

Modify the Granularity using the time picker in Query Builder. Alternatively, set a default granularity for the dataset.
Enable the Omit Missing Values graph setting on the query. To do this:
1. On the right side of Query Results, select the Settings icon () to display the Display Settings.
2. Select Omit Missing Values.
3. The graph refreshes and should display a continuous line.

Step 3: Correlate Your Metric Data with Additional Telemetry Data to Enhance your Insights

Use the Correlations tab in Query Builder and compare your metric information based on a specific Board with your query results. You gain tremendous insight when you view infrastructure metrics for your systems alongside query results from non-metrics datasets. For instance, a system running out of memory, CPU, or network resources might be the reason for an out-of-compliance SLO or an alerting trigger, and seeing the graph of the problem alongside graphs of relevant system resources could confirm or deny this kind of hypothesis.

Metrics Event Volume

Honeycomb stores metrics in events, and it combines as many metrics into a single event as possible. Every captured data point is stored as a value in an event whose timestamp represents the time of capture. All attributes that uniquely identify the metric’s timeseries are included on the event. Events that contain metrics are most effective (and cost-effective) when many data points for the same resource, same attributes, and same timestamp arrive together. Learn about factors that affect metrics event volume and how to manage it.