Send Data from AWS via AWS CloudFormation | Honeycomb

Send Data from AWS via AWS CloudFormation

Honeycomb AWS Integrations can be set up with AWS CloudFormation as your preferred Infrastructure-as-Code (IaC) method and deployment process.

Note
Honeycomb AWS Integrations utilize AWS CloudWatch, Amazon Kinesis, and AWS Lambda to send data to Honeycomb. Refer to How AWS Integrations Work to reference which AWS services use which methods. Note that standard AWS charges apply. Please refer to Amazon for specifics on associated egress costs.

AWS CloudFormation 

Honeycomb provides a CloudFormation template to automate configuration of various AWS services to Honeycomb. Each integration has an independently deployable stack that the template deploys all together with the ability to turn functionality on and off as needed.

Supported CloudFormation Integrations:

  • CloudWatch Logs
  • CloudWatch Metrics
  • RDS Cloudwatch Logs
  • Amazon S3 Bucket Logs

AWS CloudFormation Setup 

Choose from the available AWS CloudFormation templates.

Each integration option features a Launch Stack button and a list of required parameters or inputs during installation.

We also offer a “quick start” AWS CloudFormation template that provides a streamlined path to integrate your AWS environments with Honeycomb. The quick start template uses all of the per-integration templates below to offer the configuration of many integrations in a single CloudFormation stack.

The quick start template may be suitable for many production purposes, but we encourage you to use per-integration templates in a way that suits your AWS environment.

Note
If a misconfiguration happens during AWS CloudFormation installation, it is better to completely delete the CloudFormation stack and re-create it using the quick-create links.

This AWS CloudFormation template allows the configuration of multiple integrations from a single CloudFormation Template.

Select Launch Stack to start the install.

Launch Stack

Required Inputs 

Enter a value for the required input in the UI, or if using the CLI or API, ensure the inclusion of the required input and its value.

  • HoneycombAPIKey: Your Honeycomb Team’s API Key.
Note
All other parameters are optional. If you provide no additional parameters, the template only creates an S3 Bucket.

This AWS CloudFormation template integrates up to six Cloudwatch Log Groups and ships them to a Honeycomb dataset.

Select Launch Stack to start the install.

Launch Stack

Required Inputs 

Enter a value for each required input in the UI, or if using the CLI or API, ensure the inclusion of each required input and its value.

  • HoneycombAPIKey: Your Honeycomb Team’s API Key.
  • HoneycombDataset: The target Honeycomb dataset for the Stream to publish to.
  • LogGroupName: A CloudWatch Log Group name. Additional Log Groups can be added with the LogGroupNameX parameters.
  • S3FailureBucketArn: The ARN of the S3 Bucket that will store any logs that failed to be sent to Honeycomb.

This AWS CloudFormation template integrates all metrics flowing to Cloudwatch Metrics and ships them to a Honeycomb dataset.

Select Launch Stack to start the install.

Launch Stack

Required Inputs 

Enter a value for each required input in the UI, or if using the CLI or API, ensure the inclusion of each required input and its value.

  • HoneycombAPIKey: Your Honeycomb Team’s API Key.
  • S3FailureBucketArn: The ARN of the S3 Bucket that will store any logs that failed to be sent to Honeycomb.

This AWS CloudFormation template streams RDS logs from Cloudwatch to a Kinesis Firehose that includes a data transform to structure the logs before it sends them to Honeycomb.

Select Launch Stack to start the install.

Launch Stack

Required Inputs 

Enter a value for each required input in the UI, or if using the CLI or API, ensure the inclusion of each required input and its value.

  • HoneycombAPIKey: Your Honeycomb Team’s API Key.
  • HoneycombDataset: The target Honeycomb dataset for the Stream to publish to.
  • DBEngineType: The Engine type of your RDS database. One of aurora-mysql, aurora-postgresql mariadb, sqlserver,mysql, oracle, or postgresql.
  • LogGroupName: A CloudWatch Log Group name for RDS logs. Additional Log Groups can be added with the LogGroupNameX parameters.
  • S3FailureBucketArn: The ARN of the S3 Bucket that will store any logs that failed to be sent to Honeycomb.

This AWS CloudFormation template supports sending logs from a S3 bucket to Honeycomb.

Select Launch Stack to start the install.

Launch Stack

Required Inputs 

Enter a value for each required input in the UI, or if using the CLI or API, ensure the inclusion of each required input and its value.

  • HoneycombAPIKey: Your Honeycomb Team’s API Key.
  • HoneycombDataset: The target Honeycomb dataset for to publish to.
  • ParserType: The type of log file to parse. Choose one of alb, elb, cloudfront, keyval, json, s3-access, or vpc-flow.
  • S3BucketArn: The ARN of the S3 Bucket storing the logs.