Amazon Managed Streaming for Kafka
Amazon Managed Stream for Kafka (MSK) makes it easy to ingest and process streaming data in real time with fully managed Apache Kafka.
Amazon Managed Stream for Kafka publishes both logs and metrics to CloudWatch. Using Honeycomb’s AWS integrations, you can send that data to Honeycomb.
How it works
AWS CloudWatch provides Subscription Filters, which can be configured to forward all logs in a log group to a Kinesis Firehose destination. Kinesis Firehose then streams those logs to Honeycomb. Some AWS services use an additional step in the workflow that uses Lambda to structure log data before sending it to Honeycomb. Log data for Amazon API Gateway is unstructured and does not use this step.
AWS CloudWatch provides Metric Streams, which forward all metrics captured to third-party destinations. Metrics are streamed to Honeycomb using AWS Kinesis Data Firehose.
This service sends logs to CloudWatch and then forwards them (unstructured) to Honeycomb via Kinesis Firehose. It also sends metrics to CloudWatch and also forwards them to Honeycomb via AWS Kinesis.