Sharing Context Across Space and Time: Honeycomb for Teams

When Charity and I started pitching Honeycomb, we had a “bit” we would do, on the importance of building for teams: I’d identify her as the {Kafka, Mongo, insert tech-of-the-moment here} expert on the…

Honeycomb Delivers Support for OpenTelemetry - Zero Code Change Required

Challenges with Implementing SLOs

A few months ago, Honeycomb released our SLO — Service Level Objective — feature to the world. We’ve written before about how to use it and some of the use scenarios. Today, I’d like…

Observations on ARM64 & AWS’s Amazon EC2 M6g Instances

At re:Invent in December, Amazon announced the AWS Graviton2 processor and its forthcoming availability powering Amazon EC2 M6g instances. While the first-generation Graviton processor that powered A1 instances was better suited to less compute-intensive…

The Future of Software is a Sociotechnical Problem

“Sociotechnical” I learned this word from Liz Fong-Jones recently, and it immediately entered my daily lexicon. You know exactly what it means as soon as you hear it, and then you wonder how you…

Honeycomb Welcomes New VP Engineering

(Why it’s so important to look inside your org before you look outside) I am delighted to announce that we have a new VP of engineering: our own Emily Nakashima, formerly director of engineering…

They Aren’t Pillars, They’re Lenses

To have Observability is to have the ability to understand your system’s internal state based on signals and externally-visible output. Honeycomb’s approach to Observability is to strive toward this: every feature of the product…

Reducing Build Time with Observability in the Software Supply Chain

Using Honeycomb to remember to delete a feature flag

Feature flags are great and serve us in so many ways. However, we do not love long-lived feature flags. They lead to more complicated code, and when we inevitably default them to be true…

Getting At The Good Stuff: How To Sample Traces in Honeycomb

(This is the first post by our new head of Customer Success, Irving.) Sampling is a must for applications at scale; it’s a technique for reducing the burden on your infrastructure and telemetry systems…

10 tech startups for 2020 that will help the world build more resilient, secure, and observable software

From “Secondary Storage” To Just “Storage”: A Tale of Lambdas, LZ4, and Garbage Collection

When we introduced Secondary Storage two years ago, it was a deliberate compromise between economy and performance. Compared to Honeycomb’s primary NVMe storage attached to dedicated servers, secondary storage let customers keep more data…

Incident Report: Running Dry on Memory Without Noticing

On November 6, 2019, we intermittently rejected 1-3% of customer telemetry data at ingest for four periods of 20 minutes each. The trigger of the incident was a slow memory leak that manifested over…

OpenTelemetry vs OpenTracing | Understanding OpenCensus and Related Terms

This guide provides clarity on past and current projects, how they differ, and what you need to know to futureproof your observability stack.

SLOs Are the API for Your Engineering Team

So You Want To Build An Observability Tool…

I’ve said this before, but I’m saying it again: observability is not a synonym for monitoring, and there are no three pillars. The pillars are bullshit. Briefly: monitoring is how you manage your known-unknowns,…

I test in prod

Understand Your AWS Cost & Usage with Honeycomb

First published in August 2019. AWS bills are notoriously complicated, and the Amazon Cost Explorer doesn’t always make it easy to understand exactly where your money is going. When we embarked on our journey…

Observability — A 3-Year Retrospective

Treading in Haunted Graveyards

Part 1: CI/CD for Infrastructure as Code At Honeycomb, we’ve often discussed the value of making software deployments early and often, and being able to understand your code as it runs in production. However,…