Honeycomb Blog

There And Back Again: A Honeycomb Tracing Story

grover from sesame street/near-far skit
In our previous post about Honeycomb Tracing, we used tracing to better understand Honeycomb’s own query path. When doing this kind of investigation, you typically have to go back and forth, zooming out and back in again, between your analytics tool and your tracing tool, often losing context in the process. To avoid this annoying and…
Read More...

Level Up With Derived Columns: Understanding Screen Size (With Basic Arithmetic)

bee sudoku image
When we released derived columns last year, we already knew they were a powerful way to manipulate and explore data in Honeycomb, but we didn’t realize just how many different ways folks could use them. We use them all the time to improve our perspective when looking at data as we use Honeycomb internally, so we decided…
Read More...

Level Up With Derived Columns: Basic Comparisons

bee sudoku board
When we released derived columns last year, we already knew they were a powerful way to manipulate and explore data in Honeycomb, but we didn’t realize just how many different ways folks could use them. We use them all the time to improve our perspective when looking at data as we use Honeycomb internally, so…
Read More...

How Honeycomb Uses Honeycomb, Part 9: Tracing The Query Path

This post continues our long-running dogfooding series from How Honeycomb Uses Honeycomb Part 8: A Bee’s Life. To understand how Honeycomb uses Honeycomb at a high level, check out our dogfooding blog posts first — they do a great job of telling the story of problems we’ve solved with Honeycomb. Last week we announced the general availability of…
Read More...

RDS Performance Degradation – Postmortem

Summary Note: all times are UTC unless otherwise noted. On Thursday, May 3 starting at 00:39:08 UTC (Wednesday 17:39 PDT) we experienced a nearly complete outage of the Honeycomb service lasting for approximately 24 minutes. Most services came back online at 2018-05-03 01:02:49 and all customer-facing services were fully restored by 01:07:00. Impact During the…
Read More...

Diving into Kubernetes clusters with Honeycomb

At Honeycomb, we’re excited about Kubernetes. In fact, we’re in the early stages of moving some of our services to k8s. Tools like kops have made getting started with k8s easier than ever. But building clusters is only the beginning – before long you might find yourself with a large number of deployments, pods, and…
Read More...

Sam Stokes talks about data infrastructure on the Data Engineering Podcast

This past week, Honeycomb engineering manager Sam Stokes was interviewed on the Data Engineering Podcast, and in addition to hearing him talk a little about himself (which as far as I can tell, he almost never does) I thought you might want to hear all about Honeycomb’s data infrastructure in Sam’s voice (which is extremely…
Read More...

How Honeycomb Uses Honeycomb Part 8: A Bee’s Life

This post continues our dogfooding series from How Honeycomb Uses Honeycomb, Part 7: Measure twice, cut once: How we made our queries 50% faster…with data. To understand how Honeycomb uses Honeycomb at a high level, check out our dogfooding blog posts first — they do a better job of telling the story of problems we’ve…
Read More...

How Honeycomb Uses Honeycomb, Part 7: Measure twice, cut once: How we made our queries 50% faster…with data

This post continues our dogfooding series from How Honeycomb Uses Honeycomb, Part 6: Instrumenting a Production Service . The entire value proposition of Honeycomb’s columnar store is speed of queries, for instance: Examining over 1.2 million rows and returning 50 time series, aggregating results into 240 (1 minute granularity over 4 hours for this query)…
Read More...

How Honeycomb Uses Honeycomb, Part 6: Instrumenting a Production Service

This post continues our dogfooding series from How Honeycomb Uses Honeycomb, Part 5: The Correlations Are Not What They Seem. In a recent blog post, I talked about what sorts of things should go into an event. That was a lovely and generic list. This post grounds it in our reality – I’m here to…
Read More...