Product Updates   Connectors & Integrations  

New Honeycomb Integrations for PostgreSQL

By Eben Freeman  |   Last modified on January 11, 2019

We’re excited to announce that you can now use honeytail and rdslogs to send your Postgres query logs to Honeycomb. Honeycomb helps you answer the following questions (and more) about your database workload:

“What does the overall distribution of query latency look like?”

query latency distribution

“Which queries are responsible for the spikes in query volume that we’re seeing?”

query spike graph

“How did our query workload change after the latest deploy?”

graph of query volume drop

What real observability gets you

Overall database statistics such as blks_read and blks_hit are useful for general tuning, but don’t tell you much about the actual queries your application is running, or how those queries are performing. Query summaries from pg_stat_statements give you an overview of your database’s query workload, but won’t tell you how that workload is changing over time. Importantly, they also don’t tell you anything about individual queries. If instead of a single bad query, you have a single bad user who’s causing excess query volume, how will you tell?

In order to account for database resources not just by query type, but by individual user, you need to retain information about individual raw queries. But amassing a giant query log file isn’t enough if you can’t easily break it down to find what you’re looking for:

  • Which query families are most common?
  • Are queries uniformly slow, or are there latency outliers?
  • Is one client sending too much traffic?
  • How is our workload changing over time?

The Honeycomb integrations collect raw queries as well as normalized versions of queries, making it easy to identify both overall patterns and individual outliers.

Give it a try

If you’re running Postgres yourself, honeytail will consume your query logs and ship them off to Honeycomb. If you’re using Amazon RDS, rdslogs automates the process of downloading your log files from AWS, parsing their contents, and sending extracted events to Honeycomb. You can get started right away:

wget -q -O rdslogs
echo 'eb877392fa12fc1e2ae6735a3f6d726e140502a3228fdce66f45472adb7a9227  rdslogs' | sha256sum -c && 
chmod 755 ./rdslogs
  --output=honeycomb --dataset='RDS PostgreSQL' --dbtype=postgresql

Check out the docs to get started, and don’t hesitate to get in touch if you have questions!


Related Posts

Product Updates  

One-Click Insights with Board Templates

Whether you’re a new Honeycomb user or a seasoned expert looking to uncover fresh insights, chances are you’ve sent tremendous amounts of data into Honeycomb...

Observability   Connectors & Integrations  

Honeycomb + Tracetest: Observability-Driven Development

Our friends at Tracetest recently released an integration with Honeycomb that allows you to build end-to-end and integration tests, powered by your existing distributed traces....

Product Updates  

Feature Focus: April 2023

You know the old saying, I’m sure: “April deploys bring May joys.” Okay, maybe it doesn’t go exactly like that, but after reading what we’ve...