Product Updates   Connectors & Integrations  

New Honeycomb Integrations for PostgreSQL

By Eben Freeman  |   Last modified on January 11, 2019

We’re excited to announce that you can now use honeytail and rdslogs to send your Postgres query logs to Honeycomb. Honeycomb helps you answer the following questions (and more) about your database workload:

“What does the overall distribution of query latency look like?”

query latency distribution

“Which queries are responsible for the spikes in query volume that we’re seeing?”

query spike graph

“How did our query workload change after the latest deploy?”

graph of query volume drop

What real observability gets you

Overall database statistics such as blks_read and blks_hit are useful for general tuning, but don’t tell you much about the actual queries your application is running, or how those queries are performing. Query summaries from pg_stat_statements give you an overview of your database’s query workload, but won’t tell you how that workload is changing over time. Importantly, they also don’t tell you anything about individual queries. If instead of a single bad query, you have a single bad user who’s causing excess query volume, how will you tell?

In order to account for database resources not just by query type, but by individual user, you need to retain information about individual raw queries. But amassing a giant query log file isn’t enough if you can’t easily break it down to find what you’re looking for:

  • Which query families are most common?
  • Are queries uniformly slow, or are there latency outliers?
  • Is one client sending too much traffic?
  • How is our workload changing over time?

The Honeycomb integrations collect raw queries as well as normalized versions of queries, making it easy to identify both overall patterns and individual outliers.

Give it a try

If you’re running Postgres yourself, honeytail will consume your query logs and ship them off to Honeycomb. If you’re using Amazon RDS, rdslogs automates the process of downloading your log files from AWS, parsing their contents, and sending extracted events to Honeycomb. You can get started right away:

wget -q -O rdslogs https://www.honeycomb.io/download/rdslogs/1.53
echo 'eb877392fa12fc1e2ae6735a3f6d726e140502a3228fdce66f45472adb7a9227  rdslogs' | sha256sum -c && 
chmod 755 ./rdslogs
rdslogs -i YOUR_RDS_INSTANCE_IDENTIFIER --writekey=YOUR_HONEYCOMB_WRITE_KEY 
  --output=honeycomb --dataset='RDS PostgreSQL' --dbtype=postgresql

Check out the docs to get started, and don’t hesitate to get in touch if you have questions!

 

Related Posts

Product Updates   Instrumentation  

Safer Client-Side Instrumentation with Honeycomb's Ingest-Only API Keys

We're delighted to introduce our new Ingest API Keys, a significant step toward enabling all Honeycomb customers to manage their observability complexity simply, efficiently, and...

Product Updates   News & Announcements  

Now Available: Honeycomb Launches Data Residency in Europe

At Honeycomb, we are very concerned about privacy and data sovereignty—it’s something we take very seriously, and in an effort to serve our customers better,...

Product Updates   Connectors & Integrations  

Introducing Honeycomb’s Microsoft Teams Integration for Enhanced Alert Management

Today marks an exciting milestone at Honeycomb, and we're thrilled to share it with you. We officially launched our integration with Microsoft Teams, a step...