Migration playbook
Replace Honeycomb with OSS tracing and high-cardinality analysis
A cautious path for replacing Honeycomb-style event analysis with OpenTelemetry pipelines, trace backends, and queryable logs.
Honeycomb replacement should be framed as workflow migration, not just trace storage. Preserve the incident questions engineers ask most often, then decide which exploratory gaps are acceptable.
Recommended OSS Stack
OpenTelemetry Collector
Vendor-neutral telemetry collector for receiving, processing, and exporting traces, metrics, and logs.
Grafana Tempo
High-scale distributed tracing backend. Stores traces in cheap object storage (S3, GCS).
SigNoz
Full-stack, OpenTelemetry-native APM + logs + metrics. The closest single-tool Datadog alternative.
Uptrace
OpenTelemetry APM backed by ClickHouse. Lean alternative to SigNoz.
Quickwit
Rust search engine for logs and traces with sub-second queries directly against S3-compatible object storage.
Grafana
The de-facto open-source dashboard layer. Plug into Prometheus, Loki, Tempo, InfluxDB — one pane of glass.
Stack Options
Migration Phases
Identify Honeycomb behaviors
1-2 weeksOutcome: Boards, triggers, datasets, derived columns, and high-cardinality fields are documented.
- Export or inventory boards, triggers, SLOs, datasets, and query examples.
- List dimensions that engineers rely on during incidents.
- Classify derived columns and BubbleUp-style workflows that need replacement.
Normalize telemetry contracts
2-3 weeksOutcome: OpenTelemetry attributes, sampling rules, and event schemas are stable enough for migration.
- Define required resource and span attributes for services, deploys, users, and tenants.
- Route telemetry through OpenTelemetry Collector processors for redaction and normalization.
- Choose tail, head, or dynamic sampling policies by service criticality.
Rebuild investigation paths
3-4 weeksOutcome: Engineers can answer the most common incident questions without Honeycomb.
- Create trace, service, deploy, and error investigation dashboards.
- Port trigger alerts and compare them against Honeycomb for two release cycles.
- Document where exploratory queries require a different workflow.
Reduce dependency
2-3 weeksOutcome: Honeycomb is no longer the primary incident investigation system.
- Move runbook links and deploy annotations to the OSS stack.
- Keep Honeycomb read access while teams validate edge-case investigations.
- Retire datasets only after owners confirm replacement coverage.
Cutover Checklist
- Required OpenTelemetry attributes are documented and enforced.
- Sampling policy preserves errors, slow traces, and high-value tenants.
- Top incident queries have equivalent workflows.
- Triggers or SLO alerts are recreated and tested.
- Known gaps versus Honeycomb exploratory analysis are explicit.
Risks To Manage
- Honeycomb's exploratory high-cardinality UX does not map cleanly to every OSS backend.
- Poor sampling choices can erase the exact traces needed during an incident.
- Derived columns and dataset conventions may hide business logic that needs to move into telemetry pipelines.