ELK is Outdated? GreptimeDB: The Next-Gen Cloud-Native Log Storage Solution

2025-04-28
ELK is Outdated? GreptimeDB: The Next-Gen Cloud-Native Log Storage Solution

With the explosive growth of log data, the traditional ELK architecture reveals problems such as high storage costs, severe resource waste, and complex maintenance. This article introduces GreptimeDB, a cloud-native database that uses a storage-compute separation architecture, offering advantages such as high compression rates, lightweight design, and easy maintenance. It demonstrates the complete process of log collection, storage, parsing, and querying by combining it with Vector, providing a more modern solution for real-time log monitoring and data analysis.

Read more
Development log storage

Observability 2.0: Beyond the Three Pillars, Embracing Wide Events

2025-04-25
Observability 2.0: Beyond the Three Pillars, Embracing Wide Events

Charity Majors of Honeycomb introduced the concept of 'Observability 2.0,' representing an evolution from the traditional 'metrics, logs, and traces' paradigm. Observability 2.0 centers around 'wide events' as a single source of truth – high-cardinality, high-dimensional event data rich in context. This allows for the retroactive derivation of metrics, logs, and traces, addressing issues like data silos and limitations of pre-aggregation. However, this transition presents challenges in event generation, data transport, storage, and querying. GreptimeDB, an open-source analytical observability database, aims to overcome these hurdles. It supports OpenTelemetry, features a built-in transformation engine, high-throughput real-time ingestion, real-time query APIs, and materialized views, providing a robust infrastructure for Observability 2.0.

Read more
Development

GreptimeDB: A Deep Dive into Error Handling for Large Rust Projects

2024-12-19
GreptimeDB: A Deep Dive into Error Handling for Large Rust Projects

This GreptimeDB blog post delves into their error handling practices within large Rust projects. It details how they built a cheaper, more accurate error stack to replace system backtraces, how they organize errors in large projects, and how they present errors differently to logs and end-users. GreptimeDB leverages the snafu crate for error management and implements a "virtual user stack." This approach proves more efficient and memory-friendly than system backtraces, providing clearer, more understandable error messages for both developers and end-users.

Read more
Development