Data Engineering
Jul 17, 20268 min read
XGBoost vs LightGBM: Benchmarking Tabular Data Processing Speed & Accuracy
Histogram-based decision trees vs depth-wise growth: why LightGBM trains 7x faster on 10M row datasets with equal AUC-ROC scores.
#SQL
Showing all technical articles annotated with the hash-tag #sql.
Data Engineering
Jul 14, 202610 min read
Building CDC Ingestion with Apache Debezium, Kafka, and StarRocks
Streaming PostgreSQL WAL changes into StarRocks real-time analytics engine with sub-second end-to-end latency.
Data Engineering
Jul 13, 202610 min read
Apache Iceberg vs Delta Lake: Comparing Table Formats for Cloud Data Lakes
Comparing hidden partitioning, ACID transactions, time-travel queries, and multi-engine interoperability across Snowflake and Spark.
Data Engineering
Jul 12, 20268 min read
Parquet File Format Deep Dive: Row Groups, Dictionary Encoding, and Snappy Compression
Why Parquet files achieve 80%+ compression ratios over CSV: inspecting columnar binary structure, footer metadata, and dictionary encoding.
Data Engineering
Jul 11, 20269 min read
Real-Time Stream Processing with Apache Flink & Kafka: Event Time vs Processing Time
Handling out-of-order event streams, tumbling vs sliding windows, and watermarking strategies for sub-second streaming analytics.
System Design
Jul 9, 20269 min read
CQRS and Event Sourcing: Building Immutable Audit Logs with EventStoreDB
Decoupling Command write paths from Query read projections for 100% auditable financial and enterprise domain state.
System Design
Jul 6, 20268 min read
Zero-Downtime Database Migrations: The Expand-Contract Pattern in Production
How to rename database columns and alter schema types on 500-million row Postgres tables without holding table locks.