8 min readCategory: Data Engineering
MLOps Model Registry Patterns: Tracking Artifacts with MLflow & S3
Automating model lineage, hyperparameter logging, and staging-to-production promotion gates in CI/CD pipelines.
#Databricks
5 articles tagged #databricks on developerOS Insights, newest first. Tags are specific topics, tools and technologies; to browse by broader subject, use the categories.
10 min readCategory: Data Engineering
Building CDC Ingestion with Apache Debezium, Kafka, and StarRocks
Streaming PostgreSQL WAL changes into StarRocks real-time analytics engine with sub-second end-to-end latency.
10 min readCategory: Data Engineering
Apache Iceberg vs Delta Lake: Comparing Table Formats for Cloud Data Lakes
Comparing hidden partitioning, ACID transactions, time-travel queries, and multi-engine interoperability across Snowflake and Spark.
8 min readCategory: Data Engineering
Parquet File Format Deep Dive: Row Groups, Dictionary Encoding, and Snappy Compression
Why Parquet files achieve 80%+ compression ratios over CSV: inspecting columnar binary structure, footer metadata, and dictionary encoding.
9 min readCategory: Data Engineering
Real-Time Stream Processing with Apache Flink & Kafka: Event Time vs Processing Time
Handling out-of-order event streams, tumbling vs sliding windows, and watermarking strategies for sub-second streaming analytics.