Technical writing on aviation data infrastructure, real-time systems, and the engineering decisions behind production-grade platforms.
How SkyAlgorithm replaced hand-written Airflow DAGs with metadata-driven aviation pipelines for lineage, versioning, previews, schema drift handling, and safer reruns.
Read more about From Airflow DAGs to Metadata-Driven Aviation PipelinesHow SkyTrace turns raw ADS-B updates into a clean flights table using per-aircraft state, fallback takeoff and landing rules, gap handling, and idempotent reprocessing.
Read more about Reconstructing Flights from Raw ADS-BHow we built a dual-mode data platform for aviation: ADS-B, FlightAware, and weather ingest via Kafka and JetStream, MinIO-backed lakehouse with Iceberg and Trino, TimescaleDB hot path, and Airflow orchestration — running the same data layout on full cloud and lightweight edge deployments.
Read more about Building an Aviation Data Platform: From Raw Telemetry to LakehouseA technical account of how SkyTrace is built: ADS-B ingest, Kafka and JetStream streaming, hot-path querying, lakehouse storage, and the WebGL map that turns it into an operational surface.
Read more about SkyTrace: A Real-Time Aviation Telemetry PlatformWe work on data infrastructure, platform architecture, and applied AI for aviation and mission-critical operations. Happy to talk through it.