Lumen Freight tracks 2 million shipments in real time
Logistics
MySQL, Kafka → BigQuery
shipments tracked live
median end to end lag
missed scans since launch
Daniel Osei
VP Engineering
The problem
Lumen runs 140 depots across Europe. Scanner events went through a batch job every six hours, so planners were always looking at a stale picture.
The move
Sluice reads the scanner topic in Kafka and the order database in MySQL, joins them in flight and writes to BigQuery partitioned by depot.
The result
Lumen Freight now runs MySQL, Kafka → BigQuery on Sluice with no custom retry or dedupe code. 2.1M shipments tracked live, 4s median end to end lag.