/

Lumen Freight

Lumen Freight tracks 2 million shipments in real time

Logistics

MySQL, Kafka → BigQuery

2.1M

2.1M

2.1M

shipments tracked live

4s

4s

4s

median end to end lag

0

0

0

missed scans since launch

Our ops team used to wait until morning for yesterday's data. Now the dock screens update while the truck is still backing in.

Our ops team used to wait until morning for yesterday's data. Now the dock screens update while the truck is still backing in.

Our ops team used to wait until morning for yesterday's data. Now the dock screens update while the truck is still backing in.

Daniel Osei

VP Engineering

The problem

Lumen runs 140 depots across Europe. Scanner events went through a batch job every six hours, so planners were always looking at a stale picture.

The move

Sluice reads the scanner topic in Kafka and the order database in MySQL, joins them in flight and writes to BigQuery partitioned by depot.

The result

Lumen Freight now runs MySQL, Kafka → BigQuery on Sluice with no custom retry or dedupe code. 2.1M shipments tracked live, 4s median end to end lag.

Create a free website with Framer, the website builder loved by startups, designers and agencies.