Data processing
DuckDB lab.
Investigate a missing bike count in Zürich, then rearrange a million readings inside Parquet. Every query runs in this tab’s isolated Linux guest.
Field observations · Zürich, 2011
Eleven missing days
Did the bikes disappear, or did the counter stop reporting? Select a day to inspect the readings.
RecordedNo reports
View SQL
File layout · 1,000,000 synthetic readings
How much can DuckDB skip?
Write the same readings in two orders. Query one station and see which row groups the file statistics can rule out.
Build the two Parquet files to inspect their metadata.
Could contain stationRuled out
View SQL
Run your own SQL
The
daily view contains the Zürich counter
observations.
Preparing Linux…
Open the same database with
duckdb /tmp/data.duckdb
This guest has a marker in /tmp. Open a second tab and look for it there.
Compare in a new tab ↗