#107 highway-api: /workflows/{id}/steps/logs hangs - scanning 10k+ parquet files

closed high Created 2025-11-27 00:16 · Updated 2025-11-27 00:17

Description

Edit

The endpoint iterates over all parquet files (10,946) and reads each into pandas. Fix: use pyarrow.dataset with predicate pushdown

Comments

Loading comments...

Context

Loading context...

Audit History

View All

Loading audit history...