#549 [API/Perf] logs.py full table scan without predicate pushdown

closed high Created 2025-12-17 16:30 · Updated 2025-12-17 19:58

Description

Edit
File: api/blueprints/v1/logs.py:127-224. _read_table_to_pandas reads ALL parquet files into memory, THEN filters in pandas. For query like 'get log for workflow_run_id X', loads 100000 rows to return 1 row. FIX: Implement predicate pushdown using pyarrow filters.

Comments

Loading comments...

Context

Loading context...

Audit History

View All
Loading audit history...