>_
.issue.db
/highway-workflow-engine
Dashboard
Issues
Memory
Lessons
Audit Log
New Issue
Edit Issue #106
Update issue details
Title *
Description
DataShard library (../datashard/) should use gzip compression by default when writing parquet files. This will reduce storage costs and improve I/O performance for task_logs and workflow_logs tables. Location: ~/develop/datashard/ use python `pip install lz4` for that. it must be it's main dependency. the implementaion should be transparent and users shouldn't even notice it. backward compatiblity is not needed, so you can delete the already available data and test it (also snapshots and meta data will point to new data and just time travel will be broken, anyways you can delete the data). fix the tests in ~/develop/datashard/ as well to support this (again it should work as it's internally will be handled during read and write).
Priority
Low
Medium
High
Critical
Status
Open
In Progress
Closed
Due Date (YYYY-MM-DD)
Tags (comma separated)
Related Issues (IDs)
Enter IDs of issues related to this one. They will be linked as 'related'.
Update Issue
Cancel