Any recommendations on which binary format to use when I want to store all the D... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		qwertox on Jan 9, 2024 \| parent \| context \| favorite \| on: Polars Any recommendations on which binary format to use when I want to store all the DataFrames to disk in order to load them at a later point? My data as an indented JSON file takes up around 800 MB.

congoe on Jan 9, 2024 [–]

Parquet works well as it natively support Apache Arrow, the underlying data structure.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact