When loading data into Snowflake via Snowpipe what is the compressed file size recommendation?
When loading data into Snowflake via Snowpipe what is the compressed file size recommendation?
When loading data into Snowflake via Snowpipe, it is recommended to use compressed file sizes between 100-250 MB. This range strikes a balance between optimizing the number of parallel operations and distributing the load efficiently among the servers in an active warehouse, ensuring better performance and cost-efficiency.
To optimize the number of parallel operations for a load, we recommend aiming to produce data files roughly 100MB to 250MB in size, compressed. Splitting large files into a greater number of smaller files distributes the load among the servers in an active warehouse and increases performance. https://community.snowflake.com/s/article/faq-does-snowflake-have-a-recommended-file-size-for-loading
100 to 250 MB
B. 100-250 MB
Correct
We recommend files at least above 10 MB on average, with files in the 100 to 250 MB range offering the best cost-to-performance ratio. https://www.snowflake.com/blog/best-practices-for-data-ingestion