A table needs to be loaded. The input data is in JSON format and is a concatenation of multiple JSON documents. The file size is 3 GB. A warehouse size S is being used. The following COPY INTO command was executed:
COPY INTO SAMPLE FROM @~/SAMPLE.JSON (TYPE=JSON)
The load failed with this error:
Max LOB size (16777216) exceeded, actual size of parsed column is 17894470.
How can this issue be resolved?
The issue arises because the JSON column size exceeds Snowflake's maximum LOB size of 16 MB. Setting the STRIP_OUTER_ARRAY=TRUE option in the COPY INTO command will remove the outer array structure, allowing the records within to be loaded into separate rows, addressing the size limitation.
yes, D is correct !If the data exceeds 16 MB, enable the STRIP_OUTER_ARRAY file format option for the COPY INTO <table> command to remove the outer array structure and load the records into separate table rows:
Correct Answer: D
D is correct
D https://docs.snowflake.com/en/user-guide/semistructured-considerations#data-size-limitations Semi-structured Data Size Limitations A VARIANT can have a maximum size of up to 16 MB of uncompressed data. However, in practice, the maximum size is usually smaller due to internal overhead. The maximum size is also dependent on the object being stored. For more information, see VARIANT. In general, JSON data sets are a simple concatenation of multiple documents. The JSON output from some software is composed of a single huge array containing multiple records. There is no need to separate the documents with line breaks or commas, though both are supported. If the data exceeds 16 MB, enable the STRIP_OUTER_ARRAY file format option for the COPY INTO <table> command to remove the outer array structure and load the records into separate table rows
If the data exceeds 16 MB, enable the STRIP_OUTER_ARRAY file format option for the COPY INTO <table> command to remove the outer array structure and load the records into separate table rows: https://docs.snowflake.com/en/user-guide/semistructured-considerations.html#data-size-limitations
It is saying if row size exceeds this limit. here the file size exceed the limit. should not we split it and then upload.
Correct answer is D
https://docs.snowflake.com/en/user-guide/semistructured-considerations.html#data-size-limitations
Correct Answer - B The error “Max LOB size (16777216) exceeded” indicates that the size of the parsed column exceeds the maximum size allowed for a single column value in Snowflake, which is 16 MB. To resolve this issue, the file should be split into multiple smaller files that are within the recommended size range of 100 MB to 250 MB. This will ensure that each JSON document within the files is smaller than the maximum LOB size allowed. Compressing the file, using a larger-sized warehouse, or setting STRIP_OUTER_ARRAY=TRUE will not resolve the issue of the column size exceeding the maximum allowed. References: COPY INTO Error during Structured Data Load: “Max LOB size (16777216) exceeded…”
Correct Answer: D
Ans A ...........
https://community.snowflake.com/s/article/Max-LOB-size-exceeded#:~:text=When%20ingesting%20XML%20or%20JSON,of%20parsed%20column%20is%2017894470. When ingesting XML or JSON documents, if the size of the compressed column data exceeds Snowflake’s limit of 16MB [1], an error may occur: Max LOB size (16777216) exceeded, actual size of parsed column is 17894470.
The message also says that the column size that was read is a bit over 17MB. It's not the entire 3GB file. Wouldn't this create a problem by separating parts of the JSON that should be together?
The correct answer is B. Split the file into multiple files in the recommended size range (100 MB - 250 MB). The error message indicates that the size of the JSON data exceeds the maximum LOB size of 16 MB. This can happen if the JSON data contains large nested arrays or objects.
https://community.snowflake.com/s/article/Max-LOB-size-exceeded#:~:text=When%20ingesting%20XML%20or%20JSON,of%20parsed%20column%20is%2017894470.
D is correct.
Failed on maximum column size