Snowflake Copy_history ROW_COUNT while file is still being loaded

Question

When does COPY_HISTORY view's ROW_COUNT column get updated for a file load via snowpipe? I came across a scenario where I received an alert from a monitoring service we setup to poll the view and validate ROW_COUNT value against the actual number of rows in a file (loaded from snowpipe). But when I looked at this view after the alert, I see the counts actually match. Our monitoring service's logs show a mismatch in the counts when this alert was thrown though. Interesting thing is the log was logged 3 seconds BEFORE the LAST_LOAD_TIME in the COPY_HISTORY view. As per documentation this value is the time when the snowpipe finishes loading the file.

My question is does ROW_COUNT column value get update while the file load is in progress?

question from:https://stackoverflow.com/questions/65943042/snowflake-copy-history-row-count-while-file-is-still-being-loaded

Answer 1

Waitting for answers