Snowflake Ingest Pipeline - Automatically Remove Ingest Files From Source?

Question

We are wanting to ingest events into snowflake from S3 bucket. I know this is possible from this documentation: https://docs.snowflake.com/en/user-guide/data-load-snowpipe-auto-s3.html

But after the files have been ingested we'd like to either delete the files that have been ingested or remove it form the ingest bucket.

1: Events loaded into ingest bucket via Firehose (or direct) 2: Snowflake automatically ingests events from this bucket 3: Snowflake either A) moves the files to a new bucket or B) sends a message (SNS?) to a process (lambda) to move the processed file out of the ingest bucket.

Is this possible with Snowflake? I'd like to use the automatic pipeline feature but it looks like the only way I can get this behavior would be to write the pipeline ourselves.

question from:https://stackoverflow.com/questions/66049957/snowflake-ingest-pipeline-automatically-remove-ingest-files-from-source

Answer 1

Waitting for answers