Welcome to OGeek Q&A Community for programmer and developer-Open, Learning and Share
Welcome To Ask or Share your Answers For Others

Categories

0 votes
510 views
in Technique[技术] by (71.8m points)

Copy file from FTP to ADLS using Azure Data Factory

I am copying a file from FTP server to ADLS using ADF. I want to check whether the source file is completely copied in ADLS or not. How we can achieve this in ADF ?

question from:https://stackoverflow.com/questions/65916667/copy-file-from-ftp-to-adls-using-azure-data-factory

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome To Ask or Share your Answers For Others

1 Reply

0 votes
by (71.8m points)

You can compare the file properties to check if the file is completely copied.

You can use parameters in ADF to find this.

Maybe you can derive File Size at source and sink and them compare, you can compare file names as well to check if all files are copied.

You can follow this to have an idea of how to check file size.

Or, you can see this to check if file exists at destination or not after Copy


与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
OGeek|极客中国-欢迎来到极客的世界,一个免费开放的程序员编程交流平台!开放,进步,分享!让技术改变生活,让极客改变未来! Welcome to OGeek Q&A Community for programmer and developer-Open, Learning and Share
Click Here to Ask a Question

...