Forum Discussion
DataSource.Error: Microsoft SQL: Error handling external file: 'Invalid: Parquet file size is 0 byte
Ok so here is my journey: Tried to use PQ Online - but face a cap of 10 minutes, and kept getting a 10 minute timeout error, and the data flow would fail. So, I did 80% in PQ, Online in a Gen2 D...
You can exclude the SUCCESS file during copy, by using wild card to specify the files to be copied. Something like this:
If you used "file path" option, there too if you specify the "file format" as parquet, it shouldnt have copied the success file. If that happens, it looks like a bug, please let me know if that was the case.
Thank you. I will try it. It never occured to me to use a WildCard Copy.