Forum Discussion
Using Copy activity parquet file format, all columns have data type as string
The issue in this case was with Snowflake Instance. We tried same workflow with Azure SQL and it worked fine. In case you are using Snowflake and facing this issue, check out the query execution in Snowflake monitoring queries and you will notice the file format is CSV, you may have to do additional tweaking to get it to parquet.
If you disable the staging during this operation, pipeline doesn't work as well. That's one more thing to checkout.
Hi Anonymous Thank you for the tip. We enabled the check-box, however still the same behavior is persisting.
We are copying from Snowflake SQL to Lakehouse Files in parquet format.
In your screenshot - Processed Table is inside Lakehouse Tables location.
Any processing that needs to be done.
Thank you.
The issue in this case was with Snowflake Instance. We tried same workflow with Azure SQL and it worked fine. In case you are using Snowflake and facing this issue, check out the query execution in Snowflake monitoring queries and you will notice the file format is CSV, you may have to do additional tweaking to get it to parquet.
If you disable the staging during this operation, pipeline doesn't work as well. That's one more thing to checkout.