Forum Discussion
Refreshing Fabric DataLake CSV files
Hello,
I am testing setting up a Lakehouse by uploading some CSV files thorugh Dataflow Gen2 in a Fabric enabled workspace. These files are located in a shared drive within our company. I can access and upload the files just fine, but if I make updates to the CSV files , how can I have the information changes reflected in the Lakehouse? When I refresh the Dataflow, I am not seeing any changes reflected in the tables.
Is there a good way to approach setting this up or is this not an optimal structure to rely on CSV files like this in the first place?
Thank you for your help!
Hi , Almizu
According to your description, you upload your csv thorugh Dataflow Gen2 in a Fabric enabled workspace, dose it in this in my understand:
And we can see the prompt box around the "Upload file"(Files will be uploaded to your OneDrice for Business account), i think this is why the csv in your PC have updated but the dataflow gen2 can not detect the changes:
Because we upload the current file to our OneDrice for Business folder, even if your local file changes, the csv in OneDrice for Business is still the data you uploaded.
You can go to your OneDrive to view the successfully uploaded csv file:So for your question, if you want to view the latest data in Dataflow gen2, you need to re-upload your latest csv file to OneDrive, and then refresh Dataflow gen2 to view the latest data.
If you want to connect to a local csv file, then you need to download the local data gateway to connect to your local csv file, for this , you can refer to :
Power Query Text/CSV connector - Power Query | Microsoft LearnOn-premises data gateway - Power BI | Microsoft Learn
And you can also see the video for the detailed steps:
Power BI Dataflow - Access On-Premise Data Using a Gateway - Bing videoThank you for your time and sharing, and thank you for your support and understanding of PowerBI!
Best Regards,
Aniya Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly
1 Reply
Hi , Almizu
According to your description, you upload your csv thorugh Dataflow Gen2 in a Fabric enabled workspace, dose it in this in my understand:
And we can see the prompt box around the "Upload file"(Files will be uploaded to your OneDrice for Business account), i think this is why the csv in your PC have updated but the dataflow gen2 can not detect the changes:
Because we upload the current file to our OneDrice for Business folder, even if your local file changes, the csv in OneDrice for Business is still the data you uploaded.
You can go to your OneDrive to view the successfully uploaded csv file:So for your question, if you want to view the latest data in Dataflow gen2, you need to re-upload your latest csv file to OneDrive, and then refresh Dataflow gen2 to view the latest data.
If you want to connect to a local csv file, then you need to download the local data gateway to connect to your local csv file, for this , you can refer to :
Power Query Text/CSV connector - Power Query | Microsoft LearnOn-premises data gateway - Power BI | Microsoft Learn
And you can also see the video for the detailed steps:
Power BI Dataflow - Access On-Premise Data Using a Gateway - Bing videoThank you for your time and sharing, and thank you for your support and understanding of PowerBI!
Best Regards,
Aniya Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly