PowerBI desktop connection to Azure Data lake storage Gen2 syncing large amounts of phantom data

[TsholofeloM]

Hello PowerBI community  I need direction with a bit of a strange issue. We have a data lake storage account with one container and a folder that has 2 sub folders. All in all the files within the container make up about 12GB in size. We are connecting to the Azure Data lake storage Gen2 from PowerBI desktop and coming up against a very strange issue. The size of all the files in the folder adds up to 12GB however the connection from PowerBI keep trying to sync up to 240GB of day. I am not sure where this phantom data is coming from, has anyone every experienced this before? #PowerBIdesktop #Azuredatalakestoragegen2

[TsholofeloM · Accepted solution]

Turns out the issue was with my query.

This article saved me a lot of time and helped me resolve the issue.

https://www.linkedin.com/pulse/convert-azure-tags-cost-reporting-power-bi-fix-anders-keis-hansen-/ 

[Anonymous]

Hi  @TsholofeloM ,

One solution is to clear the metadata cache in Power BI Desktop. To do this, go to the "File" menu and select "Options and settings" > "Options" > "Data Load" > "Clear Cache". If clearing the cache doesn't resolve the issue, you may need to check if there are any hidden files or folders in your data lake storage account that are contributing to the larger file size. You can also try to refresh the connection to your data lake storage account and see if that helps.

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly. 

[TsholofeloM]

Hi @Anonymous 

I appreciated you getting back to me.

I did clear the cache however turns out the issue is with my query.

[Anonymous]

Hi @TsholofeloM ,

Could you tell me if your problem has been solved? If it is, kindly Accept it as the solution. More people will benefit from it. Or if you are still confused about it, please feel free to let me know.

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly.