Azure Table refresh of metadata not working, fields out of date

[ToddChitt]

I am connecting to some Azure Table. All appears to work fine, except that the column list is incomplete. I have added several columns to the tables. I can view these columns in Microsoft Azure Storage Explorer and see for certain that these tables all contain the new columns, AND that the columns are populated. 

But in Power BI Desktop and Power Query, the column list it gets is like three weeks old, missing columns I just added last week. 

I have even manually entered a row with Partition Key = "FOO" and RowKey = "FOO" and can refresh Power BI and SEE THAT ROW, but NOT all the columns in the table.

Yes, I have tried "Refresh Preview" in Power Query. Tried clearing credentials, reconnecting. Nothing seems to work.

Any ideas what is going on and/or how to fix it?

Thanks in advance.

[Anonymous]

Hi @ToddChitt ,

It seems like there might be a metadata caching issue within Power BI Desktop or Power Query.Here are some suggestions for you:

1. Close Power BI Desktop.
2. Navigate to the following path: `C:\Users\[Your Username]\AppData\Local\Microsoft\Power BI Desktop\`
3. Delete the contents of the cache folders.
4. Reopen Power BI Desktop and try to refresh the data and connect the Azure Table Storage.

Can you see the new columns in the power query editor? try a go a few steps back in transform history.
Sometimes if you "expand" a column it will not add new columns and you will need to add those afterwards ie. do the expand-transform again.

To use columns dynamically, you should change the Columns parameter to null. After that, depending on what you do here, change the type of dynamic column list in this script.

Best Regards,

Xianda Tang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[ToddChitt]

I ended up clearing the cache from the Options inside Power BI Desktop. 

But I shouldn't have to. I should be able to do a Refresh Preview of a query in Power Query and have it pull in new columns. After all, isn't that what "Refresh Preview" is supposed to do? It doesn't. 

I see this as a bug.