Forum Discussion

Anonymous

Not applicable

2 years ago

Dataset fail to refresh regularly: The XXX column does not exist in the rowset

We have several PBI report with parquet files stored in ADLSG2 as datasource. There are multiple parquet files per dataset. To load all the parquet files at once we added below line in advance edito...

Icon for Super User rank

Super User

2 years ago

Hi Anonymous

I would suggest looking at the new parquet connector in power query. What should help you to successfully refresh data? Power Query Parquet connector - Power Query | Microsoft Learn

Anonymous

Not applicable

2 years ago

According to my test, the parquet connector can only read a specific parquet file. But we need it read a specific folder with several parquet partitions and files.

GilbertQ
Super User
2 years ago
Hi Anonymous

In Power BI it is possible to read multiple files in a folder and then connect to the Parquet files.
- Anonymous
  Not applicable
  2 years ago
  Sorry for not making myself clear.
  Currently I am using a M query (connectors/powerbi/fn_ReadDeltaTable.pq at master · delta-io/connectors (github.com) ) to load multiple parquet files in a folder.
  I am still learning so although the script is working, I don't know which connector it is using and why it is fail from time to time.