Forum Discussion
Incremental Load from Azure Data Lake
Dataset is not big. It can be easily imported to PowerBI. Only problem is how do I create a structured data table in PowerBI. If transformation is done on one file and upload in data model then next time refresh overide the exisiting data. I tried "http://exceleratorbi.com.au/combine-excel-workbooks-power-query-method-1/" but when giving data lake as source it gives an error of "An error occurred in the ‘’ query. DataFormat.Error: The supplied file path must be a valid absolute path.".
Looking for urget help
You must have made a mistake in defining the data-connection string for your data lake.
I'd suggest that you create a new query where you simple connect to your data lake and compare that with the function code you've created. If you cannot spot the difference, you can copy BOTH codes here & I will have a look.
Thanks for your promt reply. I am comparing the two queries. I found some issues. Its working now .The question is how this method will automatically refresh data from power bi service. I believe some one has to manually select the files to send to parameters. Currently all data source for multiple pbix file under one folder in data lake. Do we need to have seperate folders to refresh the data automatically once the file ingest on month basis.
Thanks,
Varun
If the files are not large, you can import them all every month.
The method you've chosen will not support any incremental load.