Forum Discussion
Power BI incremental refresh from Shopcada store using API
Hello Perfecta,
We regret the inconvenience caused. Please consider raising a Microsoft support ticket for further investigation. You can explain all the troubleshooting steps you have taken to help them better understand the issue.
You can create a Microsoft support ticket with the help of the link below:
https://learn.microsoft.com/en-us/power-bi/support/create-support-ticketIf this helps, please "Accept as solution" and drop a "Kudos" so other members can find it more easily.
Thank you.
Hi Perfecta
Based on available info, it sounds like the source doesnt fully support incremental refresh because its using an API.
The suggestions from Microsoft are to use a staging layer. Basically its means if you can move you API call to a SQL DB or something similar then that could work.
Another thing I would suggest is, can you move you Power Query M code to a Power BI Dataflow?
Dataflows sit in the cloud and they have slightly different behaviour to local queries. You can try moving the query to a Data flow and then connect to the data flow through desktop. The Data flow also supports incremental refresh. It should be easy to setup and you simply need to copy paste your query to a dataflow. Worth testing.
Sharing refresh history details too
Hi Perfecta,
Thank you for reaching out to the Microsoft fabric community forum.
The error message: "The column 'created_at' of the table wasn't found" indicates that the refresh is failing due to the absence of a required column during part of the process. This is especially important in the context of incremental refresh, where consistent column structure is critical.
Since you're connecting to an API source, it's important to note that such sources typically don’t support query folding, which incremental refresh depends on to optimize filtering logic. In these cases, schema reliability and data consistency across all refresh windows become even more important.
To improve refresh reliability and scalability, we recommend using a staging layer such as a Dataflow or a Lakehouse table to standardize your data before loading it into Power BI for incremental refresh. This approach also provides better control over schema consistency and helps isolate issues related to API behaviour.
Thank you, m4ni for sharing your valuable insights.
If this information is helpful, please “Accept as solution” and give a "kudos" to assist other community members in resolving similar issues more efficiently.
Thank you.
Hi Perfecta,
I hope the information provided has been useful. Please let me know if you need further clarification or would like to continue the discussion.
If your question has been answered, please “Accept as Solution” and Give “Kudos” so others with similar issues can easily find the resolution.
Thank you.