Forum Discussion

ajomat's avatar
ajomat
Frequent Visitor
2 years ago

Incremental loading from MySQL database to fabric Lakehouse using Dataflow

Hello everyone, I have a query about performing an incremental loading from MySQL database to Fabric Lakehouse, but it seems like my queries are not foldable. I read from some other internet sources...
Need Help
ajomat's avatar
ajomat
Frequent Visitor
2 years ago

Hi,

Thank you for the response.
It seems like my queries are not foldable at the source.

I followed the same step in SQL server database and the query was folding at source (the source was not greyed out and was marked as green - Screenshot below). It worked there.

But when I used MySQL database the source is greyed out and the incremental refresh is not working anymore. This is what I could see in the window (screenshot below).

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi audreygerred ,thanks for the quick reply, I'll add further。

Hi ajomat ,

Regarding your question, the documentation does not state that Mysql supports query folding. If query folding is missing, then incremental refresh loses its meaning. There is no specific solution for the moment, you can only move the data to a data source that supports query folding. For example, SQL Server.

Query folding on native queries - Power Query | Microsoft Learn

  • ajomat's avatar
    ajomat
    Frequent Visitor
    2 years ago

    Thank you Anonymous for the response. 
    Yes, it seems like there is no other solution at the moment. I hope Microsft will rectify this in the next update.