Forum Discussion

sumanthkakarla's avatar
sumanthkakarla
Helper II
10 months ago

Semantic Model Refresh Not Reflecting Latest Lakehouse Data using data pipeline

Hello All, I'm encountering an unusual issue with one of the data pipelines I built, which extracts data from BigQuery into the Fabric Lakehouse. The pipeline uses a copy activity to move data from ...
Need Help
v-lgarikapat's avatar
v-lgarikapat
Community Support
9 months ago

Hi sumanthkakarla ,

 

We just wanted to follow up with you to see if you had a chance to work on the solution provided by  tayloramy 

 

 

Thanks,

Lakshmi.

sumanthkakarla's avatar
sumanthkakarla
Helper II
9 months ago

Thank you v-lgarikapat 

I'm currently exploring an alternative solution and debating whether to implement that or revert to the PySpark script, which simply triggers the semantic refresh. I initially used that script but later transitioned to the semantic refresh activity, thinking it would be a more robust approach.

However, my semantic model refresh is currently taking over an hour to process 44 million rows. If I end up triggering it twice, I'm not sure this will be a feasible solution from a performance standpoint.

Thanks again, Krishna

  • v-lgarikapat's avatar
    v-lgarikapat
    Community Support
    9 months ago

    Hi sumanthkakarla ,

     

    Thanks for the update.

     

    Best Regards,

    Lakshmi.

  • v-lgarikapat's avatar
    v-lgarikapat
    Community Support
    9 months ago

    Hi sumanthkakarla ,

     

    We just wanted to follow up to see if you’ve had a chance to work on the solution.

     

     

    Thanks,

    Lakshmi.