Forum Discussion

Bokazoit's avatar
Bokazoit
Continued Contributor
7 months ago
Solved

Incremental refresh from API as zip file possible?

I can retrieve the data as a zip file, unpack it and load it into a table in Power BI desktop, but how to add incremental refresh? CoPilot says that retrieving data as zip file removes query folding,...
Need Help
  • v-hjannapu's avatar
    v-hjannapu
    7 months ago

    Hi Bokazoit,
    I hope the information provided above assists you in resolving the issue. If you have any additional questions or concerns, please do not hesitate to contact us. We are here to support you and will be happy to help with any further assistance you may need.

    Regards,
    Community Support Team.

anilelmastasi's avatar
anilelmastasi
Super User
7 months ago

Hi Bokazoit ,

 

Is it possible to load data into a database? You can use database as staging area and dbs support query folding.

  • anilelmastasi's avatar
    anilelmastasi
    Super User
    7 months ago

    Loading data into database is best practice but if you use Fabric, you can ingest data with Dataflow Gen2.

    After that you can write results into Lakehouse table and build your model on top of the lakehouse.

     

    If this solved your issue, please mark it as the accepted solution. āœ…

  • Bokazoit's avatar
    Bokazoit
    Continued Contributor
    7 months ago

    We are moving away from traditional Data warehouse. But I can use Dataflow Gen2 with a PPU licens?

    • v-hjannapu's avatar
      v-hjannapu
      Community Support
      7 months ago

      Hi Bokazoit,

      Yes, Dataflow Gen2 can be used with a PPU license. Since you are moving away from a traditional data warehouse, this option should work well for you.

      Incremental refresh will not work directly on ZIP files, but you can use Dataflow Gen2 to load and transform the data and store it in a Lakehouse table. Once the data is in the Lakehouse, you can build your model on top of it and use incremental refresh there.

      So using Dataflow Gen2 as an intermediate step is the supported way to handle this scenario.

      Hope this clarifies. Please let us know if you need any help setting this up.
      Regards,
      Community Support Team.

      • v-hjannapu's avatar
        v-hjannapu
        Community Support
        7 months ago

        Hi Bokazoit,
        I hope the information provided above assists you in resolving the issue. If you have any additional questions or concerns, please do not hesitate to contact us. We are here to support you and will be happy to help with any further assistance you may need.

        Regards,
        Community Support Team.