Forum Discussion

dataisdnewtoil's avatar
dataisdnewtoil
Frequent Visitor
1 year ago

Load limit for an Excel data source limits data in the PowerBi Service too

My data source is a huge local Excel file. I use a power query parameter to limit the data load locally but when I publish, only the loaded data seems to get published. As a result, it makes no difference when I update the parameter and refresh data in the PowerBI Service.

 

Short of moving the file to Sharepoint (or similar), is there a solution? Is there a way to make the PowerBI Desktop publish the full dataset?

6 Replies

    • dataisdnewtoil's avatar
      dataisdnewtoil
      Frequent Visitor

      And yes, I have tried changing and refreshing it in the PowerBi workspace but since it never publised the full excel file from my laptop (that's my inference), it doesn't make a difference.

  • dataisdnewtoil's avatar
    dataisdnewtoil
    Frequent Visitor

    The full dataset is too huge to load locally. PowerBi Desktop dies trying. 

  • christinepayton's avatar
    christinepayton
    Most Valuable Professional

    How big are we talking? The swapping parameters like that is a technique that people use to make changes locally without stressing their computer / taking a long time, then refreshing in the service. If it's too big to refresh locally, it's likely going to be too big in the service also, and SharePoint will not make it faster either. If it's a truly large file, putting it in a database (SQL) is your best option. 

    • dataisdnewtoil's avatar
      dataisdnewtoil
      Frequent Visitor

      It's actually not that huge: 65K rows in a 40MB file. Yet PBI Desktop struggles forever while an R script handles it with ease on the same laptop. 

      • christinepayton's avatar
        christinepayton
        Most Valuable Professional

        It really shouldn't be having a problem with that size unless you are doing a bunch of wild transformation on it, or perhaps your computer is lacking resources (Power BI uses a lot of system resources). It might help if you posted the advanced query text so people can see what's going on in the query.