Forum Discussion

DouweMeer's avatar
DouweMeer
Impactful Individual
4 years ago
Solved

Creating connection in model stuck

I saw some references to a maximum of a million record issue related to the topic, but two weeks ago, I was able to import like 30 million records from our database and the Excel files referred did not change. 

Manually refreshes on a selection of tables works, refreshing those tables that fail one by one does work, do it all at once results in a failure. Got back to the November version, still a problem. Different computer, still a problem. Removing the million+ tables from refresh and put a "remove blank rows" on all Excel files, still a problem. 

What am I missing?

  • Turned out that one of the Excel files I receive from another contained the maximum number of columns possible, even though they are not in use. "Remove other columns" turned out to be the solution. 

2 Replies

  • v-luwang-msft's avatar
    v-luwang-msft
    Community Support

    Hi DouweMeer ,

    There is no volume limitation for a load for either DirectQuery or Import. DirectQuery has a limit of rows behind each visual - 1 mln, but Import has no such limit. You have a limit for Import mode - memory usage limited to your computer resources (RAM). So if you have 8 GB of RAM and your report consumes 9 GB then it will fail. You can check usage via Windows Task Manager -> Resource Monitor (https://www.digitalcitizen.life/how-use-resource-monitor-windows-7)

     

     

    Best Regards

    Lucien

  • DouweMeer's avatar
    DouweMeer
    Impactful Individual

    Turned out that one of the Excel files I receive from another contained the maximum number of columns possible, even though they are not in use. "Remove other columns" turned out to be the solution.