Would be great if there was a way to append data to an existing data model ; without the table having to completely refresh. As data is loaded into the model iteratively it would be good if you can update the DM and for power query not having to completely reload the entire set. Refer to post: http://forum.powerpivotpro.com/forums/topic/append-to-existing-data-model/#post-4064
4 Comments
- nishalitNew MemberIn Excel/PQ you can achieve this by loading your Jan data, Feb data, etc. queries into the Excel worksheet, then have your "All Data" query append data from multiple spreadsheet tables, rather than appending the source queries themselves.
- rob_robertsNew MemberThanks Miguel - the challenge I have is each months rowcount is in excess of 1.2 million rows - therefore the excel worksheet gets maxed out. I give a bit of background on the design; We use Oracle Data Integrator to ETL the data from source into Oracle Exadata, we have built an Oracle repository (business meta data layer) on the back of the data and we connect to the OBIEE instance through ODBC to pull the data through. Each months data is stored in a separate catalogue within OBIEE (ie: Jan 2016, Feb 2016, Mar 2016) So I have created ower query connections to each month but need to perform the append in the same excel data model. I have worked out a workaround by manually downloading the data from OBIEE into a csl file on my local laptop, wrote a batch file to combine the files then I load and refresh this straight into powerpivot as we also had a challenge with the time it took to bring 1.2million + data cross the network so I thought if I bring local then it would process quicker.
- trevecpaNew MemberHas there been any progress on this request? I have looked through the discussions on this topic. I have the same issue with years of data with each year being over 1 million rows. I only need the current year to refresh and leave prior year queries alone. Updating remotely takes forever.
- fbcideas_migusrNew MemberStatus added:Completed
Recent ideas
Power BI - incorrect handling of empty string parameter in DAX query in paginated report
Blank string parameters in paginated reports are treated as empty strings in Power BI Report Builder but as null values in the Power BI Service, resulting in incorrect report output. -> Create a pag...roshinikumarkar2 hours agoMicrosoft EmployeeNew20Views5likes0CommentsAllow NotebookUtils getSecret() to authenticate with Workspace Identity
Current behavior In Microsoft Fabric, notebookutils.credentials.getSecret() authenticates against Azure Key Vault using the identity of the user who executes the notebook. This behavior appli...tmihara3 hours agoNew MemberNew17Views1like1CommentAllow us to rename fabric data agents published to m365
If we use deployment pipelines to promote fabric data agents between dev, test/UAT, and prod fabric workspaces, we need to keep the name of the fabric agent the same in each workspace. If we want to ...PeterDaniels10 hours agoAdvocate IIINew187Views0likes2Comments