Forum Discussion
manishbeniwal
3 years agoFrequent Visitor
How to transfer one table into multiple tables?
I have a big table of 3M+ records, I want to transfer my table data into SQL, So please suggest: How can I transfer my data so that going forwards that process should be automatically transfer my d...
jennratten
Super User
3 years agoHello - here are some suggestions and things to consider...
- What is the source of your table? If it is possible to have the data written to SQL from the source instead of Power BI that is usually a preferred approach.
- Why are you needing to write to SQL from Power BI? Are you performing transformations on the data and/or combining multiple data sources and need the resulting table to be written to SQL? Depending on the scenario, it still may be best to handle this in SQL without Power BI.
- If writing from Power BI is the best option, consider how the table is structured and how you can use the datapoints to programmatically query the data in batches and write to SQL. For example, if you have a date column in the table 1/1/2022 - 12/31/2022, you could split the data by month. You would define the range of months that are present in the data and query the data using a variable to represet each month, essentially each iteration would be month + 1. An easy way to handle this would be to use Power Automate, which can query the dataset, create the variable, issue a DAX query against a dataset, write the result to SQL and perform the job in a loop and on a schedule.