Forum Discussion
Most efficient way to PUSH data into data warehouse
Hi,
I am new to fabric. I have a scenario where I want to push data into my warehouse and not pull it. I know that there is a way to use functions for this, but is this the most efficient way? Any experience here?
Kind regards
I think it depends on what exactly you want to push.
Data that's processed and then is at rest in something like SQL database tables? I'd look at Mirroring.
Data at rest, but it's in files? See if you can use Shortcuts.
If it's being transformed or created by a process like logic apps or Databricks, you'd have to weigh the development time in writing the processes to push the data into a Fabric destination against writing it to a destination you have available and using one of the options I proposed above.
Hopefully this helps. If it does, be sure to accept the solution so others in the community can find it. If not, please provide more context into your source data structures (tables, files, etc.) and your desired storage format in Fabric.
6 Replies
Hey 🙂
there is a data source outside fabric, that wants to push data inside fabric.I think it depends on what exactly you want to push.
Data that's processed and then is at rest in something like SQL database tables? I'd look at Mirroring.
Data at rest, but it's in files? See if you can use Shortcuts.
If it's being transformed or created by a process like logic apps or Databricks, you'd have to weigh the development time in writing the processes to push the data into a Fabric destination against writing it to a destination you have available and using one of the options I proposed above.
Hopefully this helps. If it does, be sure to accept the solution so others in the community can find it. If not, please provide more context into your source data structures (tables, files, etc.) and your desired storage format in Fabric.
Hi TorgeHH
May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.
Thank you.
Hi TorgeHH
I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.
Thank you.Hi TorgeHH
I hope this information is helpful. Please let me know if you have any further questions or if you'd like to discuss this further. If this answers your question, please Accept it as a solution and give it a 'Kudos' so others can find it easily.
Thank you.
