Forum Discussion
Copy data - if table does not exist in lakehouse, create it. is this possible?
- 1 year ago
Hi wilson_smyth ,
Are you attempting to do this in Azure Synapse or Fabric. Assuming you are attempting to do this in Fabric, you can leverage the Link to Fabric in dataverse which will automatically load dataverse tables into a lakehouse in Fabric. This will automate the ingestion process into Fabric without a need for setting up any pipelines or copy activities. In the case you still needed to reference the data in a separate lakehouse, you can leverage cross-warehouse querying in Fabric, removing the need to load data an additional time.
Here is some official Microsoft documentation around this:- https://learn.microsoft.com/en-us/power-apps/maker/data-platform/azure-synapse-link-view-in-fabric
- https://learn.microsoft.com/en-us/fabric/data-warehouse/tutorial-sql-cross-warehouse-query-editor
If this helped, please mark it as the solution so others can benefit too. And if you found it useful, kudos are always appreciated.
Thanks,Samson
Connect with me on LinkedIn
Check out my Blog
Going to the European Microsoft Fabric Community Conference? Check out my Session
Hi wilson_smyth
I wanted to follow up to see if the suggestions shared earlier by SamsonTruong helped clarify your question about extraction of data from dataverse to a lakehouse using pipelines and copy data task.
If this resolved your issue, please consider marking the response as accepted, as it may help others with similar questions.
We’re happy to help explore other options if needed.
Thank you for being part of the community!
Hi wilson_smyth
I wanted to follow up on the suggestion shared by SamsonTruong earlier about using the Link to Fabric feature in Dataverse to automate loading tables into your Lakehouse.
Could you please let us know if this approach helped resolve your issue, or if you’re still facing any challenges?
We’re here and happy to help with any further questions you might have!