Forum Discussion
fabric notebooks - databricks unity catalog
Hello,
1- we are using ADF and databricks to ingest data into databricks tables using the delta parquet files, etc. All good.
2- I have done a poc which is using fabric data factory with the fabric notebook to do the same tasks as step 1
Question:
With the introduction of the databricks unity catalog, is it possible to show that with fabric, there is no need for us to stick to databricks and no need to-go through the hassle of Unity Catalog?
Thank you
HI arkiboys2,
What type of functions that you used to link databricks to fabric side?
If you are using the shortcut to link databrick, it link the remote data source to fabric side without involve data replication, so these records still be managed with unity catalog mechanism.
If you mean use pipeline or other methods that ETL data to the fabric side. The remote data source management does not affect existed data table usages.Regards,
Xiaoxin Sheng
2 Replies
HI arkiboys2,
What type of functions that you used to link databricks to fabric side?
If you are using the shortcut to link databrick, it link the remote data source to fabric side without involve data replication, so these records still be managed with unity catalog mechanism.
If you mean use pipeline or other methods that ETL data to the fabric side. The remote data source management does not affect existed data table usages.Regards,
Xiaoxin Sheng
Hi arkiboys2 ,
Is your question about the new feature of Fabric - Databricks Unity Catalog Mirroring?
By using Unity Catalog Mirroring you can mirror your unity catalog tables to Fabric and you can build reports on top of it. But if you want to do processing and storing the results back to unity catalog tables , it is not possible. You have store the aggregated results in Fabric Lakehouse or Warehouse.
Thanks,
Srisakthi
-----------------------
If this answer your question please mark accept as solution.
