data pipelines
2 TopicsReplacing your ADF Pipelines with Notebooks in Fabric by Bob Duffy
We migrated to Fabric and replaced almost all our ADF Pipelines with notebooks and haven’t looked back. Should you do the same? This session is a look at how and why you can move from a Pipeline centric ETL architecture to a notebook centric ETL for data warehousing. We compare performance, extensibility, developer experience and supportability between the two tools to see which comes out on top. TENTATIVE AGENDA (subject to change, all times listed are in Pacific Time): 7:45am Teams Meeting opens 8:00am-8:05 am Welcome 8:05am-9:05am Feature Presentation 9:05am-9:10am Wrap-up REGISTRATION: This meet-up will be hosted on Microsoft Teams and will be recorded for those who cannot attend live. To access the Teams Meeting link, you must RSVP for the event. JOINING THE EVENT: Attendees can join the Teams Meeting starting at 7:45 am PST on the day of the event. The link will be visible only if you RSVP beforehand. The event will begin at 8:00 am PST. Please ensure you are on mute to minimize background noise and distractions. During the presentation, type your questions and comments into the chat area, which will be monitored by the event hosts. There will be a Q&A session at the end, where you can unmute your mic and share your video to ask questions.Microsoft Fabric limitations
I am working on Microsoft Fabric but noted few limitations. I just want to confirm do we have any workarounds any soon updaes from Microsoft on these problems - 1. Connection information like server, database name,credentials (e.g. with on prim SQL server) can't be dynamic. Currently only Lakehouse,Datawarehouse and KSQL is supporting dynamic connections. 2.Keyvault is not integrated with connections like how we can use it in Linkedservices in ADF. Either we have to give Basic or Windows authentication 3.Event trigger which is in preview is supporting only ADLS gen 2 not even Onelake folders 4.Notebooks can't be nested in folders. Like create one parent folder and added related notebooks within it like Databricks. Please can we confirm these limitations and if any idea about workaround or updates from Microsoft side.Solved4.2KViews0likes2Comments