real-time analytics
2 TopicsETL on Fabric
Hey Guys, I'm new to Fabric, I'm trying to wrap my head around which services I should be using and in what order. I'm trying to reverse engineer our current ETL process for our existing data warehouse on SQL server database. Our ETL is incremental so every day we receive revenue files for yesterday, we also pull data for legacy databases etc... I designed a quick diagram to illustrate how I'm thinking of designing it after I read Fabric documentation. Here are my questions based on the diagram below: 1. What service should I use to push my files from Data Lake Storage Gen2 (DLS) to Lakehouse? 2. Does Dataflow Gen2 do the same thing as Notebook if not, can you please provide an example? 3. How does the Dataflow Gen2 knows that there is a new file in the Lakehouse and it needs to process it? 4. is the Data Pipeline purpose in this diagram just to push the data to the Warehouse? 5. The second image represents the services on Fabric, is it possible to tell me in which order I should start using the services, could you please number each service in the right order of use? Thank youSolved11KViews0likes6CommentsAzure Analysis Service- Fabric
Hi, I'm unable to connect azure analysis service with fabric warehouse. "Invalid credentials. (Session ID: d342ea8c-ff4b-4be4-86ef-25b86bac92ef, Region: europe)." getting this as error even the credentials provided are correct. Please let me know is there any other issues? Thanks, Hamna k s1.3KViews0likes3Comments