Forum Discussion
Where Do I Start With Consuming Source Files That can be Queries in Fabric Data Warehouse
What BI tool will you use? (Power BI?)
Will you query the files directly from your BI tool? Or will you load the data from the files into delta tables first, and then query the delta tables from your BI tool?
Could you write the contents of your files into a Delta table (by using Notebook), and use Notebook to add the Business Effective Date as a column in the Delta table?
Community ChampionWhat BI tool will you use? (Power BI?)
Will you query the files directly from your BI tool? Or will you load the data from the files into delta tables first, and then query the delta tables from your BI tool?
Could you write the contents of your files into a Delta table (by using Notebook), and use Notebook to add the Business Effective Date as a column in the Delta table?
We are going to continue using MicroStrategy. After months of trying and multiple high end consultants, we can't get Power BI to do Multi Fact Table analysis.
The plan is to query the data from MicroStrategy. I'm very new to the MicroSoft eco system and did not know how to get started. Not having File headers is definitly a complicating matter. I'm a little familur with Pipelines, but never used Notebook. Would I have to write a Notebook job for each file? or can it use Meta-data? I'm going to start reading about Note book.
- frithjof_v
I'm not quite sure what is meant by Multi Fact Table analysis.
If it is the same as Multi Fact Star Schema, then it should be quite straightforward to work with it in Power BI. https://community.fabric.microsoft.com/t5/Desktop/creating-a-multi-fact-star-schema/m-p/272010
I don't have experience with Microstrategy.
I think it should be possible with only one notebook for all the files. The notebook should be able to loop through the files, and do transformations, adding schema, column headers, etc. by using python code. I don't have super much experience with notebook, and I am not sure what a crawler is, but I think notebook should be good for working with manipulating files in directories, adding schema (column headers) and writing to tables like delta tables.
Notebook can be run on a schedule, or triggered by a Data pipeline.
If you can share some screenshots or illustrations of the files and the data structures you will be working with, it could be easier to understand and give suggestions.