Forum Discussion

dnauflett's avatar
dnauflett
Frequent Visitor
2 years ago
Solved

Where Do I Start With Consuming Source Files That can be Queries in Fabric Data Warehouse

Hello,   I know how to do this in AWS, but want to make sure I start on the correct path with MicroSoft Fabric Warehouse.    We receive 520 files from our core system everyday.  We want to create a...
Dataflows
Need Help
  • frithjof_v's avatar
    frithjof_v
    2 years ago

    What BI tool will you use? (Power BI?)

     

    Will you query the files directly from your BI tool? Or will you load the data from the files into delta tables first, and then query the delta tables from your BI tool?

     

    Could you write the contents of your files into a Delta table (by using Notebook), and use Notebook to add the Business Effective Date as a column in the Delta table? 

frithjof_v's avatar
frithjof_v
Icon for Community Champion rankCommunity Champion
2 years ago

What BI tool will you use? (Power BI?)

 

Will you query the files directly from your BI tool? Or will you load the data from the files into delta tables first, and then query the delta tables from your BI tool?

 

Could you write the contents of your files into a Delta table (by using Notebook), and use Notebook to add the Business Effective Date as a column in the Delta table? 

v-cboorla-msft's avatar
v-cboorla-msft
Icon for Microsoft Employee rankMicrosoft Employee
2 years ago

Hi dnauflett 

 

Thanks for using Microsoft Fabric Community.

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond back with the more details and we will try to help.

 

Thank you.

  • v-cboorla-msft's avatar
    v-cboorla-msft
    Icon for Microsoft Employee rankMicrosoft Employee
    2 years ago

    Hi dnauflett 

     

    We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. If you have any question relating to the current thread, please do let us know and we will try out best to help you. In case if you have any other question on a different issue, we request you to open a new thread.

     

    Thank you.

    • dnauflett's avatar
      dnauflett
      Frequent Visitor
      2 years ago

      Sorry for my slow responses,  I'm trying to figure out how to get started.  I'm going to do some reading on Notebook to see if we could use it.  We have about 520 files that we need to expose daily. I was hoping Fabric had some type of crawler that could crawl a directory struture and use Meta-data to define and expose the data for our BI tool.