Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago
Solved

read from azure storage container folder

hello,

I have managed to get the .csv file from the web page and place it into the azure storage container using the copy activity in fabric data factory.

Now I would like to read that .csv file, format some of the columns and then append this into a warehouse table (I created this table already)

any suggestions please?

thanks

pipelines
  • v-cboorla-msft's avatar
    v-cboorla-msft
    2 years ago

    Hi Anonymous 

     

    I would to like to understand what are you trying to achieve with the help of pre-script? If you are looking to adding the additional column value to warehouse, then you simply continue with mapping option. 

    If your query is different, please share more details of your query for better understanding.

     

    Thank you.

7 Replies

  • v-cboorla-msft's avatar
    v-cboorla-msft
    Microsoft Employee
    2 years ago

    Hi Anonymous 

     

    Thanks for using Microsoft Fabric Community.

    You can read the .csv file from azure storage container and append it to Fabric Warehouse by using Copy activity in Fabric Pipeline.

    I hope this information helps. Please do let us know if you have any further queries.

     

    Thank you.

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      I see...

      In that case, question please:

      1- in the destination tab - pre-script - before data is inserted into a warehouse table, get the filename (I know I can get the filename at source copy activity using $$FILENAME but not sure how to pass it into the pre-script box in destination tab.

      thanks

      • v-cboorla-msft's avatar
        v-cboorla-msft
        Microsoft Employee
        2 years ago

        Hi Anonymous 

         

        I would to like to understand what are you trying to achieve with the help of pre-script? If you are looking to adding the additional column value to warehouse, then you simply continue with mapping option. 

        If your query is different, please share more details of your query for better understanding.

         

        Thank you.