Forum Discussion

alee023's avatar
alee023
Frequent Visitor
2 years ago
Solved

Same data transformations to be done on multiple files?

I receive a CSV file on a monthly basis, and I would like to perform the same exact transformation on every new file I receieve. For example, keep certain columns, do calculations based on those colu...
Dataflows
Need Help
  • v-cboorla-msft's avatar
    v-cboorla-msft
    2 years ago

    Hi alee023 

     

    Thanks for using Microsoft Fabric Community.

    As I understand that you want to use the same type of transformations on every new .CSV file that you will receive on monthly basis.

    If the schema of all the .CSV files are similar, then the two scenarios which you have mentioned above would work.

    For your scenario, if simplicity is your main priority Option 1 (Dataflow with SharePoint Source) might be sufficient. No matter which approach you choose, you'll achieve the desired result of automatically transforming your monthly CSV files while maintaining a clear separation between data source management (SharePoint) and data transformation logic (Dataflow).

     

    I hope this information helps. If you have any further questions please do let us know.

     

    Thanks.

     

     

v-cboorla-msft's avatar
v-cboorla-msft
Microsoft Employee
2 years ago

Hi alee023 

 

Thanks for using Microsoft Fabric Community.

As I understand that you want to use the same type of transformations on every new .CSV file that you will receive on monthly basis.

If the schema of all the .CSV files are similar, then the two scenarios which you have mentioned above would work.

For your scenario, if simplicity is your main priority Option 1 (Dataflow with SharePoint Source) might be sufficient. No matter which approach you choose, you'll achieve the desired result of automatically transforming your monthly CSV files while maintaining a clear separation between data source management (SharePoint) and data transformation logic (Dataflow).

 

I hope this information helps. If you have any further questions please do let us know.

 

Thanks.

 

 

v-cboorla-msft's avatar
v-cboorla-msft
Microsoft Employee
2 years ago

Hi alee023 

 

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.
In case if you have any resolution please do share that same with the community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help.


Thanks.

  • v-cboorla-msft's avatar
    v-cboorla-msft
    Microsoft Employee
    2 years ago

    Hi alee023 

     

    We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others.
    If you have any question relating to the current thread, please do let us know and we will try out best to help you.
    In case if you have any other question on a different issue, we request you to open a new thread.


    Thanks.