How to record a scheduled cutoff table in Fabric

[13havya]

Hi All,

I am attempting to replicate some of our cutoff tables on SQL server, to Fabric. 

I created a scheduled flow on Power Automate, that pulls data from a view every month, applies certain filters, and appends the results to a cutoff table, with a timestamp associated with each row, to denote what month the data was logged. 

Currently in SQL we have a cutoff table, with the data logged, a "report name" field and a time stamp. 

We have 3 different cutoff reports, run every month, that are saved into that table.

Is there a way I can achieve this in a Fabric Lakehouse?

[Anonymous · Accepted solution]

HI @13havya,

I'd like to suggest you to use notebook to handle these operations.
You can use notebook to getting data from sql server and load to the dataframe, then you can use withcolumn to add new column based on current datetime values to record the cutoff values.

Lakehouse tutorial: Prepare and transform data in the lakehouse 
Regards,

Xiaoxin Sheng

[13havya]

Thanks @Anonymous , 

Still getting the hang of data transformations on Fabric, but this is a good resource