Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Don't miss out! 2025 Microsoft Fabric Community Conference, March 31 - April 2, Las Vegas, Nevada. Use code MSCUST for a $150 discount. Prices go up February 11th. Register now.

Reply
Toi69___
New Member

Ingest data in a lakehouse's table with the metadata activity output

Hello,

 

I have a get metadata activty wicth return this metadata :

{ "lastModified": "2024-12-17T09:10:43Z", "itemName": "Ventes_allemagne.csv", "executionDuration": 1 }

 

I need to make a table in my lakehouse with two columns : itemName and lastModified with the values from my metadata.

 

How should i do this ?

 

Thank you

1 ACCEPTED SOLUTION

Hi @BenLyon 

 

You can import the CSV file into Lakehouse, convert it into a table, and then use the above method.

 

vnuocmsft_0-1734921806633.png

 

vnuocmsft_1-1734921826448.png

 

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

4 REPLIES 4
v-nuoc-msft
Community Support
Community Support

Hi @Toi69___ 

 

In the data pipeline, add a new Copy Data activity.

 

vnuocmsft_0-1734573676377.png

 

Get Metadata

vnuocmsft_1-1734573807126.png

 

Copy data

vnuocmsft_2-1734573854823.png

 

vnuocmsft_3-1734573896731.png

 

vnuocmsft_4-1734573911412.png

 

Run

vnuocmsft_6-1734574036950.png

 

 

You can get the newmetadata table in lakehouse.

 

vnuocmsft_5-1734573996912.png

 

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

 

 

 

Hello 

 

Great example but in my case i am looking for the metadata from a csv file, not a table.

Do you think you could modified your answer in this case ?

 

Thank so much

Hi @BenLyon 

 

You can import the CSV file into Lakehouse, convert it into a table, and then use the above method.

 

vnuocmsft_0-1734921806633.png

 

vnuocmsft_1-1734921826448.png

 

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

spencer_sa
Super User
Super User

Possibly not the wisest option but assuming your Get Metadata is returning a single object (which I think it has to to return 'last modified')
1 - Create a notebook that accepts a couple of parameters - item name and last modified - into variables
2 - Set the pipeline to pass these two fields from the Get metadata step into parameters of a Notebook activity
3 - Create a dataframe containing these two variables
4 - Write to a table in Append mode.

The code I used to test - first cell is a parameter cell

spencer_sa_0-1734572209003.png


If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Prices go up Feb. 11th.

JanFabricDE_carousel

Fabric Monthly Update - January 2025

Explore the power of Python Notebooks in Fabric!

JanFabricDW_carousel

Fabric Monthly Update - January 2025

Unlock the latest Fabric Data Warehouse upgrades!

JanFabricDF_carousel

Fabric Monthly Update - January 2025

Take your data replication to the next level with Fabric's latest updates!