topic Re: get a list of PDF metadata in Pipelines

get a list of PDF metadata

caomayan — Wed, 06 Nov 2024 15:28:57 GMT

Hi folks! I need to get metadata (created, size, item name etc.) for a bunch of PDF files on Shared drive, how can I achieve this? My plan is to get the childname from the first "Get Metadata", then loop the name into the second "Get Metadata", but it errors out.

Thanks a lot!

Re: get a list of PDF metadata

spencer_sa — Thu, 07 Nov 2024 09:39:11 GMT

How I got it to work for me:
Pipeline. similiar to yours, although my first is looking up all files in a lakehouse.

ForEach Items property

2nd Get Metadata settings - note the .name

And the output

Re: get a list of PDF metadata

spencer_sa — Wed, 06 Nov 2024 22:08:54 GMT

Also note this works with GenII datalake connections too;

Re: get a list of PDF metadata

caomayan — Fri, 08 Nov 2024 16:55:44 GMT

Thanks so much, got it works!

Next, how can I get these fields into a lakehouse table? I am thinking notebook, but didn't find a way yet..

Re: get a list of PDF metadata

spencer_sa — Fri, 08 Nov 2024 20:40:17 GMT

Feed them into a notebook as separate parameters, then either create a dataframe with the parameters and 'append' it to an existing table *or* dynamically generate a SQL INSERT statement with the wanted parameters being used