topic Re: Using a wildcard in a get metadata activity to consider a specific set of files in Pipelines

Using a wildcard in a get metadata activity to consider a specific set of files

pmscorca — Sun, 30 Jun 2024 17:06:45 GMT

Hi,

in a get metadata activity of a data pipeline I've tried to use a wildcard as "*.csv" in the file name cell of the file path section, but so the get metadata activity searchs a *.csv file.

It seems that it isn't possible to use an handy wildcard in a get metadata activity?

Any suggests in order to consider a specific set of files? Thanks

Re: Using a wildcard in a get metadata activity to consider a specific set of files

NandanHegde — Mon, 01 Jul 2024 03:30:16 GMT

wildcard is not supported in Get metadata activity

So you would have to use a combination of Get meta data activity and filter activity.

get all files present within the folder via Get meta data activity and then leveraging the filter activity, filter out CSV specific file extensions

Re: Using a wildcard in a get metadata activity to consider a specific set of files

Anonymous — Mon, 01 Jul 2024 09:43:06 GMT

Hi pmscorca ,

As NandanHegde said, the Get Metadata activity does not support wildcard filters on folders/files.