Only want to load specific records from into a second dataframe, based on the first dataframe

[amien]

I have a week-dataframe which contains a list of specfic weeks.

But now i want to load the fact table into a fact-dataframe, but only for the weeks that do exist in the week-dataframe

Do can i do this?

Thanks in advanced

[spencer_sa · Accepted solution]

Are you trying to use a Copy Data activity to do this or using a Notebook?
I'm not sure you can do much table filtering in a Copy Data activity.
If you are using a notebook, then you can simply do this using an inner join, but selecting only the columns from the first table.  (The equivalent of a 'WHERE IN' clause.)

result = tableA.join(tableB, tableA.col1 == tableB.col99, "inner") \
               .select(tableA.col1, tableA.col2, tableA.col3)