https://community.fabric.microsoft.com/t5/Pipelines/Only-want-to-load-specific-records-from-into-a-second-dataframe/m-p/4263695#M6129 <P>Are you trying to use a Copy Data activity to do this or using a Notebook?<BR />I'm not sure you can do much table filtering in a Copy Data activity.<BR />If you are using a notebook, then you can simply do this using an inner join, but selecting only the columns from the first table.&nbsp; (The equivalent of a 'WHERE IN' clause.)<BR /><BR /></P><LI-CODE lang="python">result = tableA.join(tableB, tableA.col1 == tableB.col99, "inner") \ .select(tableA.col1, tableA.col2, tableA.col3)</LI-CODE> Wed, 30 Oct 2024 10:22:14 GMT spencer_sa 2024-10-30T10:22:14Z https://community.fabric.microsoft.com/t5/Pipelines/Only-want-to-load-specific-records-from-into-a-second-dataframe/m-p/4263628#M6128 <P>I have a week-dataframe which contains a list of specfic weeks.</P><P>But now i want to load the fact table into a fact-dataframe, but only for the weeks that do exist in the week-dataframe</P><P>Do can i do this?</P><P>&nbsp;</P><P>Thanks in advanced</P> Wed, 30 Oct 2024 09:36:05 GMT https://community.fabric.microsoft.com/t5/Pipelines/Only-want-to-load-specific-records-from-into-a-second-dataframe/m-p/4263628#M6128 amien 2024-10-30T09:36:05Z https://community.fabric.microsoft.com/t5/Pipelines/Only-want-to-load-specific-records-from-into-a-second-dataframe/m-p/4263695#M6129 <P>Are you trying to use a Copy Data activity to do this or using a Notebook?<BR />I'm not sure you can do much table filtering in a Copy Data activity.<BR />If you are using a notebook, then you can simply do this using an inner join, but selecting only the columns from the first table.&nbsp; (The equivalent of a 'WHERE IN' clause.)<BR /><BR /></P><LI-CODE lang="python">result = tableA.join(tableB, tableA.col1 == tableB.col99, "inner") \ .select(tableA.col1, tableA.col2, tableA.col3)</LI-CODE> Wed, 30 Oct 2024 10:22:14 GMT https://community.fabric.microsoft.com/t5/Pipelines/Only-want-to-load-specific-records-from-into-a-second-dataframe/m-p/4263695#M6129 spencer_sa 2024-10-30T10:22:14Z