The ultimate Fabric, Power BI, SQL, and AI community-led learning event. Save €200 with code FABCOMM.
Get registeredEnhance your career with this limited time 50% discount on Fabric and Power BI exams. Ends September 15. Request your voucher.
Hi Community
I am looking into moving some datapipelines from Synapse into Fabric. We have few that just read delimited text files (non compressed). However it seems like the copy activity no longer support “Skip line count”.
Is this really correct or is there something I am missing? I know I could wrangle data in a notebook but if I just want to read a delemitted textfile and replace a table that should not be necessary?
Regards
Kim Tutein
Screendump:
Solved! Go to Solution.
Hi @KimTutein
Thanks for reaching out to Microsoft Fabric Community Form.
Microsoft Fabric's Data Factory currently lacks support for the "skip line count" option when reading delimited text files in copy activity. In Azure Synapse, users had the ability to skip header rows or unwanted lines, but this functionality is not yet available in Fabric.
If you need to skip lines, you can use PySpark in a notebook to filter out specific rows during data ingestion.
To request this feature, you can submit an idea to the Microsoft Fabric Ideas forum. Microsoft reviews user requests, and popular features may be added in future updates.
When submitting, explain how this feature helped in Synapse and why it is needed in Fabric.
If the above information is helpful, please give us Kudos and mark the response as Accepted as solution.
Best Regards,
Community Support Team _ C Srikanth.
Hi @v-csrikanth
Thank you for your answer. I feared it was simply not implemented. But yes I am aware that I may do it in a notebook. As I need other wrangling of this data I will opt for the notebook.
Hi @KimTutein
Thanks for reaching out to Microsoft Fabric Community Form.
Microsoft Fabric's Data Factory currently lacks support for the "skip line count" option when reading delimited text files in copy activity. In Azure Synapse, users had the ability to skip header rows or unwanted lines, but this functionality is not yet available in Fabric.
If you need to skip lines, you can use PySpark in a notebook to filter out specific rows during data ingestion.
To request this feature, you can submit an idea to the Microsoft Fabric Ideas forum. Microsoft reviews user requests, and popular features may be added in future updates.
When submitting, explain how this feature helped in Synapse and why it is needed in Fabric.
If the above information is helpful, please give us Kudos and mark the response as Accepted as solution.
Best Regards,
Community Support Team _ C Srikanth.