Supplies are limited. Contact info@espc.tech right away to save your spot before the conference sells out.
Get your discountScore big with last-minute savings on the final tickets to FabCon Vienna. Secure your discount
Hi Community
I am looking into moving some datapipelines from Synapse into Fabric. We have few that just read delimited text files (non compressed). However it seems like the copy activity no longer support “Skip line count”.
Is this really correct or is there something I am missing? I know I could wrangle data in a notebook but if I just want to read a delemitted textfile and replace a table that should not be necessary?
Regards
Kim Tutein
Screendump:
Solved! Go to Solution.
Hi @KimTutein
Thanks for reaching out to Microsoft Fabric Community Form.
Microsoft Fabric's Data Factory currently lacks support for the "skip line count" option when reading delimited text files in copy activity. In Azure Synapse, users had the ability to skip header rows or unwanted lines, but this functionality is not yet available in Fabric.
If you need to skip lines, you can use PySpark in a notebook to filter out specific rows during data ingestion.
To request this feature, you can submit an idea to the Microsoft Fabric Ideas forum. Microsoft reviews user requests, and popular features may be added in future updates.
When submitting, explain how this feature helped in Synapse and why it is needed in Fabric.
If the above information is helpful, please give us Kudos and mark the response as Accepted as solution.
Best Regards,
Community Support Team _ C Srikanth.
Hi @v-csrikanth
Thank you for your answer. I feared it was simply not implemented. But yes I am aware that I may do it in a notebook. As I need other wrangling of this data I will opt for the notebook.
Hi @KimTutein
Thanks for reaching out to Microsoft Fabric Community Form.
Microsoft Fabric's Data Factory currently lacks support for the "skip line count" option when reading delimited text files in copy activity. In Azure Synapse, users had the ability to skip header rows or unwanted lines, but this functionality is not yet available in Fabric.
If you need to skip lines, you can use PySpark in a notebook to filter out specific rows during data ingestion.
To request this feature, you can submit an idea to the Microsoft Fabric Ideas forum. Microsoft reviews user requests, and popular features may be added in future updates.
When submitting, explain how this feature helped in Synapse and why it is needed in Fabric.
If the above information is helpful, please give us Kudos and mark the response as Accepted as solution.
Best Regards,
Community Support Team _ C Srikanth.
User | Count |
---|---|
4 | |
4 | |
2 | |
2 | |
2 |
User | Count |
---|---|
10 | |
8 | |
6 | |
6 | |
6 |