Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
Matas
Advocate II
Advocate II

SSIS Skipping Data Rows Error

Hi,

 

I have tried to goole, went into a couple of forums and asked this question, but did not received any concrete answer relates SSIS error while skipping data rows. Hopefully someone from this community have SSIS knowledge and will be able to help out.

 

My Visual Studio version is: 16.11.17

My SSIS package version is: 4.0

 

I am having an issue while trying to load a data from the .csv file since it has something to do with my delimiter "¬¬".

While using this delimiter (and I need to use this one, since all the data comes in this format) I am getting error such as:

Matas_0-1657720917877.png

Matas_1-1657721177109.png

 

 

But if I change this files delimiter using excel, lets say to ";", the result:

Matas_2-1657721827591.png

 

 

 

My Flat File Connection Manager Editor properties looks like:

Matas_4-1657722052913.png

 

Matas_5-1657722193970.png

Matas_6-1657722220640.png

 

 

Regards,

Matas

 

 

 

 

4 REPLIES 4
JamesWick
Helper I
Helper I

I found the short answer for this,

Is the TextQualifier of the Flat File Connection Manaer is set to ‘’ (double simple quote), and there are open ‘’ without closure in the source file?

If so, this combination leads flat file connection manage to consider everything that appears after ‘’ as just text, without processing the double bars, or even the new line character. So, if there is a large amount of data after the ‘’ sign, the buffer overflows.

In this situation, we can use following methods to avoid this issue:

If the file can be modified, removing the ‘’ combination.
If the file cannot be modified, or it is preferred not to do so, we can change TextQualifier to any other character or even to <none>.

Regards,
J Wick

Hi @JamesWick ,

 

Have you looked at my post or just the title of this topic?

Since you are writing about "if TextQualifier" is set to something. I have uploaded the pictures of it, it is clearly visible that in my case the TextQualifier is set to <none> and I do not have any "" in my dataset but thank you for the response.

 

Regards,

Matas

v-jingzhang
Community Support
Community Support

Hi @Matas 

 

Can you please provide a sample file with some dummy data that can reproduce this problem? We can then use it for testing. Thanks. 

 

Best Regards,
Community Support Team _ Jing

Hi @v-jingzhang ,

 

Sure, thank you for clarification.
The link for dummy data: https://we.tl/t-GdxvYzOPom

 

Regards,

Matas

Helpful resources

Announcements
Sept PBI Carousel

Power BI Monthly Update - September 2024

Check out the September 2024 Power BI update to learn about new features.

September Hackathon Carousel

Microsoft Fabric & AI Learning Hackathon

Learn from experts, get hands-on experience, and win awesome prizes.

Sept NL Carousel

Fabric Community Update - September 2024

Find out what's new and trending in the Fabric Community.