Error reading CSV File

[BernardinoBMM]

Im trying to read a CSV file and upload it to a DB2-400 database, The CVS data is pipe separated and I set the configuration to read CVS task as follow:

Field Delimiter = pipe
Record Delimiter=CRLF
Text Qualifier = none
Encoding =

When GAW read the file it fail with the following error:
Invalid record was found with boundaries '3198, 0, 3199, 0'. Invalid character '"' at line '3.198' and column '57. The field must be enclosed with in '"' characters.

the line where its fails look like this

ok--->20100132754|30|150122|01|PASEO DE LA REPUBLICA|5545|-|01|SAN ANTONIO|-|LOCAL
fail-->20100048885|13|150135|04|FIORI |115|A"|12|CENTRO COMERCIAL

its seam that GAW is especting the " caracter even text qualifier is "none"

[david_SD]

Bump.

I have the same issue trying to read a "CSV" file, except using a tab delimiter. Some of the data contains double-quote characters, so I expected the tab delimiter and textQualifer=none setting to correctly read the file into a column-based record set.

Code: Select all

<readCSV inputFile="${TheFile}" outputRowSetVariable="RSOut" fieldDelimiter="tab" skipInvalidRecords="false" skipFirstRow="true" recordDelimiter="LF" textQualifier="none" version="1.0" />

When the project reaches the first record with a double quote in it, it blows up.

Code: Select all

1/5/16 7:04:19 AM             ERROR     [9013 - readCSV] D:\Program Files\Linoma Software\GoAnywhere\userdata\tmp\inv_input.txt: Invalid record was found with boundaries '229, 0, 230, 0'. Invalid character '"' at line '229' and column '16. The field must be enclosed with in '"' characters.  

I can't seem to find a way to preserve the data as it is and read it into a columnar record set (i.e. ReadCSV vs. ReadFlatFile). Looking for advice on how to do this.

FWIW, I'm using Director 4.7.0.

Thanks.

[Support_Rick]

David,

The parsing routine expects the quotes (double quotes) in pairs when they exist. This can be an issue with data like inches (23") or feet (13'). That entry does cause issues as it doesn't have a matching " to pair with. Even if you have the text qualifier set to none.

Most customers will do a "searchAndReplace" to remove all the (single) double-quotes .. changing them to a space or some character they can go through and replace afterwards ... say an ! or ^ or % .. something that's not expected in pairs. Then, when they are done, they do the "searchAndReplace" to change it back inside their data. (Most just leave it off all together).

[msm16c]

Rick,

Reviving an old post in the case you may be able to help me. I cam receiving the same error but in my case I am using two quote marks.

Code: Select all

|Lename (pronounced "le-nam"|

In this case, is it the open parenthesis that is causing it to error?

[Support_Rick]

I don't believe it is ...

Please check your End of Record Markers .. .and make sure you're utilizing the correct one. Sometimes people have it setup for CRLF when there's only a CR, or vice-versa.