Bug #71963 for xls2csv: Smart Quote Problem (aka Curly Quote)

Wed Oct 26 18:12:52 2011 ronnie.reid [...] kng.com - Ticket created

Subject:	Smart Quote Problem (aka Curly Quote)
Date:	Wed, 26 Oct 2011 16:12:41 -0600
To:	bug-xls2csv [...] rt.cpan.org
From:	Ronnie Reid <ronnie.reid [...] kng.com>

Hi, Thanks for this useful tool. I have an XLS containing smart quotes. When save as CSV, the data in that field is garbled. Example: "Doesn’t Repel Liquids" outputs as: "Doesnt"0 "0R"0e"0p"0e"0l"0 "0L"0i"0q"0u"0i"0d"0s" I've tried using several different character sets, but none seem to help. Ideas? Thanks, Ronnie

Wed Oct 26 18:14:58 2011 ronnie.reid [...] kng.com - Correspondence added

Subject:	Re: [rt.cpan.org #71963] AutoReply: Smart Quote Problem (aka Curly Quote)
Date:	Wed, 26 Oct 2011 16:14:46 -0600
To:	bug-xls2csv [...] rt.cpan.org
From:	Ronnie Reid <ronnie.reid [...] kng.com>

Oops, to clarify, the document has a smart/curly apostrophe, not quote. But I suspect the results will be similar. Thanks On Oct 26, 2011, at 4:12 PM, Bugs in xls2csv via RT wrote: Show quoted text

> > Greetings, > > This message has been automatically generated in response to the > creation of a trouble ticket regarding: > "Smart Quote Problem (aka Curly Quote)", > a summary of which appears below. > > There is no need to reply to this message right now. Your ticket has been > assigned an ID of [rt.cpan.org #71963]. Your ticket is accessible > on the web at: > > https://rt.cpan.org/Ticket/Display.html?id=71963 > > Please include the string: > > [rt.cpan.org #71963] > > in the subject line of all future correspondence about this issue. To do so, > you may reply to this message. > > Thank you, > bug-xls2csv@rt.cpan.org > > ------------------------------------------------------------------------- > Hi, > > Thanks for this useful tool. > > I have an XLS containing smart quotes. When save as CSV, the data in that field is garbled. Example: > > "Doesn’t Repel Liquids" > > outputs as: > > "Doesnt"0 "0R"0e"0p"0e"0l"0 "0L"0i"0q"0u"0i"0d"0s" > > I've tried using several different character sets, but none seem to help. > > Ideas? > > Thanks, > Ronnie

Wed Oct 26 18:27:39 2011 xevocius [...] yahoo.com - Correspondence added

Subject:	Re: [rt.cpan.org #71963] AutoReply: Smart Quote Problem (aka Curly Quote)
Date:	Wed, 26 Oct 2011 18:27:29 -0400
To:	"bug-xls2csv [...] rt.cpan.org" <bug-xls2csv [...] rt.cpan.org>
From:	Ken <xevocius [...] yahoo.com>

Smart quotes are tricky. Sometimes data containing them isnt even in a valid character set. I have had many problems with them in the past. Could you please attach a spreadsheet that has the issue? I'll then see what I can figure out. On Oct 26, 2011, at 6:14 PM, "Ronnie Reid via RT" <bug-xls2csv@rt.cpan.org> wrote: Show quoted text

> Queue: xls2csv > Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=71963 > > > Oops, to clarify, the document has a smart/curly apostrophe, not quote. But I suspect the results will be similar. > > Thanks > > > On Oct 26, 2011, at 4:12 PM, Bugs in xls2csv via RT wrote: >

>> >> Greetings, >> >> This message has been automatically generated in response to the >> creation of a trouble ticket regarding: >> "Smart Quote Problem (aka Curly Quote)", >> a summary of which appears below. >> >> There is no need to reply to this message right now. Your ticket has been >> assigned an ID of [rt.cpan.org #71963]. Your ticket is accessible >> on the web at: >> >> https://rt.cpan.org/Ticket/Display.html?id=71963 >> >> Please include the string: >> >> [rt.cpan.org #71963] >> >> in the subject line of all future correspondence about this issue. To do so, >> you may reply to this message. >> >> Thank you, >> bug-xls2csv@rt.cpan.org >> >> ------------------------------------------------------------------------- >> Hi, >> >> Thanks for this useful tool. >> >> I have an XLS containing smart quotes. When save as CSV, the data in that field is garbled. Example: >> >> "Doesn’t Repel Liquids" >> >> outputs as: >> >> "Doesnt"0 "0R"0e"0p"0e"0l"0 "0L"0i"0q"0u"0i"0d"0s" >> >> I've tried using several different character sets, but none seem to help. >> >> Ideas? >> >> Thanks, >> Ronnie

> >

Wed Oct 26 18:27:41 2011 The RT System itself - Status changed from 'new' to 'open'

Wed Oct 26 18:35:17 2011 ronnie.reid [...] kng.com - Correspondence added

Subject:	Re: [rt.cpan.org #71963] AutoReply: Smart Quote Problem (aka Curly Quote)
Date:	Wed, 26 Oct 2011 16:35:05 -0600
To:	bug-xls2csv [...] rt.cpan.org
From:	Ronnie Reid <ronnie.reid [...] kng.com>

Thanks for the fast reply. See attached. Column AB

Download AllReviewsReport.xls.zip
application/zip 2.5k

Message body not shown because it is not plain text.

On Oct 26, 2011, at 4:27 PM, Ken via RT wrote: Show quoted text

> <URL: https://rt.cpan.org/Ticket/Display.html?id=71963 > > > Smart quotes are tricky. Sometimes data containing them isnt even in a valid character set. I have had many problems with them in the past. Could you please attach a spreadsheet that has the issue? I'll then see what I can figure out. > > > > On Oct 26, 2011, at 6:14 PM, "Ronnie Reid via RT" <bug-xls2csv@rt.cpan.org> wrote: >

>> Queue: xls2csv >> Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=71963 > >> >> Oops, to clarify, the document has a smart/curly apostrophe, not quote. But I suspect the results will be similar. >> >> Thanks >> >> >> On Oct 26, 2011, at 4:12 PM, Bugs in xls2csv via RT wrote: >>

>>> >>> Greetings, >>> >>> This message has been automatically generated in response to the >>> creation of a trouble ticket regarding: >>> "Smart Quote Problem (aka Curly Quote)", >>> a summary of which appears below. >>> >>> There is no need to reply to this message right now. Your ticket has been >>> assigned an ID of [rt.cpan.org #71963]. Your ticket is accessible >>> on the web at: >>> >>> https://rt.cpan.org/Ticket/Display.html?id=71963 >>> >>> Please include the string: >>> >>> [rt.cpan.org #71963] >>> >>> in the subject line of all future correspondence about this issue. To do so, >>> you may reply to this message. >>> >>> Thank you, >>> bug-xls2csv@rt.cpan.org >>> >>> ------------------------------------------------------------------------- >>> Hi, >>> >>> Thanks for this useful tool. >>> >>> I have an XLS containing smart quotes. When save as CSV, the data in that field is garbled. Example: >>> >>> "Doesn’t Repel Liquids" >>> >>> outputs as: >>> >>> "Doesnt"0 "0R"0e"0p"0e"0l"0 "0L"0i"0q"0u"0i"0d"0s" >>> >>> I've tried using several different character sets, but none seem to help. >>> >>> Ideas? >>> >>> Thanks, >>> Ronnie

>> >>

>

Thu Oct 27 11:55:56 2011 perl [...] xev.net - Correspondence added

On Wed Oct 26 18:35:17 2011, ronnie.reid@kng.com wrote: Show quoted text

> Thanks for the fast reply. > > See attached. Column AB >

I tried a few different character sets to see what I could come up with. I think this is what you want (assuming you want a resulting csv file in utf-8): xls2csv -b Windows-1252 -x AllReviewsReport.xls -c test.csv -a utf-8

Thu Oct 27 11:55:57 2011 perl [...] xev.net - Status changed from 'open' to 'resolved'

Thu Oct 27 12:08:07 2011 ronnie.reid [...] kng.com - Correspondence added

Subject:	Re: [rt.cpan.org #71963] Smart Quote Problem (aka Curly Quote)
Date:	Thu, 27 Oct 2011 10:07:55 -0600
To:	bug-xls2csv [...] rt.cpan.org
From:	Ronnie Reid <ronnie.reid [...] kng.com>

Awesome! Thanks, I really appreciate it!!! On Oct 27, 2011, at 9:55 AM, Ken Prows via RT wrote: Show quoted text

> <URL: https://rt.cpan.org/Ticket/Display.html?id=71963 > > > On Wed Oct 26 18:35:17 2011, ronnie.reid@kng.com wrote:

>> Thanks for the fast reply. >> >> See attached. Column AB >>

> > I tried a few different character sets to see what I could come up with. > I think this is what you want (assuming you want a resulting csv file in > utf-8): > > xls2csv -b Windows-1252 -x AllReviewsReport.xls -c test.csv -a utf-8

Thu Oct 27 12:08:07 2011 The RT System itself - Status changed from 'resolved' to 'open'

Sat Jan 21 23:27:08 2012 perl [...] xev.net - Status changed from 'open' to 'resolved'