Bug #30501 for Text-Unidecode: Incorrect transliteration of \x{8e}

Mon Nov 05 14:47:20 2007 labassistant [...] nese.com - Ticket created

Subject:	Incorrect transliteration of \x{8e}
Date:	Mon, 5 Nov 2007 14:47:02 -0500
To:	bug-Text-Unidecode [...] rt.cpan.org
From:	"Gavin Bisesi" <labassistant [...] nese.com>

Download perlv
application/octet-stream 2.7k

Message body not shown because it is not plain text.

In Text::Unidecode v0.04, \x{8e} (é) is transliterated as an empty string rather than as "e". Output of "perl -V" is in the attachment.

Tue Nov 06 19:06:12 2007 sburke [...] cpan.org - Correspondence added

From:

SBURKE [...] cpan.org

\x{8e} is correctly transliterated as empty-string, because \x{8e} is not "é" in Unicode; it is nothing, thence, nothing. Text::Unidecode requires that the input be in Unicode. You're apparently forgetting to apply the Encoding filter that would translate your non-Unicode encoding, into Unicode. (My spidey sense is tingling and telling me your encoding is the old-timey encoding MacAscii, but that's just a guess.)

Tue Nov 06 19:06:13 2007 The RT System itself - Status changed from 'new' to 'open'

Tue Nov 06 19:07:09 2007 sburke [...] cpan.org - Status changed from 'open' to 'rejected'

Wed Nov 07 12:37:32 2007 labassistant [...] nese.com - Correspondence added

Subject:	Re: [rt.cpan.org #30501] Incorrect transliteration of \x{8e}
Date:	Wed, 7 Nov 2007 12:37:07 -0500
To:	bug-Text-Unidecode [...] rt.cpan.org
From:	labassistant <labassistant [...] nese.com>

Thanks very much, and you're right, I am on a mac (macperl 5.8.6; OS X 10.4, primarily). How do I change that string to unicode? Would I use Encode::encode_utf8()? Thanks for the timely reply. On Nov 6, 2007, at 7:06 PM, via RT wrote: Show quoted text

> > <URL: http://rt.cpan.org/Ticket/Display.html?id=30501 > > > \x{8e} is correctly transliterated as empty-string, because \x{8e} is > not "é" in Unicode; it is nothing, thence, nothing. > Text::Unidecode requires that the input be in Unicode. > > You're apparently forgetting to apply the Encoding filter that would > translate your non-Unicode encoding, into Unicode. > > (My spidey sense is tingling and telling me your encoding is the > old-timey encoding MacAscii, but that's just a guess.) > >

Wed Nov 07 12:37:35 2007 The RT System itself - Status changed from 'rejected' to 'open'

Wed Jan 30 16:43:16 2008 sburke [...] cpan.org - Status changed from 'open' to 'rejected'