Bug #115434 for Text-BibTeX: Document how to handle UTF-8 in bibtex files

Sat Jun 18 17:22:51 2016 pipping.elias [...] icloud.com - Ticket created

Subject:	Document how to handle UTF-8 in bibtex files
Date:	Sat, 18 Jun 2016 23:22:36 +0200
To:	bug-Text-BibTeX [...] rt.cpan.org
From:	Elias Pipping <pipping.elias [...] icloud.com>

Hi, I’ve been using Text::BibTeX for quite a while now and it’s been serving me very well. Thank you for making that possible! Until earlier today I was using Text::BibTeX::purify_string to sanitise anything that was written to standard output. Now I wanted to print UTF-8 encoded strings, including some that were already in the bibtex file I was reading. It took me quite a while to get that right: Since Text::BibTeX::File::open() hands all its arguments over to IO::File and that class accepts a second argument “<:encoding(UTF-8)” to make it treat its input as UTF-8, I expected to be able to pass “<:encoding(UTF-8)” as the second argument to Text::BibTeX::File::open(). To do so was in fact possible, but did not seem to have any effect. In the end, by looking at the source (in particular the test suite), I found out about Encode::decode_utf8, which allowed me to make things work. It would be nice if that was mentioned somewhere in the documentation of Text::BibTeX::File, assuming it’s the right solution. Best, Elias

Sun Jun 19 08:31:30 2016 ambs [...] cpan.org - Correspondence added

On Sat Jun 18 17:22:51 2016, pipping.elias@icloud.com wrote: Show quoted text

> Hi, > > I’ve been using Text::BibTeX for quite a while now and it’s been > serving me very well. Thank you for making that possible! Until > earlier today I was using Text::BibTeX::purify_string to sanitise > anything that was written to standard output. Now I wanted to print > UTF-8 encoded strings, including some that were already in the bibtex > file I was reading. It took me quite a while to get that right: Since > Text::BibTeX::File::open() hands all its arguments over to IO::File > and that class accepts a second argument “<:encoding(UTF-8)” to make > it treat its input as UTF-8, I expected to be able to pass > “<:encoding(UTF-8)” as the second argument to > Text::BibTeX::File::open(). To do so was in fact possible, but did not > seem to have any effect. > > In the end, by looking at the source (in particular the test suite), I > found out about Encode::decode_utf8, which allowed me to make things > work. It would be nice if that was mentioned somewhere in the > documentation of Text::BibTeX::File, assuming it’s the right solution.

By pure coincidence, we are working on that. You can check https://github.com/ambs/Text-BibTeX/tree/utf8 but still not stable :) Thnks

Sun Jun 19 08:31:30 2016 The RT System itself - Status changed from 'new' to 'open'

Fri Jun 24 15:59:08 2016 ambs [...] cpan.org - Correspondence added

Hi, 0.75_01 should be hitting CPAN. use Text::BibTeX::File->open(file, { binmode => 'utf-8' }) Thanks On Sat Jun 18 17:22:51 2016, pipping.elias@icloud.com wrote: Show quoted text

> Hi, > > I’ve been using Text::BibTeX for quite a while now and it’s been > serving me very well. Thank you for making that possible! Until > earlier today I was using Text::BibTeX::purify_string to sanitise > anything that was written to standard output. Now I wanted to print > UTF-8 encoded strings, including some that were already in the bibtex > file I was reading. It took me quite a while to get that right: Since > Text::BibTeX::File::open() hands all its arguments over to IO::File > and that class accepts a second argument “<:encoding(UTF-8)” to make > it treat its input as UTF-8, I expected to be able to pass > “<:encoding(UTF-8)” as the second argument to > Text::BibTeX::File::open(). To do so was in fact possible, but did not > seem to have any effect. > > In the end, by looking at the source (in particular the test suite), I > found out about Encode::decode_utf8, which allowed me to make things > work. It would be nice if that was mentioned somewhere in the > documentation of Text::BibTeX::File, assuming it’s the right solution. > > > Best, Elias

Fri Jun 24 18:29:49 2016 pipping.elias [...] icloud.com - Correspondence added

Subject:	Re: [rt.cpan.org #115434] Document how to handle UTF-8 in bibtex files
Date:	Sat, 25 Jun 2016 00:29:37 +0200
To:	bug-Text-BibTeX [...] rt.cpan.org
From:	Elias Pipping <pipping.elias [...] icloud.com>

Show quoted text

> On 24 Jun 2016, at 21:59, Alberto Simões via RT <bug-Text-BibTeX@rt.cpan.org> wrote: > > <URL: https://rt.cpan.org/Ticket/Display.html?id=115434 > > > Hi, > > 0.75_01 should be hitting CPAN. > use > > Text::BibTeX::File->open(file, { binmode => 'utf-8' }) > > Thanks

This is great! Works like a charm, too (after addressing [1]). Thanks :) Elias [1] https://github.com/ambs/Text-BibTeX/issues/10

Tue Aug 02 06:14:34 2016 ambs [...] cpan.org - Correspondence added

On Fri Jun 24 18:29:49 2016, pipping.elias@icloud.com wrote: Show quoted text

>

> > On 24 Jun 2016, at 21:59, Alberto Simões via RT <bug-Text- > > BibTeX@rt.cpan.org> wrote: > > > > <URL: https://rt.cpan.org/Ticket/Display.html?id=115434 > > > > > Hi, > > > > 0.75_01 should be hitting CPAN. > > use > > > > Text::BibTeX::File->open(file, { binmode => 'utf-8' }) > > > > Thanks

> > This is great! Works like a charm, too (after addressing [1]). Thanks > :) > > > > Elias > > [1] https://github.com/ambs/Text-BibTeX/issues/10

Marked as fixed. Thanks

Tue Aug 02 06:14:40 2016 ambs [...] cpan.org - Status changed from 'open' to 'resolved'