Skip Menu |

This queue is for tickets about the Perl-Tidy CPAN distribution.

Report information
The Basics
Id: 90265
Status: rejected
Priority: 0/
Queue: Perl-Tidy

People
Owner: Nobody in particular
Requestors: pause [...] tlinx.org
Cc:
AdminCc:

Bug Information
Severity: (no value)
Broken in: 20130922
Fixed in: (no value)



Subject: Tidy does not handle utf8 source code
Tidy die with fatal errors upon encountering valid perl source code that uses utf8. I saw some error related to broken unicode from 5 years ago, but figure that can't be the same bug, since perl's utf8 support has changed quite a bit in 5 years. If it IS the same, that is really bad not having addressed that bug for over 5 years. Is this product still being actively worked on or maintained? Thanks!
Typical message on a working perl file are: 297: unexpected character decimal 240 (360) in script 297: unexpected character decimal 157 (235) in script 297: unexpected character decimal 144 (220) in script 297: unexpected character decimal 138 (212) in script 297: unexpected character decimal 240 (360) in script 297: unexpected character decimal 157 (235) in script 297: unexpected character decimal 144 (220) in script 297: unexpected character decimal 140 (214) in script 297: unexpected character decimal 240 (360) in script 297: unexpected character decimal 157 (235) in script 297: unexpected character decimal 144 (220) in script 297: unexpected character decimal 134 (206) in script 297: Giving up after error Final nesting depth of '{'s is 2 The most recent un-matched '{' is on line 296 296: use constant { #  ^ 1543: To save a full .LOG file rerun with -g
Details about setup (sorry)... Show quoted text
> perl -V
Summary of my perl5 (revision 5 version 16 subversion 2) configuration: Platform: osname=linux, osvers=3.4.6-2.10-default, archname=x86_64-linux-thread-multi uname='linux build34 3.4.6-2.10-default #1 smp thu jul 26 09:36:26 utc 2012 (641c197) x86_64 x86_64 x86_64 gnulinux ' config_args='-ds -e -Dprefix=/usr -Dvendorprefix=/usr -Dinstallusrbinperl -Dusethreads -Di_db -Di_dbm -Di_ndbm -Di_gdbm -Dd_dbm_open -Duseshrplib=true -Doptimize=-fmessage-length=0 -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector -funwind-tables -fasynchronous-unwind-tables -g -Wall -pipe -Accflags=-DPERL_USE_SAFE_PUTENV -Dotherlibdirs=/usr/lib/perl5/site_perl' hint=recommended, useposix=true, d_sigaction=define useithreads=define, usemultiplicity=define useperlio=define, d_sfio=undef, uselargefiles=define, usesocks=undef use64bitint=define, use64bitall=define, uselongdouble=undef usemymalloc=n, bincompat5005=undef Compiler: cc='cc', ccflags ='-D_REENTRANT -D_GNU_SOURCE -DPERL_USE_SAFE_PUTENV -fno-strict-aliasing -pipe -fstack-protector -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64', optimize='-fmessage-length=0 -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector -funwind-tables -fasynchronous-unwind-tables -g -Wall -pipe', cppflags='-D_REENTRANT -D_GNU_SOURCE -DPERL_USE_SAFE_PUTENV -fno-strict-aliasing -pipe -fstack-protector' ccversion='', gccversion='4.7.2 20130108 [gcc-4_7-branch revision 195012]', gccosandvers='' intsize=4, longsize=8, ptrsize=8, doublesize=8, byteorder=12345678 d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16 ivtype='long', ivsize=8, nvtype='double', nvsize=8, Off_t='off_t', lseeksize=8 alignbytes=8, prototype=define Linker and Libraries: ld='cc', ldflags =' -L/usr/local/lib64 -fstack-protector' libpth=/lib64 /usr/lib64 /usr/local/lib64 libs=-lm -ldl -lcrypt -lpthread perllibs=-lm -ldl -lcrypt -lpthread libc=/lib64/libc-2.17.so, so=so, useshrplib=true, libperl=libperl.so gnulibc_version='2.17' Dynamic Linking: dlsrc=dl_dlopen.xs, dlext=so, d_dlsymun=undef, ccdlflags='-Wl,-E -Wl,-rpath,/usr/lib/perl5/5.16.2/x86_64-linux-thread-multi/CORE' cccdlflags='-fPIC', lddlflags='-shared -L/usr/local/lib64 -fstack-protector' Characteristics of this binary (from libperl): Compile-time options: HAS_TIMES MULTIPLICITY PERLIO_LAYERS PERL_DONT_CREATE_GVSV PERL_IMPLICIT_CONTEXT PERL_MALLOC_WRAP PERL_PRESERVE_IVUV PERL_USE_SAFE_PUTENV USE_64_BIT_ALL USE_64_BIT_INT USE_ITHREADS USE_LARGE_FILES USE_LOCALE USE_LOCALE_COLLATE USE_LOCALE_CTYPE USE_LOCALE_NUMERIC USE_PERLIO USE_PERL_ATOF USE_REENTRANT_API Built under linux Compiled at Feb 15 2013 01:19:34 %ENV: PERL5OPT="-Mutf8 -CSA -I/home/law/bin/lib" @INC: /home/law/bin/lib /usr/lib/perl5/site_perl/5.16.2/x86_64-linux-thread-multi /usr/lib/perl5/site_perl/5.16.2 /usr/lib/perl5/vendor_perl/5.16.2/x86_64-linux-thread-multi /usr/lib/perl5/vendor_perl/5.16.2 /usr/lib/perl5/5.16.2/x86_64-linux-thread-multi /usr/lib/perl5/5.16.2 /usr/lib/perl5/site_perl/5.16.2/x86_64-linux-thread-multi /usr/lib/perl5/site_perl/5.16.2 /usr/lib/perl5/site_perl . Ishtar:law/bin> cpan -i Perl::Tidy CPAN::SQLite not installed, trying to work without CPAN: Storable loaded ok (v2.45) Reading '/home/CPAN-ishtar-build-cache/Metadata' Database was generated on Sat, 09 Nov 2013 02:53:02 GMT CPAN: Module::CoreList loaded ok (v3.00) Perl::Tidy is up to date (20130922).
Hi, Perl::Tidy does not handle utf8 encoded files (http://perltidy.sourceforge.net/BUGS.html). There have been offers to develop a patch, but no results yet. I don't have time to work on it myself, but if you or anyone reading this would like to help, let me know, and I can help with integration. Steve On Mon Nov 11 12:59:30 2013, LAWALSH wrote: Show quoted text
> Tidy die with fatal errors upon encountering valid perl source code > that uses utf8. I saw some error related to broken unicode from 5 > years ago, but figure that can't be the same bug, since perl's utf8 > support has changed quite a bit in 5 years. > > If it IS the same, that is really bad not having addressed that bug > for over 5 years. > > > Is this product still being actively worked on or maintained? > > Thanks!
Stated limitation...