Bug #81739 for XML-LibXML: Upgrade fail against Perl v5.8.8

Thu Dec 06 05:51:57 2012 jd-bitcard [...] webtrickery.com - Ticket created

Subject:

Upgrade fail against Perl v5.8.8

perl, v5.8.8 built for x86_64-linux-thread-multi bash-3.2# uname -a Linux <servername> 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:48 EDT 2009 x86_64 x86_64 x86_64 GNU/Linux I have XML::LibXML 2.0012 installed without problem, cpanm is automatically trying to upgrade and failing: t/40reader_mem_error.t (Wstat: 6 Tests: 1 Failed: 0) Non-zero wait status: 6 Parse errors: Bad plan. You planned 2 tests but ran 1. This started and has been falling since Dec 5th, I’ve checked and there was/is a later XML::LibXML released on 5th Dec (XML-LibXML-2.0014, irritatingly this also fails the same) t/40reader_mem_error.t ............... 1/2 *** glibc detected *** /usr/bin/perl: double free or corruption (!prev): 0x00000000035e8140 *** t/90threads.t ........................ skipped: optional (set THREAD_TEST=1 to run these tests) I've tried to upgrade without threads and still fails. Sorry if I've missed something from output which may help, I can / will assist if I can, just let me know what output / tests you need. Thanks w1bble.

Thu Dec 06 06:33:59 2012 SHLOMIF [...] cpan.org - Correspondence added

Hi, On Thu Dec 06 05:51:57 2012, w1bble wrote: Show quoted text

> perl, v5.8.8 built for x86_64-linux-thread-multi > > bash-3.2# uname -a > Linux <servername> 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:48 EDT 2009 > x86_64 x86_64 x86_64 GNU/Linux > > > I have XML::LibXML 2.0012 installed without problem, cpanm is > automatically trying to upgrade and failing: >

perl-5.8.8 is old and no longer maintained. Furthermore, you should not mess too much with the built-in Enterprise Linux perl and instead use perlbrew or whatever and install perl-5.16.x. Can you try it again with a vanilla perl-5.16.x? Regards, -- Shlomi Fish Show quoted text

> > t/40reader_mem_error.t (Wstat: 6 Tests: 1 Failed: 0) > Non-zero wait status: 6 > Parse errors: Bad plan. You planned 2 tests but ran 1. > > This started and has been falling since Dec 5th, I’ve checked and there > was/is a later XML::LibXML released on 5th Dec (XML-LibXML-2.0014, > irritatingly this also fails the same) > > t/40reader_mem_error.t ............... 1/2 *** glibc detected *** > /usr/bin/perl: double free or corruption (!prev): 0x00000000035e8140 *** > t/90threads.t ........................ skipped: optional (set > THREAD_TEST=1 to run these tests) > > > I've tried to upgrade without threads and still fails. > > Sorry if I've missed something from output which may help, I can / will > assist if I can, just let me know what output / tests you need. > > Thanks > > w1bble.

Thu Dec 06 06:34:01 2012 The RT System itself - Status changed from 'new' to 'open'

Thu Dec 06 07:11:53 2012 jd-bitcard [...] webtrickery.com - Correspondence added

From:

jd-bitcard [...] webtrickery.com

On Thu Dec 06 06:33:59 2012, SHLOMIF wrote: Show quoted text

> Hi, > > On Thu Dec 06 05:51:57 2012, w1bble wrote:

> > perl, v5.8.8 built for x86_64-linux-thread-multi > > > > bash-3.2# uname -a > > Linux <servername> 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:48 EDT 2009 > > x86_64 x86_64 x86_64 GNU/Linux > > > > > > I have XML::LibXML 2.0012 installed without problem, cpanm is > > automatically trying to upgrade and failing: > >

> > perl-5.8.8 is old and no longer maintained. Furthermore, you should not > mess too much with the built-in Enterprise Linux perl and instead use > perlbrew or whatever and install perl-5.16.x. > > Can you try it again with a vanilla perl-5.16.x? > > Regards, > > -- Shlomi Fish

<snip> I appreciate it's an old version of perl but hoped it would still have some support. I have a global grid of 200+ servers that are reliant on this version (hopefully with a current LibXML). Regards w1bble

Fri Dec 07 04:51:55 2012 http://rcsheets.myopenid.com/ - Correspondence added

On Thu Dec 06 06:33:59 2012, SHLOMIF wrote: Show quoted text

> perl-5.8.8 is old and no longer maintained. Furthermore, you should not > mess too much with the built-in Enterprise Linux perl and instead use > perlbrew or whatever and install perl-5.16.x. > > Can you try it again with a vanilla perl-5.16.x?

I don't believe this issue is specific to upgrading nor to the requestor's version of perl. With a vanilla install of perl-5.16.2, I am seeing the following test results, which seem to indicate a SIGSEGV is killing the perl process of t/40reader_mem_error.t: Running make test PERL_DL_NONLAZY=1 /home/utils/perl-5.16/5.16.2-nothreads-64/bin/perl "-MExtUtils::Command::MM" "-e" "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t t/01basic.t .......................... 1/3 # # # Compiled against libxml2 version: 20626 # Running libxml2 version: 20626 # t/01basic.t .......................... ok t/02parse.t .......................... ok t/03doc.t ............................ ok t/04node.t ........................... ok t/05text.t ........................... ok t/06elements.t ....................... ok t/07dtd.t ............................ ok t/08findnodes.t ...................... ok t/09xpath.t .......................... ok t/10ns.t ............................. ok t/11memory.t ......................... skipped: developers only (set MEMORY_TEST=1 to run these tests) t/12html.t ........................... ok t/13dtd.t ............................ ok t/14sax.t ............................ ok t/15nodelist.t ....................... ok t/16docnodes.t ....................... ok t/17callbacks.t ...................... ok t/18docfree.t ........................ ok t/19die_on_invalid_utf8_rt_58848.t ... ok t/19encoding.t ....................... ok t/20extras.t ......................... ok t/21catalog.t ........................ ok t/23rawfunctions.t ................... ok t/24c14n.t ........................... ok t/25relaxng.t ........................ ok t/26schema.t ......................... ok t/27new_callbacks_simple.t ........... ok t/28new_callbacks_multiple.t ......... ok t/29id.t ............................. ok t/30keep_blanks.t .................... ok t/30xpathcontext.t ................... ok t/31xpc_functions.t .................. ok t/32xpc_variables.t .................. ok t/40reader.t ......................... ok t/40reader_mem_error.t ............... All 2 subtests passed t/41xinclude.t ....................... ok t/42common.t ......................... ok t/43options.t ........................ ok t/44extent.t ......................... skipped: skipping for libxml2 < 2.6.27 t/45regex.t .......................... ok t/46err_column.t ..................... ok t/47load_xml_callbacks.t ............. ok t/48_removeChild_crashes_rt_80395.t .. ok t/48_rt55000.t ....................... ok t/48importing_nodes_IDs_rt_69520.t ... ok t/49_load_html.t ..................... ok t/49callbacks_returning_undef.t ...... ok t/49global_extent.t .................. skipped: skipping for libxml2 < 2.6.27 t/50devel.t .......................... ok t/60error_prev_chain.t ............... ok t/60struct_error.t ................... ok t/61error.t .......................... ok t/62overload.t ....................... ok t/71overloads.t ...................... ok t/72destruction.t .................... ok t/80registryleak.t ................... ok t/90threads.t ........................ skipped: no ithreads in this Perl t/pod.t .............................. ok t/style-trailing-space.t ............. skipped: Test::TrailingSpace required for trailing space test. Test Summary Report ------------------- t/40reader_mem_error.t (Wstat: 11 Tests: 2 Failed: 0) Non-zero wait status: 11 Files=59, Tests=2451, 7 wallclock secs ( 0.38 usr 0.07 sys + 4.43 cusr 0.60 csys = 5.48 CPU) Result: FAIL Failed 1/59 test programs. 0/2451 subtests failed. make: *** [test_dynamic] Error 255

Fri Dec 07 09:54:30 2012 SHLOMIF [...] cpan.org - Correspondence added

On Fri Dec 07 04:51:55 2012, http://rcsheets.myopenid.com/ wrote: Show quoted text

> On Thu Dec 06 06:33:59 2012, SHLOMIF wrote:

> > perl-5.8.8 is old and no longer maintained. Furthermore, you should not > > mess too much with the built-in Enterprise Linux perl and instead use > > perlbrew or whatever and install perl-5.16.x. > > > > Can you try it again with a vanilla perl-5.16.x?

> > I don't believe this issue is specific to upgrading nor to the > requestor's version of perl. With a vanilla install of perl-5.16.2, I am > seeing the following test results, which seem to indicate a SIGSEGV is > killing the perl process of t/40reader_mem_error.t: >

Yes, I received many test failures. Of course, this test would likely have failed with earlier versions of XML::LibXML. Now if I could only get perlbrew or perlall to do what I want. Regards, -- Shlomi Fish Show quoted text

> Running make test > PERL_DL_NONLAZY=1 /home/utils/perl-5.16/5.16.2-nothreads-64/bin/perl > "-MExtUtils::Command::MM" "-e" "test_harness(0, 'blib/lib', > 'blib/arch')" t/*.t > t/01basic.t .......................... 1/3 # > # > # Compiled against libxml2 version: 20626 > # Running libxml2 version: 20626 > # > t/01basic.t .......................... ok > t/02parse.t .......................... ok > t/03doc.t ............................ ok > t/04node.t ........................... ok > t/05text.t ........................... ok > t/06elements.t ....................... ok > t/07dtd.t ............................ ok > t/08findnodes.t ...................... ok > t/09xpath.t .......................... ok > t/10ns.t ............................. ok > t/11memory.t ......................... skipped: developers only (set > MEMORY_TEST=1 to run these tests) > t/12html.t ........................... ok > t/13dtd.t ............................ ok > t/14sax.t ............................ ok > t/15nodelist.t ....................... ok > t/16docnodes.t ....................... ok > t/17callbacks.t ...................... ok > t/18docfree.t ........................ ok > t/19die_on_invalid_utf8_rt_58848.t ... ok > t/19encoding.t ....................... ok > t/20extras.t ......................... ok > t/21catalog.t ........................ ok > t/23rawfunctions.t ................... ok > t/24c14n.t ........................... ok > t/25relaxng.t ........................ ok > t/26schema.t ......................... ok > t/27new_callbacks_simple.t ........... ok > t/28new_callbacks_multiple.t ......... ok > t/29id.t ............................. ok > t/30keep_blanks.t .................... ok > t/30xpathcontext.t ................... ok > t/31xpc_functions.t .................. ok > t/32xpc_variables.t .................. ok > t/40reader.t ......................... ok > t/40reader_mem_error.t ............... All 2 subtests passed > t/41xinclude.t ....................... ok > t/42common.t ......................... ok > t/43options.t ........................ ok > t/44extent.t ......................... skipped: skipping for libxml2 < > 2.6.27 > t/45regex.t .......................... ok > t/46err_column.t ..................... ok > t/47load_xml_callbacks.t ............. ok > t/48_removeChild_crashes_rt_80395.t .. ok > t/48_rt55000.t ....................... ok > t/48importing_nodes_IDs_rt_69520.t ... ok > t/49_load_html.t ..................... ok > t/49callbacks_returning_undef.t ...... ok > t/49global_extent.t .................. skipped: skipping for libxml2 < > 2.6.27 > t/50devel.t .......................... ok > t/60error_prev_chain.t ............... ok > t/60struct_error.t ................... ok > t/61error.t .......................... ok > t/62overload.t ....................... ok > t/71overloads.t ...................... ok > t/72destruction.t .................... ok > t/80registryleak.t ................... ok > t/90threads.t ........................ skipped: no ithreads in this Perl > t/pod.t .............................. ok > t/style-trailing-space.t ............. skipped: Test::TrailingSpace > required for trailing space test. > > Test Summary Report > ------------------- > t/40reader_mem_error.t (Wstat: 11 Tests: 2 Failed: 0) > Non-zero wait status: 11 > Files=59, Tests=2451, 7 wallclock secs ( 0.38 usr 0.07 sys + 4.43 > cusr 0.60 csys = 5.48 CPU) > Result: FAIL > Failed 1/59 test programs. 0/2451 subtests failed. > make: *** [test_dynamic] Error 255

Fri Dec 07 16:41:27 2012 http://rcsheets.myopenid.com/ - Correspondence added

On Fri Dec 07 09:54:30 2012, SHLOMIF wrote: Show quoted text

> Yes, I received many test failures. Of course, this test would likely > have failed with earlier versions of XML::LibXML. Now if I could only > get perlbrew or perlall to do what I want.

Given that's the only error, does it seem reasonable to you to force installation as a workaround?

Fri Dec 07 16:52:52 2012 SHLOMIF [...] cpan.org - Correspondence added

On Fri Dec 07 16:41:27 2012, http://rcsheets.myopenid.com/ wrote: Show quoted text

> On Fri Dec 07 09:54:30 2012, SHLOMIF wrote:

> > Yes, I received many test failures. Of course, this test would likely > > have failed with earlier versions of XML::LibXML. Now if I could only > > get perlbrew or perlall to do what I want.

> > Given that's the only error, does it seem reasonable to you to force > installation as a workaround?

I think so. That problem should only affect XML::LibXML::Reader , and existed before the test was added.

Tue Dec 11 07:09:40 2012 SHLOMIF [...] cpan.org - Correspondence added

Can you people give me the exact versions of the Linux distributions, perl, libxml2, etc. that you are trying to build it on? I seem unable to reproduce (but I guess I can try with CentOS 5.). Regards, — Shlomi Fish

Tue Dec 11 08:10:37 2012 jd-bitcard [...] webtrickery.com - Correspondence added

From:

jd-bitcard [...] webtrickery.com

On Tue Dec 11 07:09:40 2012, SHLOMIF wrote: Show quoted text

> Can you people give me the exact versions of the Linux distributions, > perl, libxml2, etc. that you are trying to build it on? I seem unable to > reproduce (but I guess I can try with CentOS 5.). > > Regards, > > — Shlomi Fish

perl, v5.8.8 built for x86_64-linux-thread-multi (and I reproduced with a vanilla RHEL 5.8 with perl 5.16 with same issue) Servers are: Red Hat Enterprise Linux Server release 5.7 (Tikanga) (but majority are RHEL 5.4, nearly all x86_64 a couple of 32bit) libxml-2.0 Thanks w1bble

Tue Dec 11 11:32:08 2012 SHLOMIF [...] cpan.org - Correspondence added

On Tue Dec 11 08:10:37 2012, w1bble wrote: Show quoted text

> On Tue Dec 11 07:09:40 2012, SHLOMIF wrote:

> > Can you people give me the exact versions of the Linux distributions, > > perl, libxml2, etc. that you are trying to build it on? I seem unable to > > reproduce (but I guess I can try with CentOS 5.). > > > > Regards, > > > > — Shlomi Fish

> > perl, v5.8.8 built for x86_64-linux-thread-multi (and I reproduced with > a vanilla RHEL 5.8 with perl 5.16 with same issue) > > Servers are: > Red Hat Enterprise Linux Server release 5.7 (Tikanga) (but majority are > RHEL 5.4, nearly all x86_64 a couple of 32bit) > > libxml-2.0 >

OK, I was able to reproduce it on a CentOS 5.8 VirtualBox VM with XML::LibXML compiled from sources. However, I suspect that it may be a problem with the version of libxml-2.0 that is shipped with RHEL/CentOS 5 which is very old. I'm going to try it with the latest libxml2 compiled from source. CentOS 6 does not exhibit this problem. Regards, -- Shlomi Fish

Tue Dec 11 12:03:27 2012 SHLOMIF [...] cpan.org - Correspondence added

On Tue Dec 11 11:32:08 2012, SHLOMIF wrote: Show quoted text

> On Tue Dec 11 08:10:37 2012, w1bble wrote:

> > On Tue Dec 11 07:09:40 2012, SHLOMIF wrote:

> > > Can you people give me the exact versions of the Linux distributions, > > > perl, libxml2, etc. that you are trying to build it on? I seem

unable to Show quoted text

> > > reproduce (but I guess I can try with CentOS 5.). > > > > > > Regards, > > > > > > — Shlomi Fish

> > > > perl, v5.8.8 built for x86_64-linux-thread-multi (and I reproduced with > > a vanilla RHEL 5.8 with perl 5.16 with same issue) > > > > Servers are: > > Red Hat Enterprise Linux Server release 5.7 (Tikanga) (but majority are > > RHEL 5.4, nearly all x86_64 a couple of 32bit) > > > > libxml-2.0 > >

> > OK, I was able to reproduce it on a CentOS 5.8 VirtualBox VM with > XML::LibXML compiled from sources. However, I suspect that it may be a > problem with the version of libxml-2.0 that is shipped with RHEL/CentOS > 5 which is very old. I'm going to try it with the latest libxml2 > compiled from source. CentOS 6 does not exhibit this problem. >

OK, the crash does not happen with libxml2-2.9.0 that is compiled with "./configure --prefix=$HOME/apps/libxml". The magic incantation for building it with XML::LibXML Makefile.PL is: perl Makefile.PL LIBS="-L$HOME/apps/libxml2/lib/ -lxml2 -lm -lz" \ INC="-I$HOME/apps/libxml2/include/libxml2" -------- So what do we do now? I guess I can blacklist that particular version of libxml2, but it's possible other versions in between have similar problems. We can also try bisecting the libxml2 repository for that problem. Does anyone have any better suggestions? Regards, -- Shlomi Fish

Wed Dec 12 06:53:55 2012 SREZIC [...] cpan.org - Correspondence added

Just to add some data points: XML-LibXML-2.00014 runs fine with: * CentOS 5.8 * system perl 5.8.8 and self-compiled perl 5.14.2 * self-compiled libxml2 2.7.6 Regards, Slaven

Wed Dec 12 07:47:31 2012 SHLOMIF [...] cpan.org - Correspondence added

On Wed Dec 12 06:53:55 2012, SREZIC wrote: Show quoted text

> Just to add some data points: XML-LibXML-2.00014 runs fine with: > * CentOS 5.8 > * system perl 5.8.8 and self-compiled perl 5.14.2 > * self-compiled libxml2 2.7.6 > > Regards, > Slaven

Slaven, thanks for the input. Regards, -- Shlomi Fish

Thu Jan 03 10:25:10 2013 gortan [...] cpan.org - Cc GORTAN added