Skip Menu |

This queue is for tickets about the Hadoop-Streaming CPAN distribution.

Report information
The Basics
Id: 59164
Status: resolved
Priority: 0/
Queue: Hadoop-Streaming
People
Owner: SPAZM [...] cpan.org
Requestors: SPAZM [...] cpan.org
Cc:
AdminCc:
Bug Information
Severity: Important
Broken in:
  • 0.100050
  • 0.100060
  • 0.100270
Fixed in:
  • 0.101880
  • 0.101881

History Show all quoted text
  Wed Jul 07 11:51:52 2010 SPAZM [...] cpan.org - Ticket created
Automated smoke test failures on multiple platforms. I assume this has to do with problems making system calls out to run more perl copies to simulate running nthe independent mapper and reducer scripts. 0.101860 introduced better logging on STDERR errors from these calls to Test::Command. There are now lots of reports with two general themes: can't load moose, can't load .so for Sub::Name. 1) Can't find moose: # Failed test 'map stderr is blank' # at t/01-wordcount.t line 31. # got: 'Can't locate Moose.pm in @INC (@INC contains: /export/home/cpant3/.cpan/build/Hadoop-Streaming-0.101860-DGiKgT/blib/lib /export/home/cpant3/.cpan/build/Hadoop-Streaming-0.101860-DGiKgT/blib/arch /export/home/cpant3/.cpan/build/Test-Command-0.08-ttUuQE/blib/arch /export/home/cpant3/.cpan/build/Test-Command-0.08-ttUuQE/blib/lib /export/home/cpant3/.cpan/build/Test-Command-0.08-ttUuQE/blib/arch /export/home/cpant3/.cpan/build/Test-Command-0.08-ttUuQE/blib/lib /usr/perl5/5.8.4/lib/i86pc-solaris-64int /usr/perl5/5.8.4/lib /usr/perl5/site_perl/5.8.4/i86pc-solaris-64int /usr/perl5/site_perl/5.8.4 /usr/perl5/site_perl /usr/perl5/vendor_perl/5.8.4/i86pc-solaris-64int /usr/perl5/vendor_perl/5.8.4 /usr/perl5/vendor_perl .) at /export/home/cpant3/.cpan/build/Hadoop-Streaming-0.101860-DGiKgT/t/wordcount/map.pl line 4. # BEGIN failed--compilation aborted at /export/home/cpant3/.cpan/build/Hadoop-Streaming-0.101860-DGiKgT/t/wordcount/map.pl line 4. http://www.cpantesters.org/cpan/report/07563141-b19f-3f77-b713-d32bba55d77f http://www.cpantesters.org/cpan/report/07566623-b19f-3f77-b713-d32bba55d77f http://www.cpantesters.org/cpan/report/07565919-b19f-3f77-b713-d32bba55d77f 2) Can't load Sub::Name [ERROR] [Tue Jul 6 13:03:00 2010] MAKE TEST failed: No such file or directory PERL_DL_NONLAZY=1 /usr/home/cpan/pit/bare/perl-5.10.0/bin/perl "-MExtUtils::Command::MM" "-e" "test_harness(0, 'blib/lib', 'blib/arch')" t/*.t t/00-load.t ....... ok ... # Failed test 'map stderr is blank' # at t/01-wordcount.t line 31. # got: 'Can't load '/usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Sub-Name-0.04/blib/arch/auto/Sub/Name/Name.so' for module Sub::Name: /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Sub-Name-0.04/blib/arch/auto/Sub/Name/Name.so: Undefined symbol "PL_unitcheckav" at /usr/local/lib/perl5/5.8.9/mach/DynaLoader.pm line 226. # at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Class-MOP-1.03/blib/lib/Class/MOP/Mixin/HasMethods.pm line 12 # Compilation failed in require at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Class-MOP-1.03/blib/lib/Class/MOP/Mixin/HasMethods.pm line 12. # BEGIN failed--compilation aborted at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Class-MOP-1.03/blib/lib/Class/MOP/Mixin/HasMethods.pm line 12. # Compilation failed in require at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Class-MOP-1.03/blib/lib/Class/MOP.pm line 18. # BEGIN failed--compilation aborted at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Class-MOP-1.03/blib/lib/Class/MOP.pm line 18. # Compilation failed in require at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Moose-1.08/blib/lib/Moose/Exporter.pm line 11. # BEGIN failed--compilation aborted at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Moose-1.08/blib/lib/Moose/Exporter.pm line 11. # Compilation failed in require at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Moose-1.08/blib/lib/Moose.pm line 14. # BEGIN failed--compilation aborted at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Moose-1.08/blib/lib/Moose.pm line 14. # Compilation failed in require at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Hadoop-Streaming-0.101860/t/wordcount/map.pl line 4. # BEGIN failed--compilation aborted at /usr/home/cpan/pit/bare/conf/perl-5.10.0/.cpanplus/5.10.0/build/Hadoop-Streaming-0.101860/t/wordcount/map.pl line 4. # ' http://www.cpantesters.org/cpan/report/6c8c09ca-88f6-11df-ae63-e0e88fbefd91 http://www.cpantesters.org/cpan/report/07570221-b19f-3f77-b713-d32bba55d77f 3) Just found a third: a problem with weaken in Class::MOP requiring XS version of Scalar::Util. I wonder how I list that as a requirement? # Failed test 'map stderr is blank' # at t/01-wordcount.t line 31. # got: 'weaken is only available with the XS version of Scalar::Util at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Class-MOP-1.03/blib/lib/Class/MOP.pm line 12 # BEGIN failed--compilation aborted at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Class-MOP-1.03/blib/lib/Class/MOP.pm line 12. # Compilation failed in require at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Moose-1.08/blib/lib/Moose/Exporter.pm line 11. # BEGIN failed--compilation aborted at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Moose-1.08/blib/lib/Moose/Exporter.pm line 11. # Compilation failed in require at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Moose-1.08/blib/lib/Moose.pm line 14. # BEGIN failed--compilation aborted at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Moose-1.08/blib/lib/Moose.pm line 14. # Compilation failed in require at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Hadoop-Streaming-0.101860/t/wordcount/map.pl line 4. # BEGIN failed--compilation aborted at /Volumes/Media/smoke/64bit/conf/perl-5.8.7/.cpanplus/5.8.7/build/Hadoop-Streaming-0.101860/t/wordcount/map.pl line 4. http://www.cpantesters.org/cpan/report/07570938-b19f-3f77-b713-d32bba55d77f
  Wed Jul 07 11:57:15 2010 SPAZM [...] cpan.org - Taken
  Wed Jul 07 11:59:32 2010 SPAZM [...] cpan.org - Correspondence added
released Hadoop-Streaming-0.101880 with change to query Config module for perl path instead of 'env perl' hack. Will see if this improves test results. If you have downloaded Hadoop::Streaming and it failed to build, please comment on this ticket so I can get this working for more people. It works for me, which is making testing/fixing difficult.
  Wed Jul 07 11:59:32 2010 SPAZM [...] cpan.org - Status changed from 'new' to 'open'
  Wed Jul 07 12:25:05 2010 SPAZM [...] cpan.org - Correspondence added
Subject: Test results for 101880 look good so far
Test results for 101880: first 7 results are PASS, but those look like they are all from the same box. http://www.cpantesters.org/distro/H/Hadoop-Streaming.html#Hadoop-Streaming-0.101880 Grade Perl version OS name OS version Architecture PASS 5.8.7 Linux 2.6.26-1-amd64 x86_64-linux-thread-multi-ld PASS 5.8.9 Linux 2.6.26-1-amd64 x86_64-linux PASS 5.10.1 Linux 2.6.30-1-amd64 x86_64-linux-ld PASS 5.12.1 Linux 2.6.32-2-amd64 x86_64-linux PASS 5.13.0 Linux 2.6.32-2-amd64 x86_64-linux-thread-multi-ld PASS 5.13.1 Linux 2.6.32-2-amd64 x86_64-linux-thread-multi-ld PASS 5.13.2 Linux 2.6.32-2-amd64 x86_64-linux I'm glad they're able to pull 101880 for testing. I'm still seeing 100270, not even 101870 from 3 days ago. Not sure what that is all about.
  Wed Jul 07 16:58:25 2010 SPAZM [...] cpan.org - Subject changed from (no value) to 'Test failures on a variety of platforms.'
  Thu Jul 08 12:10:14 2010 SPAZM [...] cpan.org - Correspondence added
fixed with the changes for 0.01880 and 0.01881!
  Thu Jul 08 12:10:15 2010 SPAZM [...] cpan.org - Status changed from 'open' to 'resolved'
  Thu Jul 08 12:10:43 2010 SPAZM [...] cpan.org - Fixed in 0.101880 added
  Thu Jul 08 12:10:43 2010 SPAZM [...] cpan.org - Fixed in 0.101881 added
  Thu Jul 08 12:10:43 2010 SPAZM [...] cpan.org - Severity Important added