Skip Menu |

This queue is for tickets about the Shipwright CPAN distribution.

Report information
The Basics
Id: 91220
Status: resolved
Priority: 0/
Queue: Shipwright

People
Owner: Nobody in particular
Requestors: apsaltis [...] akamai.com
Cc:
AdminCc:

Bug Information
Severity: (no value)
Broken in: 2.4.37
Fixed in: (no value)



CC: "Magri, Matt" <mmagri [...] akamai.com>
Subject: shipwright update --follow sometimes fails
Date: Fri, 06 Dec 2013 11:44:25 -0500
To: bug-Shipwright [...] rt.cpan.org
From: Andrew Psaltis <apsaltis [...] akamai.com>
-- Shipwright 2.4.36 (latest dependencies from CPAN) -- Perl 5.18.1 (Debian Unstable), Perl 5.14.2 (Ubuntu 12.04) Greetings. I have been attempting to use shipwright to manage a large collection of CPAN modules, and attempting to do a recursive module update often (but not always) results in some dependent modules losing their "require.yml" files. This prevents updates of any other module in the shipyard without deleting and re-importing all of the modules for which this has happened. For example, the following output can result from a simple "shipwright update --follow" command: ------------------------------------------------------------ + rm -rf /home/apsaltis/test-sw/sy + /home/apsaltis/perl5/bin/shipwright create successfully created + /home/apsaltis/perl5/bin/shipwright import Net::SSLeay --version 1.48 CPAN related output will be at /tmp/shipwright_cpan.log importing cpan-Net-SSLeay successfully imported + /home/apsaltis/perl5/bin/shipwright import IO::Socket::SSL --version 1.76 CPAN related output will be at /tmp/shipwright_cpan.log import cpan-Net-SSLeay importing cpan-IO-Socket-SSL successfully imported + /home/apsaltis/perl5/bin/shipwright update --follow cpan-IO-Socket-SSL CPAN related output will be at /tmp/shipwright_cpan.log import cpan-Net-SSLeay importing cpan-IO-Socket-SSL successfully imported CPAN related output will be at /tmp/shipwright_cpan.log importing cpan-Net-SSLeay Failed to load YAML document from '/home/apsaltis/test-sw/sy//scripts/cpan-Net-SSLeay/require.yml' at /home/apsaltis/perl5/lib/perl5/Shipwright/Backend/FS.pm line 204. successfully updated ------------------------------------------------------------ Here, the environment variable "SHIPWRIGHT_SHIPYARD" is set to "fs:/home/apsaltis/test-sw/sy". Tests using the -r flag set to that same value yielded similar results. Nothing appears out of place in /tmp/shipwright_cpan.log. Using the latest CPAN.pm has no effect on whether the problem manifests. The problem can also be demonstrated by updating dependent components of DBIx::SearchBuilder. Sometimes, nothing goes wrong when I do a call to "shipwright update --follow". It may take take multiple executions of the below test case for the problem to appear: ------------------------------------------------------------ #!/bin/bash CWD=$(pwd) SY=fs:$CWD/sy export SHIPWRIGHT_SHIPYARD=$SY SW=$(which shipwright) set -x rm -rf $CWD/sy $SW create $SW import Net::SSLeay --version 1.48 $SW import IO::Socket::SSL --version 1.76 $SW update --follow cpan-IO-Socket-SSL ------------------------------------------------------------ Thanks, ~Andrew -- Andrew Psaltis -- Akamai Technologies -- apsaltis@akamai.com
Subject: Re: [rt.cpan.org #91220] shipwright update --follow sometimes fails
Date: Sat, 7 Dec 2013 17:13:59 +0800
To: bug-Shipwright [...] rt.cpan.org
From: sunnavy <sunnavy [...] bestpractical.com>
Hi Andrew Thanks for reporting this! Turned out multiple “import” commands involved in the “update -—follow” result in collision sometimes. I released 2.4.37 just now, which contains a quick fix for this. Regards sunnavy On Dec 7, 2013, at 12:44 AM, Andrew Psaltis via RT <bug-Shipwright@rt.cpan.org> wrote: Show quoted text
> Fri Dec 06 11:44:35 2013: Request 91220 was acted upon. > Transaction: Ticket created by apsaltis@akamai.com > Queue: Shipwright > Subject: shipwright update --follow sometimes fails > Broken in: (no value) > Severity: (no value) > Owner: Nobody > Requestors: apsaltis@akamai.com > Status: new > Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=91220 > > > > -- Shipwright 2.4.36 (latest dependencies from CPAN) > > -- Perl 5.18.1 (Debian Unstable), Perl 5.14.2 (Ubuntu 12.04) > > Greetings. > > I have been attempting to use shipwright to manage a large collection of CPAN modules, and > attempting to do a recursive module update often (but not always) results in some > dependent modules losing their "require.yml" files. This prevents updates of any other > module in the shipyard without deleting and re-importing all of the modules for which this > has happened. > > For example, the following output can result from a simple "shipwright update --follow" > command: > > ------------------------------------------------------------ > > + rm -rf /home/apsaltis/test-sw/sy > + /home/apsaltis/perl5/bin/shipwright create > successfully created > + /home/apsaltis/perl5/bin/shipwright import Net::SSLeay --version 1.48 > CPAN related output will be at /tmp/shipwright_cpan.log > importing cpan-Net-SSLeay > successfully imported > + /home/apsaltis/perl5/bin/shipwright import IO::Socket::SSL --version 1.76 > CPAN related output will be at /tmp/shipwright_cpan.log > import cpan-Net-SSLeay > importing cpan-IO-Socket-SSL > successfully imported > + /home/apsaltis/perl5/bin/shipwright update --follow cpan-IO-Socket-SSL > CPAN related output will be at /tmp/shipwright_cpan.log > import cpan-Net-SSLeay > importing cpan-IO-Socket-SSL > successfully imported > CPAN related output will be at /tmp/shipwright_cpan.log > importing cpan-Net-SSLeay > Failed to load YAML document from > '/home/apsaltis/test-sw/sy//scripts/cpan-Net-SSLeay/require.yml' at > /home/apsaltis/perl5/lib/perl5/Shipwright/Backend/FS.pm line 204. > successfully updated > > ------------------------------------------------------------ > > Here, the environment variable "SHIPWRIGHT_SHIPYARD" is set to > "fs:/home/apsaltis/test-sw/sy". Tests using the -r flag set to that same value yielded > similar results. > > Nothing appears out of place in /tmp/shipwright_cpan.log. Using the latest CPAN.pm has no > effect on whether the problem manifests. > > The problem can also be demonstrated by updating dependent components of DBIx::SearchBuilder. > > Sometimes, nothing goes wrong when I do a call to "shipwright update --follow". It may > take take multiple executions of the below test case for the problem to appear: > > ------------------------------------------------------------ > > #!/bin/bash > > CWD=$(pwd) > > SY=fs:$CWD/sy > export SHIPWRIGHT_SHIPYARD=$SY > SW=$(which shipwright) > > set -x > > rm -rf $CWD/sy > > $SW create > > $SW import Net::SSLeay --version 1.48 > > $SW import IO::Socket::SSL --version 1.76 > > $SW update --follow cpan-IO-Socket-SSL > > ------------------------------------------------------------ > > Thanks, > ~Andrew > > -- > Andrew Psaltis -- Akamai Technologies -- apsaltis@akamai.com >
Subject: Re: [rt.cpan.org #91220] shipwright update --follow sometimes fails
Date: Mon, 09 Dec 2013 10:16:32 -0500
To: "bug-Shipwright [...] rt.cpan.org" <bug-Shipwright [...] rt.cpan.org>
From: Andrew Psaltis <apsaltis [...] akamai.com>
Thanks for the quick response. A test of an "update --follow" in our larger shipyard for a module with a larger dependency list worked without any incident. Could you update Shipwright in CPAN at your convenience? It doesn't seem to know that 2.4.37 exists yet. Thanks again, ~Andrew On 2013-12-07 04:14 , sunnavy@bestpractical.com via RT wrote: Show quoted text
> <URL: https://rt.cpan.org/Ticket/Display.html?id=91220 > > > Hi Andrew > > Thanks for reporting this! > > Turned out multiple “import” commands involved in the “update -—follow” > result in collision sometimes. > > I released 2.4.37 just now, which contains a quick fix for this. > > Regards > sunnavy > > On Dec 7, 2013, at 12:44 AM, Andrew Psaltis via RT <bug-Shipwright@rt.cpan.org> wrote: >
>> Fri Dec 06 11:44:35 2013: Request 91220 was acted upon. >> Transaction: Ticket created by apsaltis@akamai.com >> Queue: Shipwright >> Subject: shipwright update --follow sometimes fails >> Broken in: (no value) >> Severity: (no value) >> Owner: Nobody >> Requestors: apsaltis@akamai.com >> Status: new >> Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=91220 > >> >> >> -- Shipwright 2.4.36 (latest dependencies from CPAN) >> >> -- Perl 5.18.1 (Debian Unstable), Perl 5.14.2 (Ubuntu 12.04) >> >> Greetings. >> >> I have been attempting to use shipwright to manage a large collection of CPAN modules, and >> attempting to do a recursive module update often (but not always) results in some >> dependent modules losing their "require.yml" files. This prevents updates of any other >> module in the shipyard without deleting and re-importing all of the modules for which this >> has happened. >> >> For example, the following output can result from a simple "shipwright update --follow" >> command: >> >> ------------------------------------------------------------ >> >> + rm -rf /home/apsaltis/test-sw/sy >> + /home/apsaltis/perl5/bin/shipwright create >> successfully created >> + /home/apsaltis/perl5/bin/shipwright import Net::SSLeay --version 1.48 >> CPAN related output will be at /tmp/shipwright_cpan.log >> importing cpan-Net-SSLeay >> successfully imported >> + /home/apsaltis/perl5/bin/shipwright import IO::Socket::SSL --version 1.76 >> CPAN related output will be at /tmp/shipwright_cpan.log >> import cpan-Net-SSLeay >> importing cpan-IO-Socket-SSL >> successfully imported >> + /home/apsaltis/perl5/bin/shipwright update --follow cpan-IO-Socket-SSL >> CPAN related output will be at /tmp/shipwright_cpan.log >> import cpan-Net-SSLeay >> importing cpan-IO-Socket-SSL >> successfully imported >> CPAN related output will be at /tmp/shipwright_cpan.log >> importing cpan-Net-SSLeay >> Failed to load YAML document from >> '/home/apsaltis/test-sw/sy//scripts/cpan-Net-SSLeay/require.yml' at >> /home/apsaltis/perl5/lib/perl5/Shipwright/Backend/FS.pm line 204. >> successfully updated >> >> ------------------------------------------------------------ >> >> Here, the environment variable "SHIPWRIGHT_SHIPYARD" is set to >> "fs:/home/apsaltis/test-sw/sy". Tests using the -r flag set to that same value yielded >> similar results. >> >> Nothing appears out of place in /tmp/shipwright_cpan.log. Using the latest CPAN.pm has no >> effect on whether the problem manifests. >> >> The problem can also be demonstrated by updating dependent components of DBIx::SearchBuilder. >> >> Sometimes, nothing goes wrong when I do a call to "shipwright update --follow". It may >> take take multiple executions of the below test case for the problem to appear: >> >> ------------------------------------------------------------ >> >> #!/bin/bash >> >> CWD=$(pwd) >> >> SY=fs:$CWD/sy >> export SHIPWRIGHT_SHIPYARD=$SY >> SW=$(which shipwright) >> >> set -x >> >> rm -rf $CWD/sy >> >> $SW create >> >> $SW import Net::SSLeay --version 1.48 >> >> $SW import IO::Socket::SSL --version 1.76 >> >> $SW update --follow cpan-IO-Socket-SSL >> >> ------------------------------------------------------------ >> >> Thanks, >> ~Andrew >> >> -- >> Andrew Psaltis -- Akamai Technologies -- apsaltis@akamai.com >>
> >
-- Andrew Psaltis -- Akamai Technologies -- apsaltis@akamai.com
Subject: Re: [rt.cpan.org #91220] shipwright update --follow sometimes fails
Date: Tue, 10 Dec 2013 00:44:50 +0800
To: bug-Shipwright [...] rt.cpan.org
From: sunnavy <sunnavy [...] bestpractical.com>
Hi Andrew I did that 2 days ago, seems the CPAN mirror you are using is out of date? Regards sunnavy On Dec 9, 2013, at 23:16, Andrew Psaltis via RT <bug-Shipwright@rt.cpan.org> wrote: Show quoted text
> Queue: Shipwright > Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=91220 > > > Thanks for the quick response. > > A test of an "update --follow" in our larger shipyard for a module with a larger > dependency list worked without any incident. > > Could you update Shipwright in CPAN at your convenience? It doesn't seem to know that > 2.4.37 exists yet. > > Thanks again, > ~Andrew > > On 2013-12-07 04:14 , sunnavy@bestpractical.com via RT wrote:
>> <URL: https://rt.cpan.org/Ticket/Display.html?id=91220 > >> >> Hi Andrew >> >> Thanks for reporting this! >> >> Turned out multiple “import” commands involved in the “update -—follow” >> result in collision sometimes. >> >> I released 2.4.37 just now, which contains a quick fix for this. >> >> Regards >> sunnavy >> >> On Dec 7, 2013, at 12:44 AM, Andrew Psaltis via RT <bug-Shipwright@rt.cpan.org> wrote: >>
>>> Fri Dec 06 11:44:35 2013: Request 91220 was acted upon. >>> Transaction: Ticket created by apsaltis@akamai.com >>> Queue: Shipwright >>> Subject: shipwright update --follow sometimes fails >>> Broken in: (no value) >>> Severity: (no value) >>> Owner: Nobody >>> Requestors: apsaltis@akamai.com >>> Status: new >>> Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=91220 > >>> >>> >>> -- Shipwright 2.4.36 (latest dependencies from CPAN) >>> >>> -- Perl 5.18.1 (Debian Unstable), Perl 5.14.2 (Ubuntu 12.04) >>> >>> Greetings. >>> >>> I have been attempting to use shipwright to manage a large collection of CPAN modules, and >>> attempting to do a recursive module update often (but not always) results in some >>> dependent modules losing their "require.yml" files. This prevents updates of any other >>> module in the shipyard without deleting and re-importing all of the modules for which this >>> has happened. >>> >>> For example, the following output can result from a simple "shipwright update --follow" >>> command: >>> >>> ------------------------------------------------------------ >>> >>> + rm -rf /home/apsaltis/test-sw/sy >>> + /home/apsaltis/perl5/bin/shipwright create >>> successfully created >>> + /home/apsaltis/perl5/bin/shipwright import Net::SSLeay --version 1.48 >>> CPAN related output will be at /tmp/shipwright_cpan.log >>> importing cpan-Net-SSLeay >>> successfully imported >>> + /home/apsaltis/perl5/bin/shipwright import IO::Socket::SSL --version 1.76 >>> CPAN related output will be at /tmp/shipwright_cpan.log >>> import cpan-Net-SSLeay >>> importing cpan-IO-Socket-SSL >>> successfully imported >>> + /home/apsaltis/perl5/bin/shipwright update --follow cpan-IO-Socket-SSL >>> CPAN related output will be at /tmp/shipwright_cpan.log >>> import cpan-Net-SSLeay >>> importing cpan-IO-Socket-SSL >>> successfully imported >>> CPAN related output will be at /tmp/shipwright_cpan.log >>> importing cpan-Net-SSLeay >>> Failed to load YAML document from >>> '/home/apsaltis/test-sw/sy//scripts/cpan-Net-SSLeay/require.yml' at >>> /home/apsaltis/perl5/lib/perl5/Shipwright/Backend/FS.pm line 204. >>> successfully updated >>> >>> ------------------------------------------------------------ >>> >>> Here, the environment variable "SHIPWRIGHT_SHIPYARD" is set to >>> "fs:/home/apsaltis/test-sw/sy". Tests using the -r flag set to that same value yielded >>> similar results. >>> >>> Nothing appears out of place in /tmp/shipwright_cpan.log. Using the latest CPAN.pm has no >>> effect on whether the problem manifests. >>> >>> The problem can also be demonstrated by updating dependent components of DBIx::SearchBuilder. >>> >>> Sometimes, nothing goes wrong when I do a call to "shipwright update --follow". It may >>> take take multiple executions of the below test case for the problem to appear: >>> >>> ------------------------------------------------------------ >>> >>> #!/bin/bash >>> >>> CWD=$(pwd) >>> >>> SY=fs:$CWD/sy >>> export SHIPWRIGHT_SHIPYARD=$SY >>> SW=$(which shipwright) >>> >>> set -x >>> >>> rm -rf $CWD/sy >>> >>> $SW create >>> >>> $SW import Net::SSLeay --version 1.48 >>> >>> $SW import IO::Socket::SSL --version 1.76 >>> >>> $SW update --follow cpan-IO-Socket-SSL >>> >>> ------------------------------------------------------------ >>> >>> Thanks, >>> ~Andrew >>> >>> -- >>> Andrew Psaltis -- Akamai Technologies -- apsaltis@akamai.com >>>
>> >>
> > > -- > Andrew Psaltis -- Akamai Technologies -- apsaltis@akamai.com >
Subject: Re: [rt.cpan.org #91220] shipwright update --follow sometimes fails
Date: Tue, 10 Dec 2013 13:46:57 -0500
To: "bug-Shipwright [...] rt.cpan.org" <bug-Shipwright [...] rt.cpan.org>
From: Andrew Psaltis <apsaltis [...] akamai.com>
That would seem to have been the case, I was able to run an update almost immediately before I got your reply yesterday, my bad. I had noticed this because it took a while to show up on "search.cpan.org". Thanks, ~Andrew On 2013-12-09 11:44 , sunnavy@bestpractical.com via RT wrote: Show quoted text
> <URL: https://rt.cpan.org/Ticket/Display.html?id=91220 > > > Hi Andrew > > I did that 2 days ago, seems the CPAN mirror you are using is out of date? > > Regards > sunnavy > > On Dec 9, 2013, at 23:16, Andrew Psaltis via RT <bug-Shipwright@rt.cpan.org> wrote: >
>> Queue: Shipwright >> Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=91220 > >> >> Thanks for the quick response. >> >> A test of an "update --follow" in our larger shipyard for a module with a larger >> dependency list worked without any incident. >> >> Could you update Shipwright in CPAN at your convenience? It doesn't seem to know that >> 2.4.37 exists yet. >> >> Thanks again, >> ~Andrew >> >> On 2013-12-07 04:14 , sunnavy@bestpractical.com via RT wrote:
>>> <URL: https://rt.cpan.org/Ticket/Display.html?id=91220 > >>> >>> Hi Andrew >>> >>> Thanks for reporting this! >>> >>> Turned out multiple “import” commands involved in the “update -—follow” >>> result in collision sometimes. >>> >>> I released 2.4.37 just now, which contains a quick fix for this. >>> >>> Regards >>> sunnavy >>> >>> On Dec 7, 2013, at 12:44 AM, Andrew Psaltis via RT <bug-Shipwright@rt.cpan.org> wrote: >>>
>>>> Fri Dec 06 11:44:35 2013: Request 91220 was acted upon. >>>> Transaction: Ticket created by apsaltis@akamai.com >>>> Queue: Shipwright >>>> Subject: shipwright update --follow sometimes fails >>>> Broken in: (no value) >>>> Severity: (no value) >>>> Owner: Nobody >>>> Requestors: apsaltis@akamai.com >>>> Status: new >>>> Ticket <URL: https://rt.cpan.org/Ticket/Display.html?id=91220 > >>>> >>>> >>>> -- Shipwright 2.4.36 (latest dependencies from CPAN) >>>> >>>> -- Perl 5.18.1 (Debian Unstable), Perl 5.14.2 (Ubuntu 12.04) >>>> >>>> Greetings. >>>> >>>> I have been attempting to use shipwright to manage a large collection of CPAN modules, and >>>> attempting to do a recursive module update often (but not always) results in some >>>> dependent modules losing their "require.yml" files. This prevents updates of any other >>>> module in the shipyard without deleting and re-importing all of the modules for which this >>>> has happened. >>>> >>>> For example, the following output can result from a simple "shipwright update --follow" >>>> command: >>>> >>>> ------------------------------------------------------------ >>>> >>>> + rm -rf /home/apsaltis/test-sw/sy >>>> + /home/apsaltis/perl5/bin/shipwright create >>>> successfully created >>>> + /home/apsaltis/perl5/bin/shipwright import Net::SSLeay --version 1.48 >>>> CPAN related output will be at /tmp/shipwright_cpan.log >>>> importing cpan-Net-SSLeay >>>> successfully imported >>>> + /home/apsaltis/perl5/bin/shipwright import IO::Socket::SSL --version 1.76 >>>> CPAN related output will be at /tmp/shipwright_cpan.log >>>> import cpan-Net-SSLeay >>>> importing cpan-IO-Socket-SSL >>>> successfully imported >>>> + /home/apsaltis/perl5/bin/shipwright update --follow cpan-IO-Socket-SSL >>>> CPAN related output will be at /tmp/shipwright_cpan.log >>>> import cpan-Net-SSLeay >>>> importing cpan-IO-Socket-SSL >>>> successfully imported >>>> CPAN related output will be at /tmp/shipwright_cpan.log >>>> importing cpan-Net-SSLeay >>>> Failed to load YAML document from >>>> '/home/apsaltis/test-sw/sy//scripts/cpan-Net-SSLeay/require.yml' at >>>> /home/apsaltis/perl5/lib/perl5/Shipwright/Backend/FS.pm line 204. >>>> successfully updated >>>> >>>> ------------------------------------------------------------ >>>> >>>> Here, the environment variable "SHIPWRIGHT_SHIPYARD" is set to >>>> "fs:/home/apsaltis/test-sw/sy". Tests using the -r flag set to that same value yielded >>>> similar results. >>>> >>>> Nothing appears out of place in /tmp/shipwright_cpan.log. Using the latest CPAN.pm has no >>>> effect on whether the problem manifests. >>>> >>>> The problem can also be demonstrated by updating dependent components of DBIx::SearchBuilder. >>>> >>>> Sometimes, nothing goes wrong when I do a call to "shipwright update --follow". It may >>>> take take multiple executions of the below test case for the problem to appear: >>>> >>>> ------------------------------------------------------------ >>>> >>>> #!/bin/bash >>>> >>>> CWD=$(pwd) >>>> >>>> SY=fs:$CWD/sy >>>> export SHIPWRIGHT_SHIPYARD=$SY >>>> SW=$(which shipwright) >>>> >>>> set -x >>>> >>>> rm -rf $CWD/sy >>>> >>>> $SW create >>>> >>>> $SW import Net::SSLeay --version 1.48 >>>> >>>> $SW import IO::Socket::SSL --version 1.76 >>>> >>>> $SW update --follow cpan-IO-Socket-SSL >>>> >>>> ------------------------------------------------------------ >>>> >>>> Thanks, >>>> ~Andrew >>>> >>>> -- >>>> Andrew Psaltis -- Akamai Technologies -- apsaltis@akamai.com >>>>
>>> >>>
>> >> >> -- >> Andrew Psaltis -- Akamai Technologies -- apsaltis@akamai.com >>
> >