Bug #112111 for podlinkcheck: Support App::cpanminus?

Thu Feb 18 00:32:04 2016 bkb [...] cpan.org - Ticket created

Subject:

Support App::cpanminus?

I am only using App::cpanminus to install modules these days. I think podlinkcheck is very useful, but requiring CPAN::SQLite to detect existing modules doesn't work for me. I think there are a lot of other people using App::cpanminus, for example it has 208 stars on metacpan: https://metacpan.org/pod/App::cpanminus Would you be interested in adding support for this? I can try to add it myself if you like. I have downloaded the source code from the ftp site, but would it be OK to use github, or how should I contribute? Thank you again for the useful module.

Thu Feb 18 03:18:53 2016 user42_kevin [...] yahoo.com.au - Correspondence added

Subject:	Re: [rt.cpan.org #112111] Support App::cpanminus?
Date:	Thu, 18 Feb 2016 19:17:11 +1100
To:	bug-podlinkcheck [...] rt.cpan.org
From:	Kevin Ryde <user42_kevin [...] yahoo.com.au>

"Ben Bullock via RT" <bug-podlinkcheck@rt.cpan.org> writes: Show quoted text

> > I am only using App::cpanminus to install modules these days. I think > podlinkcheck is very useful, but requiring CPAN::SQLite to detect > existing modules doesn't work for me.

Oh, I mainly intended target modules would be installed somewhere in @INC, then the cpan indexes are a fallback. Show quoted text

> Would you be interested in adding support for this?

Does cpanm keep an index of something? I don't mind consulting that if it has a programming interface. I hadn't intended to download to check module existence. I check section part of a link target too, which is why having the pod or pm in full was the idea. For checking your own work the idea was that you probably have all (or almost all) cross-referenced modules installed, having used them or compared them.

Thu Feb 18 03:18:53 2016 The RT System itself - Status changed from 'new' to 'open'

Thu Feb 18 04:07:34 2016 benkasminbullock [...] gmail.com - Correspondence added

CC:	BKB <bkb [...] cpan.org>
Subject:	Re: [rt.cpan.org #112111] Support App::cpanminus?
Date:	Thu, 18 Feb 2016 18:07:22 +0900
To:	bug-podlinkcheck [...] rt.cpan.org
From:	Ben Bullock <benkasminbullock [...] gmail.com>

On 18 February 2016 at 17:18, Kevin Ryde via RT <bug-podlinkcheck@rt.cpan.org> wrote: Show quoted text

>> Would you be interested in adding support for this?

> > Does cpanm keep an index of something? I don't mind consulting that if > it has a programming interface.

It keeps a download of the index files in .cpanm/sources/http%www.cpan.org/02packages.details.txt, which is what CPAN used to do before the SQLite method I believe. Show quoted text

> I hadn't intended to download to check module existence. I check > section part of a link target too, which is why having the pod or pm in > full was the idea. For checking your own work the idea was that you > probably have all (or almost all) cross-referenced modules installed, > having used them or compared them.

I don't have all the referenced modules installed locally so it would be preferable if there was a cpanminus way to check for the existence of modules, in my opinion.

Thu Feb 18 19:44:39 2016 bkb [...] cpan.org - Correspondence added

Further to this discussion, I was looking through the issues page of Test::Pod::LinkCheck and noticed this discussion: https://rt.cpan.org/Public/Bug/Display.html?id=77976 In this discussion, ETHER says "Instead of using the cpanplus/cpan/cpanm backends to do querying, there are CPAN::Meta::* modules available directly which you can use to query the db, which would also be preferred as it doesn't require the user to have preconfigured any particular client." Perhaps that is a better direction, rather than what I suggested?

Fri Feb 19 21:25:49 2016 user42_kevin [...] yahoo.com.au - Correspondence added

Subject:	Re: [rt.cpan.org #112111] Support App::cpanminus?
Date:	Sat, 20 Feb 2016 13:22:33 +1100
To:	"Ben Bullock via RT" <bug-podlinkcheck [...] rt.cpan.org>
From:	Kevin Ryde <user42_kevin [...] yahoo.com.au>

"Ben Bullock via RT" <bug-podlinkcheck@rt.cpan.org> writes: Show quoted text

> > It keeps a download of the index files in > .cpanm/sources/http%www.cpan.org/02packages.details.txt, which is what > CPAN used to do before the SQLite method I believe.

Yes, still, in its own location. Do we know if App::cpanminus has a program interface for looking into its one? I would want to just query the file. I had some nasty trouble persuading CPAN and CPAN::Sqlite not to redownload updates :-(. The debian install has App::cpanminus in a fat blob -- convenient for one-file running I suppose, but you'd think debian could be module files ... Makes it hard to tell what is what. A grep or Search::Dict would be ok if nothing else. Tempting to do that on the CPAN copy too even. Show quoted text

> "Instead of using the cpanplus/cpan/cpanm backends to do querying, there > are CPAN::Meta::* modules available directly which you can use to query > the db, which would also be preferred as it doesn't require the user to > have preconfigured any particular client."

Hmm. The bits I see look like parsers of META.yml files. Is there more? -- Physicists at the Large Hadron Collider announced that improved accuracy in their measurements will allow the next experimental run to examine medium and small hadrons. "Tiny hadrons are beyond the capabilities of our design but we hope to see interesting new physics in small hadrons."

Fri Feb 19 22:11:24 2016 benkasminbullock [...] gmail.com - Correspondence added

Subject:	Fwd: [rt.cpan.org #112111] Support App::cpanminus?
Date:	Sat, 20 Feb 2016 12:11:14 +0900
To:	ether [...] cpan.org, bug-podlinkcheck [...] rt.cpan.org
From:	Ben Bullock <benkasminbullock [...] gmail.com>

Greetings Ether, I referred Kevin Ryde to your comments in Test::Pod::Link as seen below. Can you answer his query? Thank you. Ben Bullock Show quoted text

---------- Forwarded message ---------- From: Kevin Ryde via RT <bug-podlinkcheck@rt.cpan.org> Date: 20 February 2016 at 11:25 Subject: Re: [rt.cpan.org #112111] Support App::cpanminus? To: bkb@cpan.org <URL: https://rt.cpan.org/Ticket/Display.html?id=112111 > "Ben Bullock via RT" <bug-podlinkcheck@rt.cpan.org> writes:

> > It keeps a download of the index files in > .cpanm/sources/http%www.cpan.org/02packages.details.txt, which is what > CPAN used to do before the SQLite method I believe.

Yes, still, in its own location. Do we know if App::cpanminus has a program interface for looking into its one? I would want to just query the file. I had some nasty trouble persuading CPAN and CPAN::Sqlite not to redownload updates :-(. The debian install has App::cpanminus in a fat blob -- convenient for one-file running I suppose, but you'd think debian could be module files ... Makes it hard to tell what is what. A grep or Search::Dict would be ok if nothing else. Tempting to do that on the CPAN copy too even.

> "Instead of using the cpanplus/cpan/cpanm backends to do querying, there > are CPAN::Meta::* modules available directly which you can use to query > the db, which would also be preferred as it doesn't require the user to > have preconfigured any particular client."

Hmm. The bits I see look like parsers of META.yml files. Is there more? -- Physicists at the Large Hadron Collider announced that improved accuracy in their measurements will allow the next experimental run to examine medium and small hadrons. "Tiny hadrons are beyond the capabilities of our design but we hope to see interesting new physics in small hadrons."

Sun Feb 21 00:31:34 2016 ether [...] cpan.org - Correspondence added

On 2016-02-19 18:25:49, user42_kevin@yahoo.com.au wrote: Show quoted text

> "Ben Bullock via RT" <bug-podlinkcheck@rt.cpan.org> writes:

> > > > It keeps a download of the index files in > > .cpanm/sources/http%www.cpan.org/02packages.details.txt, which is what > > CPAN used to do before the SQLite method I believe.

> > Yes, still, in its own location. Do we know if App::cpanminus has a > program interface for looking into its one? > > I would want to just query the file. I had some nasty trouble > persuading CPAN and CPAN::Sqlite not to redownload updates :-(. > > The debian install has App::cpanminus in a fat blob -- convenient for > one-file running I suppose, but you'd think debian could be module files > ... Makes it hard to tell what is what. A grep or Search::Dict would > be ok if nothing else. Tempting to do that on the CPAN copy too even. >

> > "Instead of using the cpanplus/cpan/cpanm backends to do querying, there > > are CPAN::Meta::* modules available directly which you can use to query > > the db, which would also be preferred as it doesn't require the user to > > have preconfigured any particular client."

> > Hmm. The bits I see look like parsers of META.yml files. Is there more?

I think was referring to modules such as CPAN::Common::Index and its backends. Apocalypse talked about them a bit in the RT ticket that was linked, and made use of them in the subsequent release of Test::Pod::LinkCheck.

Sun Feb 21 05:20:29 2016 user42_kevin [...] yahoo.com.au - Correspondence added

Subject:	Re: [rt.cpan.org #112111] Support App::cpanminus?
Date:	Sun, 21 Feb 2016 21:15:29 +1100
To:	"Karen Etheridge via RT" <bug-podlinkcheck [...] rt.cpan.org>
From:	Kevin Ryde <user42_kevin [...] yahoo.com.au>

"Karen Etheridge via RT" <bug-podlinkcheck@rt.cpan.org> writes: Show quoted text

> > I think was referring to modules such as CPAN::Common::Index and its backends.

Hmm, maybe. But does it download? I had a lot of trouble originally persuading the plain cpan etc not do that, and not play 20 questions with the user, etc :(. Show quoted text

> Test::Pod::LinkCheck

Ah, it even calls a couple of my modules I never documented. Better say something what they do ... if I can remember! At any rate, Ben, I uploaded a version 13 reading the cpanm 02packages you said. I did a file bsearch with Search::Dict which ought to be good speedwise. Goes well for me. We'll have to see if it's robust :).

Mon Feb 22 02:40:31 2016 benkasminbullock [...] gmail.com - Correspondence added

CC:	BKB <bkb [...] cpan.org>
Subject:	Re: [rt.cpan.org #112111] Support App::cpanminus?
Date:	Mon, 22 Feb 2016 16:40:20 +0900
To:	bug-podlinkcheck [...] rt.cpan.org
From:	Ben Bullock <benkasminbullock [...] gmail.com>

I've just downloaded the -13 version from the website, it seems to be working in that I'm not getting the messages about Compress::Deflate7 any more, but it's awfully noisy about CPAN::SQLite. Here is the first message I got: ---- [ben@mikan] {16:34 15} image-png-libpng 503 $ podlinkcheck lib/Image/PNG/Libpng.pod lib/Image/PNG/Libpng.pod: PodLinkCheck: CPAN configs PodLinkCheck: loading CPAN::SQLite for module existence checking DBD::SQLite::db prepare failed: no such table: dists at /home/ben/software/install/lib/perl5/site_perl/5.18.2/CPAN/SQLite/DBI/Search.pm line 57. CPAN::SQLite error, disabling -- DBD::SQLite::db prepare failed: no such table: dists at /home/ben/software/install/lib/perl5/site_perl/5.18.2/CPAN/SQLite/DBI/Search.pm line 57. PodLinkCheck: module existence checking in /home/ben/.cpanm/sources/http%www.cpan.org/02packages.details.txt --- I then tried uninstalling CPAN::SQLite: --- [ben@mikan] {16:34 22} image-png-libpng 504 $ pm-uninstall CPAN::SQLite --> Working on CPAN::SQLite --- However it's still really noisy with that gone: [ben@mikan] {16:35 09} image-png-libpng 505 $ podlinkcheck lib/Image/PNG/Libpng.pod lib/Image/PNG/Libpng.pod: PodLinkCheck: CPAN configs PodLinkCheck: loading CPAN::SQLite for module existence checking Cannot load CPAN::SQLite, skipping -- Can't locate CPAN/SQLite.pm in @INC (you may need to install the CPAN::SQLite module) (@INC contains: /home/ben/software/install/lib/perl5/site_perl/5.18.2/i386-freebsd /home/ben/software/install/lib/perl5/site_perl/5.18.2 /home/ben/software/install/lib/perl5/5.18.2/i386-freebsd /home/ben/software/install/lib/perl5/5.18.2 /home/ben/software/install/lib/perl5/site_perl /usr/home/ben/projects/image-png-libpng) at /home/ben/software/install/lib/perl5/site_perl/5.18.2/App/PodLinkCheck.pm line 413. PodLinkCheck: module existence checking in /home/ben/.cpanm/sources/http%www.cpan.org/02packages.details.txt --- As I said I think many people are using App::cpanminus exclusively these days, I tend to compile Perl from source and delete all the old directories from old versions, and I don't think I have used the cpan command line client even once with my current version of Perl, so the error messages seem a bit excessive. Anyway thank you for making the addition, the main problem is fixed so please do feel free to close this if you like. Thanks again. On 21 February 2016 at 19:20, Kevin Ryde via RT <bug-podlinkcheck@rt.cpan.org> wrote: Show quoted text

> <URL: https://rt.cpan.org/Ticket/Display.html?id=112111 > > > "Karen Etheridge via RT" <bug-podlinkcheck@rt.cpan.org> writes:

>> >> I think was referring to modules such as CPAN::Common::Index and its backends.

> > Hmm, maybe. But does it download? I had a lot of trouble originally > persuading the plain cpan etc not do that, and not play 20 questions > with the user, etc :(. >

>> Test::Pod::LinkCheck

> > Ah, it even calls a couple of my modules I never documented. > Better say something what they do ... if I can remember! > > > At any rate, Ben, I uploaded a version 13 reading the cpanm 02packages > you said. I did a file bsearch with Search::Dict which ought to be good > speedwise. Goes well for me. We'll have to see if it's robust :). >

Tue Feb 23 02:00:04 2016 user42_kevin [...] yahoo.com.au - Correspondence added

Subject:	Re: [rt.cpan.org #112111] Support App::cpanminus?
Date:	Tue, 23 Feb 2016 17:53:01 +1100
To:	"Ben Bullock via RT" <bug-podlinkcheck [...] rt.cpan.org>
From:	Kevin Ryde <user42_kevin [...] yahoo.com.au>

"Ben Bullock via RT" <bug-podlinkcheck@rt.cpan.org> writes: Show quoted text

> > However it's still really noisy with that gone: > > Cannot load CPAN::SQLite, skipping -- Can't locate CPAN/SQLite.pm in > @INC (you may need to install the CPAN::SQLite module) (@INC contains: > /home/ben/software/install/lib/perl5/site_perl/5.18.2/i386-freebsd > ...

Ah yes, that's just the perl error message. I think I should reduce all those messages to --verbose. Attempting to load cpan might print some messages. Could capture to supress. Or raise cpanminus to first preference anyway, as it's quiet and needs only a file. (There's a little array of methods in the "sub new {}" if you want to try that in the interim. :-) Show quoted text

> I have used the cpan > command line client even once with my current version of Perl,

I did it in a strawberry perl on msdos, but only because it came with it and worked. Otherwise I don't go any of the cpans (own-made debs for anything not already packaged, for ease of removability, dependencies, etc).

Fri Mar 04 20:28:05 2016 user42_kevin [...] yahoo.com.au - Correspondence added

Subject:	Re: [rt.cpan.org #112111] Support App::cpanminus?
Date:	Sat, 05 Mar 2016 12:20:31 +1100
To:	"Ben Bullock via RT" <bug-podlinkcheck [...] rt.cpan.org>
From:	Kevin Ryde <user42_kevin [...] yahoo.com.au>

I wrote: Show quoted text

> > I think I should reduce all those messages to --verbose.

I uploaded a version 14 with the messages de-rated.

Sat Mar 05 20:39:55 2016 benkasminbullock [...] gmail.com - Correspondence added

CC:	BKB <bkb [...] cpan.org>
Subject:	Re: [rt.cpan.org #112111] Support App::cpanminus?
Date:	Sun, 6 Mar 2016 10:39:43 +0900
To:	bug-podlinkcheck [...] rt.cpan.org
From:	Ben Bullock <benkasminbullock [...] gmail.com>

Thank you very much for improving the module in this way. I have just downloaded and found it to be greatly improved. I will be using this podlinkcheck to check all modules released to CPAN in future. Thanks again and please feel free to close this issue if you want to. On 5 March 2016 at 10:28, Kevin Ryde via RT <bug-podlinkcheck@rt.cpan.org> wrote: Show quoted text

> <URL: https://rt.cpan.org/Ticket/Display.html?id=112111 > > > I wrote:

>> >> I think I should reduce all those messages to --verbose.

> > I uploaded a version 14 with the messages de-rated. >

Thu Sep 22 00:24:43 2016 KRYDE [...] cpan.org - Status changed from 'open' to 'resolved'

Thu Sep 22 00:24:44 2016 KRYDE [...] cpan.org - Fixed in 14 added