Bug #132451 for Astro-Catalog: Astro::Catalog::Query::Vizier V4.35 sometimes returns truncated results.

Wed Apr 29 09:53:13 2020 paul [...] leyland.vispa.com - Ticket created

Subject:	Astro::Catalog::Query::Vizier V4.35 sometimes returns truncated results.
Date:	Wed, 29 Apr 2020 14:52:28 +0100
To:	bug-Astro-Catalog [...] rt.cpan.org
From:	Paul Leyland <paul [...] leyland.vispa.com>

#! /usr/bin/perl =for comment Astro::Catalog::Query::Vizier V4.35 sometimes returns truncated results. Testing environment: #-------------------------------------------------------------------- $ uname -a Linux thoth 5.3.0-19-generic #20-Ubuntu SMP Fri Oct 18 09:04:39 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux $ perl -v This is perl 5, version 28, subversion 1 (v5.28.1) built for x86_64-linux-gnu-thread-multi (with 61 registered patches, see perl -V for more detail) #-------------------------------------------------------------------- The following script reports that 55 records are returned by the query. Interactive searching as http://vizier.u-strasbg.fr/viz-bin/VizieR-4 returns 315 records. Using vizquery from cdsclient-3.84 yields this result: $ vizquery -source=I/345/gaia2 -out.max=1000 -c.rm=5 -c='00:32:15 41:57:00' | wc #...input_file=0, list= #...ASU parameters being sent to vizier 378 7978 97884 Filtering out the header lines yields 315 as in the interactive case: $ vizquery -source=I/345/gaia2 -out.max=1000 -c.rm=5 -c='00:32:15 41:57:00' | grep '^00' | wc #...input_file=0, list= #...ASU parameters being sent to vizier 315 7427 92952 I have not yet been able to work out why a reproducibly specific subset is returned and the other 260 records discarded but am willing to provide more assistance if suitably guided. Incidentally, the co-ordinates are (approximately) those of the variable star LS And. =cut use Astro::Catalog::Query::Vizier; my $gaia_dr2 = new Astro::Catalog::Query::Vizier ( Catalog => 'I/345/gaia2', RA =>'00 32 15', Dec => '41 57 00', Radius => 5, Number => 1000, ); @stars = ($gaia_dr2->querydb()->{ALLSTARS})[0]; # Run the query ... @records = @{$stars[0]}; # ... saving only the array of stellar data. print 1+$#records, " records returned.\n";

Wed Apr 29 19:49:32 2020 GSB [...] cpan.org - Correspondence added

55 is the number of results for this query but with radius 2', which seems to be the default. It looks like Vizier might want a single c.rm parameter rather than c.rm.max and c.rm.min as Astro::Catalog::Query::Vizier has been generating. I made a commit to combine the parameters, but it isn't very elegant. https://github.com/timj/perl-Astro-Catalog/commit/692a9c3f4dde57a82e578ea9fcd10afcbcba65ef With this, I do get 315 results. (I didn't make a CPAN new release yet.) On Wed Apr 29 09:53:13 2020, paul@leyland.vispa.com wrote: Show quoted text

> #! /usr/bin/perl > > =for comment > > Astro::Catalog::Query::Vizier V4.35 sometimes returns truncated > results. > > Testing environment: > > #-------------------------------------------------------------------- > > $ uname -a > > Linux thoth 5.3.0-19-generic #20-Ubuntu SMP Fri Oct 18 09:04:39 UTC > 2019 x86_64 x86_64 x86_64 GNU/Linux > > $ perl -v > > This is perl 5, version 28, subversion 1 (v5.28.1) built for x86_64- > linux-gnu-thread-multi > (with 61 registered patches, see perl -V for more detail) > > #-------------------------------------------------------------------- > > The following script reports that 55 records are returned by the > query. > > Interactive searching as http://vizier.u-strasbg.fr/viz-bin/VizieR-4 > returns > 315 records. Using vizquery from cdsclient-3.84 yields this result: > > $ vizquery -source=I/345/gaia2 -out.max=1000 -c.rm=5 -c='00:32:15 > 41:57:00' | wc > #...input_file=0, list= > #...ASU parameters being sent to vizier > 378 7978 97884 > > Filtering out the header lines yields 315 as in the interactive case: > > $ vizquery -source=I/345/gaia2 -out.max=1000 -c.rm=5 -c='00:32:15 > 41:57:00' | grep '^00' | wc > #...input_file=0, list= > #...ASU parameters being sent to vizier > 315 7427 92952 > > I have not yet been able to work out why a reproducibly specific > subset is returned and the > other 260 records discarded but am willing to provide more assistance > if suitably guided. > > Incidentally, the co-ordinates are (approximately) those of the > variable star LS And. > > =cut > > use Astro::Catalog::Query::Vizier; > my $gaia_dr2 = new Astro::Catalog::Query::Vizier ( > Catalog => > 'I/345/gaia2', > RA =>'00 32 15', > Dec => '41 57 00', > Radius => 5, > Number => 1000, > ); > @stars = ($gaia_dr2->querydb()->{ALLSTARS})[0]; # Run the query ... > @records = @{$stars[0]}; # ... saving only > the array of stellar data. > print 1+$#records, " records returned.\n";

Wed Apr 29 19:49:34 2020 The RT System itself - Status changed from 'new' to 'open'

Thu Apr 30 03:52:20 2020 paul [...] leyland.vispa.com - Correspondence added

Subject:	Re: [rt.cpan.org #132451] Astro::Catalog::Query::Vizier V4.35 sometimes returns truncated results.
Date:	Thu, 30 Apr 2020 08:51:36 +0100
To:	bug-Astro-Catalog [...] rt.cpan.org
From:	Paul Leyland <paul [...] leyland.vispa.com>

Hi Graham. Wonderful, thank you! Before you make a new release, would you like some proo-freading [sic] of the commentary and documentation in (some of) the Astro::Catalog modules? Spotting speeling misteaks and the like comes naturally to me (very common among Asperger's people I believe) but many non-Aspies get annoyed at what they interpret as pedantic nit-picking so I always ask first. By the way, do you frequent PerlMonks.org? I've asked there about help to get started on writing a TAP client module. ATB, Paul On 30/04/2020 00:49, Graham Bell via RT wrote: Show quoted text

> <URL: https://rt.cpan.org/Ticket/Display.html?id=132451 > > > 55 is the number of results for this query but with radius 2', which seems to be the default. It looks like Vizier might want a single c.rm parameter rather than c.rm.max and c.rm.min as Astro::Catalog::Query::Vizier has been generating. > > I made a commit to combine the parameters, but it isn't very elegant. > > https://github.com/timj/perl-Astro-Catalog/commit/692a9c3f4dde57a82e578ea9fcd10afcbcba65ef > > With this, I do get 315 results. > > (I didn't make a CPAN new release yet.) > > On Wed Apr 29 09:53:13 2020, paul@leyland.vispa.com wrote:

>> #! /usr/bin/perl >> >> =for comment >> >> Astro::Catalog::Query::Vizier V4.35 sometimes returns truncated >> results. >> >> Testing environment: >> >> #-------------------------------------------------------------------- >> >> $ uname -a >> >> Linux thoth 5.3.0-19-generic #20-Ubuntu SMP Fri Oct 18 09:04:39 UTC >> 2019 x86_64 x86_64 x86_64 GNU/Linux >> >> $ perl -v >> >> This is perl 5, version 28, subversion 1 (v5.28.1) built for x86_64- >> linux-gnu-thread-multi >> (with 61 registered patches, see perl -V for more detail) >> >> #-------------------------------------------------------------------- >> >> The following script reports that 55 records are returned by the >> query. >> >> Interactive searching as http://vizier.u-strasbg.fr/viz-bin/VizieR-4 >> returns >> 315 records. Using vizquery from cdsclient-3.84 yields this result: >> >> $ vizquery -source=I/345/gaia2 -out.max=1000 -c.rm=5 -c='00:32:15 >> 41:57:00' | wc >> #...input_file=0, list= >> #...ASU parameters being sent to vizier >> 378 7978 97884 >> >> Filtering out the header lines yields 315 as in the interactive case: >> >> $ vizquery -source=I/345/gaia2 -out.max=1000 -c.rm=5 -c='00:32:15 >> 41:57:00' | grep '^00' | wc >> #...input_file=0, list= >> #...ASU parameters being sent to vizier >> 315 7427 92952 >> >> I have not yet been able to work out why a reproducibly specific >> subset is returned and the >> other 260 records discarded but am willing to provide more assistance >> if suitably guided. >> >> Incidentally, the co-ordinates are (approximately) those of the >> variable star LS And. >> >> =cut >> >> use Astro::Catalog::Query::Vizier; >> my $gaia_dr2 = new Astro::Catalog::Query::Vizier ( >> Catalog => >> 'I/345/gaia2', >> RA =>'00 32 15', >> Dec => '41 57 00', >> Radius => 5, >> Number => 1000, >> ); >> @stars = ($gaia_dr2->querydb()->{ALLSTARS})[0]; # Run the query ... >> @records = @{$stars[0]}; # ... saving only >> the array of stellar data. >> print 1+$#records, " records returned.\n";

> >