Bug #93012 for Finance-Quote: Yahoo changed, breaking F::Q

Thu Feb 13 14:53:39 2014 jralls [...] ceridwen.us - Ticket created

Subject:	Yahoo changed, breaking F::Q
Date:	Thu, 13 Feb 2014 11:53:47 -0800
To:	bug-Finance-Quote [...] rt.cpan.org
From:	John Ralls <jralls [...] ceridwen.us>

yahoo.t fails 8 of 11 tests. GnuCash’s gnc-fq-dump returns Show quoted text

> No results found for stock AAPL, but results were returned for > the stock(s) <!doctype html><html lang="en-US"><head><meta http-equiv="content-type" content="text/html; charset=UTF-8"><title>Yahoo Search - Web Search</title><meta name="description" content="The search engine that helps you find exactly what you're looking for. Find the most relevant information. Printing data for the first stock returned. > > Finance::Quote fields Gnucash uses: > symbol: Yahoo Search - Web Search<meta name="description" content="The search engine that helps you find exactly what you're looking for. Find the most relevant information <=== required > date: 00/00/2000 <=== required > currency: CORE <=== required > last: images <=\ > nav: <=== one of these > price: images <=/ > timezone: <=== optional

which might be helpful. F::Q 1.18, recently updated with all dependencies via CPAN. Perl 5.16 on MacOSX 10.9. Regards, John Ralls

Thu Feb 13 21:36:23 2014 lockster [...] gmail.com - Correspondence added

From:

lockster [...] gmail.com

I can confirm it's broken too. Someone has also mentioned that it's broken on the mailing list http://sourceforge.net/mailarchive/message.php?msg_id=31974510 Finance::QuoteHist is still working though, so I'm using that to get closing prices, but it's often a day or 2 out of date.

Thu Feb 13 21:36:24 2014 The RT System itself - Status changed from 'new' to 'open'

Thu Feb 13 22:37:54 2014 smkbot [...] gmail.com - Correspondence added

Subject:	[rt.cpan.org #93012]
Date:	Thu, 13 Feb 2014 19:37:46 -0800
To:	bug-Finance-Quote [...] rt.cpan.org
From:	Stephen Kent <smkbot [...] gmail.com>

It looks like Finance::Quote makes a request to http://finance.yahoo.com/d?s=etc, which returns a 302 to another page which returns a 404. It seems http://finance.yahoo.com/d/quotes.csv?s=etc. works though. I'm not sure if that's the official API or where the documentation is.

Thu Feb 13 23:25:43 2014 jchain3 [...] gmail.com - Correspondence added

From:

jchain3 [...] gmail.com

I confirm it is broken too.

Fri Feb 14 02:22:32 2014 eco [...] ecocode.net - Taken

Fri Feb 14 03:32:36 2014 eco [...] ecocode.net - Correspondence added 30 min

The URLs for european and USA yahoo quotes has been modified. commit f46f11948f27643adae5a1574757625e18be07da on github master branch should solve this. please test ! I'll program a new release of F::Q soon. -- Erik

Fri Feb 14 03:32:38 2014 eco [...] ecocode.net - Status changed from 'open' to 'resolved'

Fri Feb 14 04:16:27 2014 eco [...] ecocode.net - Correspondence added 5 min

and the correct URL is finally "http://download.finance.yahoo.com/d/quotes.csv" which I put in commit a4cfca753c45c41fd8d44be0070b7a7aabe8ca79 and pushed to master This link is used both for yahoo USA and EUROPE. So I guess we know can officially remove Yahoo::Europe from the repo. Any objections ? -- Erik

Fri Feb 14 10:10:19 2014 jralls [...] ceridwen.us - Correspondence added

Subject:	Re: [rt.cpan.org #93012] Yahoo changed, breaking F::Q
Date:	Fri, 14 Feb 2014 07:10:05 -0800
To:	bug-Finance-Quote [...] rt.cpan.org
From:	John Ralls <jralls [...] ceridwen.us>

On Feb 14, 2014, at 1:16 AM, Erik Colson via RT <bug-Finance-Quote@rt.cpan.org> wrote: Show quoted text

> <URL: https://rt.cpan.org/Ticket/Display.html?id=93012 > > > and the correct URL is finally > "http://download.finance.yahoo.com/d/quotes.csv" > which I put in commit a4cfca753c45c41fd8d44be0070b7a7aabe8ca79 and pushed to master > > This link is used both for yahoo USA and EUROPE. > So I guess we know can officially remove Yahoo::Europe from the repo. > > Any objections ?

If you just delete it, it will break retrieval in GnuCash where the user has stored yahoo_europe as the quote source. Can you make yahoo_europe an alias to yahoo for backwards compatibility? Regards, John Ralls

Fri Feb 14 10:17:14 2014 eco [...] ecocode.net - Correspondence added

On Fri Feb 14 10:10:19 2014, jralls@ceridwen.us wrote: Show quoted text

> > If you just delete it, it will break retrieval in GnuCash where the > user has stored yahoo_europe as the quote source. Can you make > yahoo_europe an alias to yahoo for backwards compatibility?

Hi John, That's what I meant. Look @ this post on the ml : http://sourceforge.net/mailarchive/message.php?msg_id=31976980 best -- Erik

Fri Feb 14 10:28:55 2014 jralls [...] ceridwen.us - Correspondence added

Subject:	Re: [rt.cpan.org #93012] Yahoo changed, breaking F::Q
Date:	Fri, 14 Feb 2014 07:28:44 -0800
To:	bug-Finance-Quote [...] rt.cpan.org
From:	John Ralls <jralls [...] ceridwen.us>

On Feb 14, 2014, at 7:17 AM, Erik Colson via RT <bug-Finance-Quote@rt.cpan.org> wrote: Show quoted text

> <URL: https://rt.cpan.org/Ticket/Display.html?id=93012 > > > On Fri Feb 14 10:10:19 2014, jralls@ceridwen.us wrote:

>> >> If you just delete it, it will break retrieval in GnuCash where the >> user has stored yahoo_europe as the quote source. Can you make >> yahoo_europe an alias to yahoo for backwards compatibility?

> > Hi John, > > That's what I meant. Look @ this post on the ml : http://sourceforge.net/mailarchive/message.php?msg_id=31976980

Erik, That should be fine. Thanks. Regards, John Ralls