Bug #109084 for WWW-Mechanize-FireFox: is Accessible Rich Internet Applications supported in Mechanize-FireFox?

Tue Nov 17 11:12:38 2015 ei69jeff [...] comcast.net - Ticket created

Subject:	is Accessible Rich Internet Applications supported in Mechanize-FireFox?
Date:	Tue, 17 Nov 2015 11:12:25 -0500
To:	bug-WWW-Mechanize-FireFox [...] rt.cpan.org
From:	Jeff EI69 Stalzer <ei69jeff [...] comcast.net>

I love Mechanize-FireFox. I have used it successfully for many months scrapping the First National Bank On-Line banking pages. Recently the bank changed a large portion of their site over to Accessible Rich Internet Applications (ARIA). Part of my scraping tool stopped working. I find it necessary to click on an item to "expand" it before I can scrape it. The HTML items (each represent a check) look like this: <button class="expand-btn collapsibleControl" aria-controls="paymentDetail_20150803092128879762" data-billid="20150803092128879762" data-activitypaymenttypecode="0"> I have tried everything to "click" the item. There is no ID nor is there NAME. Clicking by number fails. Is there some method to initiate this expansion using WWW-Mechanize-FireFox? Or has the ARIA extensions gone beyond the capabilities of the current version of WWW-Mechanize-FireFox? Thanks, Jeff

Tue Nov 17 12:41:43 2015 corion [...] cpan.org - Correspondence added

Subject:	Re: [rt.cpan.org #109084] is Accessible Rich Internet Applications supported in Mechanize-FireFox?
Date:	Tue, 17 Nov 2015 18:41:24 +0100
To:	bug-WWW-Mechanize-FireFox [...] rt.cpan.org
From:	Max Maischein <corion [...] cpan.org>

Hello Jeff, Show quoted text

> I love Mechanize-FireFox. I have used it successfully for many months > scrapping the First National Bank On-Line banking pages. Recently the > bank changed a large portion of their site over to Accessible Rich > Internet Applications (ARIA). Part of my scraping tool stopped working. > I find it necessary to click on an item to "expand" it before I can > scrape it. The HTML items (each represent a check) look like this: > > <button class="expand-btn collapsibleControl" > aria-controls="paymentDetail_20150803092128879762" > data-billid="20150803092128879762" data-activitypaymenttypecode="0"> > > I have tried everything to "click" the item. There is no ID nor is > there NAME. Clicking by number fails.

What of "everything" did you try? Show quoted text

> Is there some method to initiate this expansion using > WWW-Mechanize-FireFox? Or has the ARIA extensions gone beyond the > capabilities of the current version of WWW-Mechanize-FireFox?

I would try to use ->selector() to get at the element and then pass the DOM element into ->click(). Have you already tried that? If so, please show the code and how it failed for you. -max

Tue Nov 17 12:41:43 2015 The RT System itself - Status changed from 'new' to 'open'

Wed Nov 18 16:42:27 2015 ei69jeff [...] comcast.net - Correspondence added

Subject:	Re: [rt.cpan.org #109084] is Accessible Rich Internet Applications supported in Mechanize-FireFox?
Date:	Wed, 18 Nov 2015 16:42:15 -0500
To:	bug-WWW-Mechanize-FireFox [...] rt.cpan.org
From:	Jeff EI69 Stalzer <ei69jeff [...] comcast.net>

Using ->selector() to get at the element worked. Thanks for the help, Jeff Max Maischein via RT wrote: Show quoted text

> <URL: https://rt.cpan.org/Ticket/Display.html?id=109084 > > > Hello Jeff, >

> > I love Mechanize-FireFox. I have used it successfully for many months

>> scrapping the First National Bank On-Line banking pages. Recently the >> bank changed a large portion of their site over to Accessible Rich >> Internet Applications (ARIA). Part of my scraping tool stopped working. >> I find it necessary to click on an item to "expand" it before I can >> scrape it. The HTML items (each represent a check) look like this: >> >> <button class="expand-btn collapsibleControl" >> aria-controls="paymentDetail_20150803092128879762" >> data-billid="20150803092128879762" data-activitypaymenttypecode="0"> >> >> I have tried everything to "click" the item. There is no ID nor is >> there NAME. Clicking by number fails.

> What of "everything" did you try? >

>> Is there some method to initiate this expansion using >> WWW-Mechanize-FireFox? Or has the ARIA extensions gone beyond the >> capabilities of the current version of WWW-Mechanize-FireFox?

> I would try to use ->selector() to get at the element and then pass the > DOM element into ->click(). Have you already tried that? If so, please > show the code and how it failed for you. > > -max > > > >

Wed Nov 18 16:52:16 2015 corion [...] cpan.org - Status changed from 'open' to 'rejected'