[mythtv-users] tv_grab_au-1.41 and ABC2

[Lincoln Dale]

Hi Phill,

> I've been having a go with the Australian TV grabber at
> http://www.whuffy.com/tv_grab_au/tv_grab_au-1.41 for the last few days
> but I can't get it to download any ABC2 data. I'm running it like
> this:
> 
> $ tv_grab_au_ltd_1.41 --days=7 --output=tv_grab_au_ltd_2.xml
> --cache-file=/usr/local/bin/mythtv/tv_grab_au_ltd.dat --warper
> --obfuscate
> 
> I get this in the ouput - it only seems to try for 1 page not 30 and
> immediately moves on to downloading SBS:
> 
> [1158898054] fetching yahoo7 widget data: 7 of 7[obfuscate]:
> http://webwarper.net/ww/au.tv.yahoo.com/widget.html?rg=73&st=1159416000&et
> =1159502400
> [1158898057] feeling sleepy for 5 seconds..
> [1158898076] fetching abc2.abc.gov.au data: 1 of 30[obfuscate]:
> http://webwarper.net/ww/www.abc.net.au/tv/guide/abc2/200609/20060922.htm
> [1158898078] feeling sleepy for 1 seconds..
> 
> Could someone please tell me what I'm doing wrong.

i'm guessing WebWarper is refusing the connection.  since the grabber will
get up to 30 days of data for ABC/ABC2 via the ABC website (but they don't
always have 30 days of data up there), it silently aborts after the first
failed attempt.

this logic is specific only for data fetched via the ABC website - and not
for data fetched via the yahoo portal or widget data.

i'd suggest you run it without using --warper.
alternatively, in the get_url function, remove the line
	$max_retries = 1 if ($dontretry);
and then it'll try the default of 3 times before aborting fetching that
page.


cheers,

lincoln.