[mythtv-users] New Australian XMLTV grabber

[David Collett]

While we're on the topic of threading and not abusing webservers...

Whilst I havent really read the code, I would expect that this script
could in fact be modified to used as many as 5 or so different web
servers at the same time. This is because ninemsn, seven, yahoo, tvweek
etc, etc all use the same region, channel and program id's because they
are all syndicating hww 's data. Perhaps we could produce an uber-script
which simultaneously grabs data from all of them, thus reducing the
impact on any one server and making it more fault tollerant in the
process.

Dave

On Fri, 2004-11-05 at 11:00, David Collett wrote:
> Whats all this about d1?
> I dont believe anyone is abusing them. The threaded script thats been
> posted is to grab stuff from ninemsn, not d1. And it was only written
> because d1 died! I doubt 10 hits at a time (rather than one) is going to
> bring ninemsn to its knees.
> 
> Dave
> 
> 
> On Thu, 2004-11-04 at 23:33, Phill Edwards wrote:
> > Me too - I agree. We've had enough problems with the programme data
> > providers preventing us from using the data. I think we need to be as
> > considerate to d1.com.au as we can possibly be as they've been good enough
> > to come up with the goods for us.
> > 
> > Regards,
> > Phill
> > 
> > ----- Original Message ----- 
> > From: "Zaakiy Siddiqui" <zaakiy at nticon.com.au>
> > To: "Discussion about mythtv" <mythtv-users at mythtv.org>
> > Sent: Thursday, November 04, 2004 10:56 PM
> > Subject: RE: [mythtv-users] New Australian XMLTV grabber
> > 
> > 
> > I'm afraid Jay is right.  We don't want D1 to start thinking unkindly
> > towards us.
> > 
> > If you think about it, what's the need to speed it up (apart from
> > testing)?
> > 
> > Even if you elongate the process so it takes an hour, no harm done.  I
> > can understand though that at the developmental stage it's good to have
> > it fast, thus making it easier to test.
> > 
> > Zaakiy
> > 
> > -----Original Message-----
> > From: mythtv-users-bounces at mythtv.org
> > [mailto:mythtv-users-bounces at mythtv.org] On Behalf Of Jay R. Ashworth
> > Sent: Thursday, 4 November 2004 4:03 AM
> > To: Discussion about mythtv
> > Subject: Re: [mythtv-users] New Australian XMLTV grabber
> > 
> > On Thu, Nov 04, 2004 at 01:26:44AM +1000, Paul Andreassen wrote:
> > > Here is another version with threading.  It will download each days
> > data
> > > in it own thread and therefore should be seven times faster.
> > 
> > Thus septupling the load on the service provider.
> > 
> > Efficiency does not always mean effectiveness: users should careful
> > weigh whether the speed of an automated overnight process is *this*
> > important...
> > 
> > _______________________________________________
> > mythtv-users mailing list
> > mythtv-users at mythtv.org
> > http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users
> > 
> > 
> 
> 
> ______________________________________________________________________
> _______________________________________________
> mythtv-users mailing list
> mythtv-users at mythtv.org
> http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users