[mythtv] Mythfilldatabase and Shepherd (tv_grab_au)
Michael T. Dean
mtdean at thirdcontact.com
Mon Jul 18 20:09:02 UTC 2011
On 07/18/2011 04:01 PM, Michael T. Dean wrote:
> On 07/16/2011 05:17 PM, Max Barry wrote:
>> Shepherd phones
>> home with stats, and our graphs were showing an order of magnitude spike
>> in usage at 2am, as a great many Shepherd users Australia-wide all hit
>> the datasources at once. Please bear in mind that each Shepherd user is
>> not simply downloading one XMLTV file, but rather compiling XMLTV by
>> scraping dozens or hundreds or thousands of different web pages.
> runs should be spread out within that window.
> That said, I'm all for changing the defaults for execution start and end
> to 0/23 (meaning it's allowed to run at any time of day--so runs would
> be spread out over the whole day, where each would be "seeded" by the
> time the user first ran mythbackend).
Oh, and I should probably mention:
Run mythfilldatabase at time suggested by the grabber.
If enabled, allow a DataDirect guide data provider to specify the next
download time in order to distribute load on their servers.
mythfilldatabase Execution Start/End times are also ignored.
which defaults to enabled. Currently, it only works with Schedules
Direct data, but if the XMLTV community wants to come up with a
standardized approach for providing this data, I can add support for it
into mythfilldatabase. Then, each grabber can choose a time using
whatever approach they want (random times, phone home to the Shepard
server and ask it for the recommended next run time, ...).
More information about the mythtv-dev