[mythtv-users] Myth job queue problems...

Sun Jun 4 04:21:39 UTC 2006

--- Chris Pinkham <cpinkham at bc2va.org> wrote:

> * On Fri Jun 02, 2006 at 07:51:26AM -0700, drescher0110-mythtv at yahoo.com wrote:
> > I recently ran into problems with the job queue and a master / slave
> configuaration.
> > I scheduled several transcode jobs on the master and the slave but after the
> first
> > few jobs were finished both systems are not processing any jobs anymore. After
> > running mythjobqueue on both systems I think I have found the reason for this.
> Both
> > machines are trying to run jobs for the other machine and stopping because I
> have
> > this disabled. 
> 
> The JobQueue will try to run any jobs which are not already assigned to another
> host
> and if the current host is allowed to run that particular job type.  It sounds
> like
> you did not turn on the "Run Jobs only on original recording host" setting in the
> mythtv-setup program, otherwise your slave would not try to run jobs for the
> master and vice-versa.
> 
> > Attempted to transcode myth://192.168.1.100:6543/2010_20060523145900.mpg.
> > Mythtranscode is currently unable to transcode remote files.
> 
> If you do not have the above setting turned ON, then turn it on, go into the
> mythfrontend status page and delete these jobs, then requeue them from the watch
> recordings screen.
> 
> > Is there a way to get the job queue to continue to the next file after this type
> of
> > error? Or how do I get remote transcoding to work with the master and slave both
> > having their own private folders where they store recordings?
> 
> Myth transcode should return an error in this case and the JobQueue should go
> ahead
> on to the next job, but you're saying it is not doing this.
> 
> Can you past the relevant log portions from running the backend as
> "mythbackend -v jobqueue" so I can see what is going on?
> 
> --
I have not fully duplicated the problem (pissibly because I bumped the max
concurrent  jobs up to 3) but I think I see what happens although it does not look
like this output tells the story:

 # mythbackend -v jobqueue
2006-06-04 00:10:10.443 Using runtime prefix = /usr
2006-06-04 00:10:10.473 New DB connection, total: 1
2006-06-04 00:10:10.483 Connected to database 'mythconverg' at host: jmd0
2006-06-04 00:10:10.488 Current Schema Version: 1141
Running as a slave backend.
2006-06-04 00:10:10.495 New DB connection, total: 2
2006-06-04 00:10:10.497 Connected to database 'mythconverg' at host: jmd0
2006-06-04 00:10:10.499 EITHelper: localtime offset -4:00:00
2006-06-04 00:10:10.521 New DB connection, total: 3
2006-06-04 00:10:10.522 Connected to database 'mythconverg' at host: jmd0
2006-06-04 00:10:10.695 EITHelper: localtime offset -4:00:00
2006-06-04 00:10:10.858 JobQueue: RecoverQueue: Checking for unfinished jobs to
recover.
2006-06-04 00:10:10.859 mythbackend version: 0.19.20060522-1 www.mythtv.org
2006-06-04 00:10:10.859 Enabled verbose msgs:  important general jobqueue
2006-06-04 00:10:10.859 AutoExpire: Found 2 recorders w/max rate of 144 MiB/min
2006-06-04 00:10:10.860 JobQueue: GetJobsInQueue: findJobs search bitmask 4, found
22 total jobs
2006-06-04 00:10:10.861 AutoExpire: Required Free Space: 3.1 GB w/freq: 10 min
2006-06-04 00:10:10.860 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060519145900 in Finished state.
2006-06-04 00:10:10.861 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2059 @
20060515180000 in Finished state.
2006-06-04 00:10:10.861 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060523145900 in Finished state.
2006-06-04 00:10:10.862 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2059 @
20060515190000 in Finished state.
2006-06-04 00:10:10.862 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2059 @
20060516180000 in Finished state.
2006-06-04 00:10:10.862 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2059 @
20060516190000 in Finished state.
2006-06-04 00:10:10.862 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060524145900 in Finished state.
2006-06-04 00:10:10.862 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060525145900 in Finished state.
2006-06-04 00:10:10.862 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060526145900 in Finished state.
2006-06-04 00:10:10.862 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060529145900 in Finished state.
2006-06-04 00:10:10.863 JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job for
2010 @ 20060602145900 in Finished state.
2006-06-04 00:10:10.863 JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job for
2059 @ 20060602180000 in Finished state.
2006-06-04 00:10:10.863 JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job for
2059 @ 20060602190000 in Finished state.
2006-06-04 00:10:10.863 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2059 @
20060517180000 in Finished state.
2006-06-04 00:10:10.863 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060530145900 in Finished state.
2006-06-04 00:10:10.864 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060531145900 in Finished state.
QServerSocket: failed to bind or listen to the socket
2006-06-04 00:10:10.864 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2059 @
20060517190000 in Finished state.
2006-06-04 00:10:10.864 Failed to bind port 6543. Exiting.
2006-06-04 00:10:10.864 JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job for
2059 @ 20060524180000 in Finished state.
2006-06-04 00:10:10.864 JobQueue: GetJobsInQueue: Found 'Transcode' Job for 2045 @
20051214222600 in Starting state.
2006-06-04 00:10:10.864 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2045 @
20060302010000 in Finished state.

In this example the transcode job 20051214222600 is stuck in the starting state on
the slave backend. This file resides on the master backend and the option to only
run transcode jobs on the recording machine is on. A few minutes later on the slave
again I scheduled a transcode job and that went right to the running state while the
other job remains in the starting state:

# mythbackend -v jobqueue
2006-06-04 00:21:09.821 Using runtime prefix = /usr
2006-06-04 00:21:09.832 New DB connection, total: 1
2006-06-04 00:21:09.837 Connected to database 'mythconverg' at host: jmd0
2006-06-04 00:21:09.839 Current Schema Version: 1141
Running as a slave backend.
2006-06-04 00:21:09.844 New DB connection, total: 2
2006-06-04 00:21:09.845 Connected to database 'mythconverg' at host: jmd0
2006-06-04 00:21:09.846 EITHelper: localtime offset -4:00:00
2006-06-04 00:21:09.853 New DB connection, total: 3
2006-06-04 00:21:09.854 Connected to database 'mythconverg' at host: jmd0
2006-06-04 00:21:10.024 EITHelper: localtime offset -4:00:00
2006-06-04 00:21:10.193 JobQueue: RecoverQueue: Checking for unfinished jobs to
recover.
2006-06-04 00:21:10.195 mythbackend version: 0.19.20060522-1 www.mythtv.org
2006-06-04 00:21:10.195 JobQueue: GetJobsInQueue: findJobs search bitmask 4, found
22 total jobs
2006-06-04 00:21:10.195 Enabled verbose msgs:  important general jobqueue
2006-06-04 00:21:10.195 AutoExpire: Found 2 recorders w/max rate of 144 MiB/min
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060519145900 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2059 @
20060515180000 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060523145900 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2059 @
20060515190000 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2059 @
20060516180000 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2059 @
20060516190000 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060524145900 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060525145900 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060526145900 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060529145900 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job for
2010 @ 20060602145900 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job for
2059 @ 20060602180000 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job for
2059 @ 20060602190000 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060530145900 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2010 @
20060531145900 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2059 @
20060517190000 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job for
2059 @ 20060524180000 in Finished state.
2006-06-04 00:21:10.196 JobQueue: GetJobsInQueue: Found 'Transcode' Job for 2045 @
20051214222600 in Starting state.
2006-06-04 00:21:10.197 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2045 @
20060302010000 in Finished state.
2006-06-04 00:21:10.197 JobQueue: GetJobsInQueue: Found 'Transcode' Job for 2068 @
20050924190800 in Running state.
2006-06-04 00:21:10.197 JobQueue: GetJobsInQueue: Ignore 'Transcode' Job for 2059 @
20060523180000 in Finished state.
2006-06-04 00:21:10.197 JobQueue: GetJobsInQueue: Found 'Transcode' Job for 2059 @
20060517180000 in Running state.
2006-06-04 00:21:10.197 JobQueue: RecoverQueue: Recovering 'Transcode' 2045 @
20051214222600 from 'Starting' state.
2006-06-04 00:21:10.199 AutoExpire: Required Free Space: 3.1 GB w/freq: 10 min
2006-06-04 00:21:10.199 JobQueue: RecoverQueue: Recovering 'Transcode' 2059 @
20060517180000 from 'Running' state.
QServerSocket: failed to bind or listen to the socket
2006-06-04 00:21:10.200 Failed to bind port 6543. Exiting.

John