MiroBridge

From MythTV Official Wiki
Jump to: navigation, search


Author R.D. Vaughan
Description MiroBridge provides an interface between Miro's videos, graphics, meta data and MythTV's "Watch Recordings" screen and MythVideo.
Supports Version24.png  Version25.png  Version26.png Version27.png 


NOTICE

As of Jan 2nd, 2015 this code will no longer be supported by the original developer (R.D. Vaughan). Anyone interested in picking up support is welcome. All code is in python so can be easily added to your development environment.


Important.png Note: [Sat, June 29th, 2013] MiroBridge with MythTV 0.25+Fixes and higher now supports Miro v6.0.x. Due to a bug in Miro v5.x that release will never be supported.
Going forward MiroBridge will only receive new enhancements for the last two released versions of MythTV (e.g. 0.25+Fixes and 0.26+Fixes) plus "best effort" for master. MythTV 0.23+Fixes and 0.24+Fixes continues to work with Miro 2.0.3 through 4.02.

What is Miro Bridge?

“In essence Miro Bridge enables Miro to emulate a MythTV recording device”

This python script provides an interface between Miro's videos, graphics, meta data and MythTV's "Watch Recordings" screen and MythVideo. Miro Bridge is intended to be used as a cron job which starts Miro in the background to update it's feeds, expire old videos and auto download new videos, then closes Miro.

Once the Miro updates are complete Miro Bridge:

  • adds new videos to MythTV's "Watch Recordings" screen
  • moves watched videos to MythVideo
  • removes from MythVideo videos that have been expired/removed by Miro

If you deleted a video in the "Watch Recordings" screen or in the MythVideo user interface, that video will also be deleted from Miro the next time Miro Bridge is run.

During processing cover art and screen shots may be copied or created but video files by default are symlinks to the Miro's video. This means no redundant video files and no additional disk space used for video files. When a video is removed by either the user or by Miro expiring a video, Miro Bridge will clean up any graphics that were created during processing.

Miro Bridge fully supports MythTV storage Groups for video and graphics.

For MythTV the Miro videos, graphics and subdirectories are all renamed to the Miro Channel title and Channel episode names. Within Miro itself Miro video, graphics and directory names are left unaltered.

This 588k archive contains the following screen shots [1]

  • Watch Recordings screen
  • MythVideo Miro Channel subdirectories
  • MythVideo Movie Trailers subdirectory
  • MythVideo View Details of a movie trailer

All examples use the new MythTV theme Graphite.

If you do not know what Miro is then check their web site at [2]

Additional Miro Bridge Features

User Configuration File allows a user to override Miro Bridge's default processing

  • Force all or selected Miro Channel videos to never be added to MythVideo. This is a watch-and-forget option. The Videos will be removed by Miro according to Miro's own expiry settings (X number of days)
  • Force all or selected Miro Channel videos to be copied directly to MythVideo and never displayed in the MythTV's "Watch Recordings" screen. These copied videos are removed from Miro entirely. Miro never expires/removes a copied video which act like any other MythVideo video file.
  • Force all or selected Miro Channel videos to be copied directly to MythVideo AFTER they have been watched in the MythTV "Watch Recordings" screen. This option is a good balance between having new videos highlighted through the MythTV's "Watch Recordings" screen and automatically saving the video in MythVideo once it has been watched. This option is most frequently used for Movie trailers. Miro never expires/removes a copied video which act like any other MythVideo video file.
  • Normally cover art for a video is set to the video's Miro Channel's icon. This configuration option allows for the video's Miro screen shot to be used as cover art. This option is specifically valuable for some movie trailer Channels. For example "Timo's HD Movie Trailers" uses movie posters as their "screen shot".
  • Some Miro Channels (e.g the Revision3 network channel "Tekzilla") have high quality graphics on thetvdatabase.com.
    • For MythTV 0.22 through 0.24 the metadata utility Jamu option (-MW) will attempt to download graphics for Miro channels from themoviedatbase.org (TMDB) and the thetvdatabase.com (TVDB). See details for this option at [3].
    • For MythTV 0.25, Mirobridge has been integrated with the new automated metadata methods. See: THE MOST IMPORTANT CONFIGURATION STEPS

Multi-Language Support

As both Miro and MythTV can display and function with non-English language characters sets, Miro Channels from non-English sources are fully supported.
Examples:
Japanese and Cantonese: [4]

Prerequisites

  • Miro Bridge requires Python v2.5 or higher
  • Miro Bridge requires a MythTV back end running 0.22+fixes or higher
  • You must have a properly configured "~/.mythtv/config.xml" installed for the account which you will be running Miro Bridge. The config.xml file is used by the python bindings to access the MythTV database. See the Getting started section for details on setting up a config.xml file.
  • Miro installed on a MythTV back end
  • The Miro Bridge script has been tested with these versions of Miro. Version 2.0.3 being the oldest.
    • Miro version 2.0.3 through 4.0.6 from Miro's own repository on MythTV 0.23+Fixes and higher
    • Miro version 4.0.1 specifically and any 5.x WILL NEVER WORK!
    • Miro version 6.0.x from Miro's own repository with MythTV 0.25+Fixes and higher
  • The Miro Bridge must be run on the same MythTV back end where Miro is installed
  • ffmpeg must be installed and functioning
    • Original testing was done with ffmpeg version "version 0.5-svn17737+3:0.svn20090303-1ubuntu6", from the Ubuntu 9.04 repository
  • Imagemagick package must be installed and functioning (specifically the "convert" utility)
    • Original Testing was done with ImageMagick 6.4.5 from the Ubuntu 9.04 repository
  • The Python library "pyparsing" (e.g. in Ubuntu it is the package python-pyparsing) version 1.5.0 or higher must be installed.
  • The MythTV back end which runs Miro Bridge must have Internet access so the Channel feed updates and video downloads can occur.

Getting Started

Downloading the Miro Bridge archive

Miro Bridge is shipped with MythTV.

Mythbuntu 10.04 (Lucid Lynx) includes a MiroBridge Mythbuntu-Control-Centre plug-in which provides a GUI for install and configuration.

Installing Miro Bridge

Miro Bridge can only be run on a MythTV back end. If you have multiple MythTV back ends you only need to run Miro Bridge on the back end where Miro is installed.

If you have installed the ".../mythtv/contrib/imports/mirobridge" directory you can run mirobridge.py right from that directory. Mirobridge does not have to be copied into the MythVideo scripts directory. As long as mirobridge.py and the mirobridge subdirectory are together the utility will work.

Configuring your graphics directories

Set up the directories for the graphic artwork. In a MythTV front end Utilities/Setup|Setup|Media Settings|Videos Settings|General Settings on page 1/8, enter the directories where the graphic files will be stored. It is recommended to use separate directories for each type of graphic file (Posters, Banners, Fan art and Screen shots).

Test that your installation is properly configured

To ensure that all Miro Bridge prerequisites have been met, run the following from the MythTV Back end's command line. Make sure you are logged on with the same user account which will be running the Miro Bridge cron job.

/the path to mirobridge/mirobridge.py -t

If you see the text "The environment test passed !" you should be able to run Miro Bridge.

If you see the text "The environment test FAILED. See previously displayed error messages!" or Miro Bridge aborts with a critical error message, you will need to correct all issues described in the those error messages.

If you see an error like "'MythDB' object has no attribute 'db'" then you are likely missing a properly configured ~/.mythtv/config.xml file. Some users have the file but it is empty.
To create the config.xml file:
1) Remove or move the ~/.mythtv/mysql.txt (if you have one)
2) Start the frontend (on the backend you will be running Miro Bridge)
3) Enter the DB info when prompted

If you get stuck try the suggested problem solutions in the instructions pertaining to issues with Miro Bridge running in cron Finally adding Miro Bridge as a cron job. The solutions are for more than just cron jobs.

Adding a Miro Specific MythTV Channel (optional)

This configuration step should ONLY be run once.
This is an optional configuration step and only provides cosmetic improvements to the MythTV "Watch Recordings" screen. If you do not perform this step then you will see "#9999 #9999" text displayed on the Watch Recordings screen If you apply this step that text will be replaced with "999 - Miro" and MythWeb you will also display a Miro channel icon.

A Miro Channel icon has been provided see A few extras for "miro_channel_icon.png"

Place this icon in a directory on the MythTV back end accessible to the user account that will be running Miro Bridge. Make sure that the icon name is "miro_channel_icon.png"

/the path to mirobridge/mirobridge.py -C "/path to the Miro channel icon/miro_channel_icon.png"

Miro Bridge by default will add the channel "999", make sure that this channel number does NOT clash with any of your current channel numbers. You can override the default channel number as shown below. In this example the channel number is changed to "888":

/the path to mirobridge/mirobridge.py -c "9999:888" -C "/path to the Miro channel icon/miro_channel_icon.png"

WARNING: Once you change either the channel id "9999" and/or the channel number "999" default numbers, you MUST always add the -c option with your new settings ANYTIME you run Miro Bridge. If you do not you could strand Miro video's in the "Watch Recordings" screen or orphan some MythTV data base records.

THE MOST IMPORTANT CONFIGURATION STEPS

  • Before you run Miro Bridge you need to change the Miro channel names to get rid of extraneous characters, brackets and shorten the overall name. The Miro channel names will not harm Miro Bridge but can prevent the "Watch Recordings" screen from displaying cover art for some videos, plus the names will look better in both MythTV and MythVideo.
  • In Miro right click on a channel and select "Rename" from the pop-up. Then change the Channel name. In general, you only want the show name. Below are examples of good and bad names:
    • Good: "Timo's HD Movie Trailers"
    • Bad: "GeekBrief TV | HD (video)"
    • Good: "GeekBrief TV"
    • Bad: "Tekzilla (Quicktime HD)"
    • Good: "Tekzilla"
  • With the metadata automation in MythTV 0.25 [5], you should check www.thetvdb.com to see if your Miro channels have graphics. If thetvdb.com has the podcast then change your Miro channel names to exactly match the name on www.thetvdb.com. If you do that then graphics will be added for your Miro videos in both the Watch Recordings screen and MythVideo. MiroBridge automatically adds a recording rule with an inetref for any Miro Channel who's channel name can be found on www.thetvdb.com
    • For example the Miro channel name "Tekzilla (Quicktime HD)" should be changed to "Tekzilla" [6]
  • Make sure that Miro is configured so that it DOES NOT start automatically on a reboot. The option by default is turned off but should be double checked. In the Miro UI check (File->Preferences->"General" tab and make sure "Automatically run Miro when I log in" is not selected). When the Miro GUI is running it will block Miro Bridge from performing downloads and updates to the Miro database.

User Configuration File

A user configuration file is only necessary if you want to override Miro Bridge's default processing. If this is the case then copy and rename the example configuration file to the ".mythtv" directory of the user account that will be running Miro Bridge. For example:

cp "/the path to mirobridge/mirobridge/mirobridge-example.conf" "/path to mythtv/.mythtv/mirobridge.conf"

Now edit the new "mirobridge.conf" file to override the Miro Bridge default behavior. The configuration file contains documentation on the available options.

Your first Miro Bridge run

NOTE: Miro Bridge cannot be run if Miro or another instance of Miro Bridge is already running. Miro Bridge will issue a message and exit if this condition exists.

Download the Miro Bridge extras archive A few extras and extract the archive graphics files.

Copy the "folder.png" file to the directory where your poster graphics are stored. Rename the "folder.png" file to "Miro.png". When your MythVideo "Miro" subdirectory is created copy the "folder.png" file to the Miro subdirectory (no renaming is required).

Make sure that the MythTV back end is running.

It is best that your first Miro Bridge run use the simulation (-s) option. Using that option will:

  • Start Miro update and automatic downloading
  • Simulate updates to MythTV and MythVideo. No MythTV data base updates are actually performed.

With the accompanying (-V) option you will have a lot of output to analyze if things go wrong. Be aware that with the simulation option the statistics report will mostly display zero's as nothing has actually changed.

/the path to mirobridge/mirobridge.py -Vs

If there were no errors and Miro Bridge completed successfully then you are ready to try Miro Bridge live with the following command:

/the path to mirobridge/mirobridge.py -V

If that ran to completion without errors then check the statistics report to see if there were any videos added to the Watch Recordings screen and/or MythVideo. Assuming there were some video's added to MythTV then start your MythTV front end and check the "Watch Recordings" and MythVideo in the "Miro" subdirectory.

Finally adding Miro Bridge as a cron job

Miro Bridge is meant to run as a recurring cron job set to the frequency that you would normally have Miro check for video updates (usually every hour or once a day). Add this cron command string:

/the path to mirobridge/mirobridge.py -V  > "/tmp/mirobridge.log" 2>&1

Note: The option -V is recommended until you have confidence Miro Bridge is running without issue.

Sometimes the cron environment has different paths and may react differently then when you successfully tested Miro Bridge from the command line. Messages such as:

"Importing Miro functions has an issue. Miro must be installed and functional."

OR

"GConf Error: Failed to contact configuration server; some possible causes are that you need to enable TCP/IP networking for ORBit, or you have stale NFS locks due to a system crash. See http://www.gnome.org/projects/gconf/ for information. (Details - 1: Not running within active session)"

If you see similar or either of these messages then you need to use the following cron command string:

env `dbus-launch` sh -c 'trap "kill $DBUS_SESSION_BUS_PID" EXIT; /the path to mirobridge/mirobridge.py -V'  > "/tmp/mirobridge.log" 2>&1'

See this link for an explanation: [7]. This issue has been seen in both a Ubuntu and Mandriva installation.

You may also need to set your cron environment to UTF-8. For US locales, add the following to the top of your crontab (see "crontab -h" for "crontab -e" information):

LANG=en_US.UTF-8
LANGUAGE=en
LC_CTYPE=en_US.UTF-8


Some users SSH into their MythTV back end. Here is an issue Norm had and his solution (thanks Norm).
"The mirobridge.py -t command (actually I think Miro does, but not sure) requires an available X server session. I ssh'd into my backend/frontend combo without setting a DISPLAY variable or using SSH -X. I set up the cron job after my first run and it failed with the critical error!
Ran from the command line and it failed! So I worked backwards to see what the differences were. Set my DISPLAY, ran Miro with GUI to my local machine and it worked fine."

Miro Channel import support

You can export your Miro channel configuration from any Miro install and import that configuration onto the MythTV backend which you have installed MiroBridge. This feature is especially useful for a headless backend.

After you have selected and changed the names of your Miro channels through the Miro GUI, export a OPML file.

  • In Miro select "Sidebar->Export podcasts (OPML)", name and save the OPML output file.
  • Copy the exported OPML file to the MythTV backend where MiroBridge is installed
  • Execute the command line (modify the specific paths to match your install):
/path to mirobridge/mirobridge.py --import_opml="/path to opml file/my_channels.opml"

Additional command line options

To display all of Miro Bridge's command line arguments use the command line option (-h):

/the path to mirobridge/mirobridge.py -h

This stupid thing does not work!

The usual suspects:

  1. See the instructions pertaining to issues with Miro Bridge running in cron Finally adding Miro Bridge as a cron job.
  2. You are running Miro Bridge at the same time you have the Miro GUI open. One would lock the other out from updating the Miro data base. Close the Miro GUI and rerun Miro Bridge. This can happen accidentally when a Miro Bridge cron job starts and you have the Miro GUI opened. In that case Miro Bridge will just exist with a message indicating which processes caused it's premature termination.
  3. The MythTV back end is not running.
  4. The MySQL database used by MythTV is not running.
  5. You have manually deleted a Miro downloaded video file. In this case you need to start Miro and it will automatically clean up the mess. MiroBridge is receiving bogus information from Miro about a video that does not exist and has stopped working until the Miro stops reporting on non-exiting videos. It is never a good practice to manually remove files use the methods provided by the applications.
  6. You are not using a supported Miro version. Versions 2.0.3, 2.5.2 to 2.5.4, 3.0, 3.5.1 and 4.0.2 are the only tested versions. If you try Miro Bridge with other Miro versions and run into problems you are on your own.
  7. You are running cron with different account privileges then the account you tested Miro Bridge with. Try running within cron the following command string and see what the log messages reveal.
    /path to mirobridge/mirobridge.py -tV > "/tmp/mirobridge.log" 2>&1
  8. One or more of the Miro feed sites are down or have issues. Ignore these errors Miro's own logs would show the same messages.
  9. You have not followed the installation process or set up instructions. The best check of a proper installation is that Miro can update and perform auto downloads on the MythTV back end that you are running Miro Bridge.
  10. You have Miro configured so that all Channel feeds are set to manual down load only
  11. You are not running your machine with locale of 'utf-8'. Your configuration should look something like:
    > locale
    LANG=en_CA.UTF-8
    LC_CTYPE="en_CA.UTF-8"
    LC_NUMERIC="en_CA.UTF-8"
    LC_TIME="en_CA.UTF-8"
    LC_COLLATE="en_CA.UTF-8"
    LC_MONETARY="en_CA.UTF-8"
    LC_MESSAGES="en_CA.UTF-8"
    LC_PAPER="en_CA.UTF-8"
    LC_NAME="en_CA.UTF-8"
    LC_ADDRESS="en_CA.UTF-8"
    LC_TELEPHONE="en_CA.UTF-8"
    LC_MEASUREMENT="en_CA.UTF-8"
    LC_IDENTIFICATION="en_CA.UTF-8"
    LC_ALL=
  12. If you are running Miro Bridge as a cron job and you see a Unicode error message, but the same command works when run from a command line, most likely your cron environment is not running as UTF8 compliant. This can happen even if root and users run with a locale of UTF8. Please refer to your distribution for instructions on setting cron's locale environment variables OR use the solution described in Finally adding Miro Bridge as a cron job to set utf on your cron environment.
  13. If you are running Miro Bridge as a cron job and you see a "! Warning - Creating an instance caused an error for one of: MythTV, MythVideo or MythDB" message, but the same command works when run from a command line, the problem may be that you have two different "config.xml" or "mysql.txt" files. One for root and one for your user account. Check to see if they both using the correct settings.
  14. As with the Miro player some WMV videos do not play with sound "unrecognised codec". You could purchase these proprietary audio codecs.
  15. Sometimes videos that have AC3 5.1 surround sound do not play back properly with the MythTV internal player. The audio plays slow and video is slightly choppy. This is not a Miro Bridge issue.
  16. I got an error that says "no module named pyparsing". This means you didn't install the python-parsing package or equivalent for your distro.
  17. If you get an error "AttributeError: 'NoneType' object has no attribute 'lower'" you need to delete some entries from your oldrecorded table that are causing issues. You can find instructions on how to do it here[8]. This issue has been fixed in the most recent versions of MiroBridge, please upgrade.

I want to delete Miro videos from MythVideo

NOTE: If you manually deleted Miro downloaded video(s) files and have not run Miro since then Miro will cause MiroBridge to stop functioning. See #5 of the This stupid thing does not work! section.

Miro Bridge and Miro are both resilient when a user removes video files and/or subdirectories external from either Miro or MythTV. Miro Bridge will remove any orphaned database records, and graphics (cover art and screen shots). This clean up process includes Miro video files that were copied into MythVideo by Miro Bridge. The deleted videos will disappear from MythVideo after you run Miro Bridge and performed a MythVideo "Scan for changes".

If you delete Miro videos that were copied from Miro to MythVideo they will be permanently deleted.

If the Miro video was moved (symlink) to MythVideo after being watched in the "Watch Recordings" screen that video will be automatically removed after the expiry period set in Miro (X number of days). If you just delete the symlink the video will reappear in MythVideo the next time you run Miro Bridge.

If you want to delete a video prior to Miro's normal expiry time you must use the MythVideo user interface to delete the video. The next time Miro Bridge is run both Miro and MythVideo data bases and associated graphics will be automatically cleaned up.

What are these messages?

If MiroBridge is not working and you see messgaes similar to the ones below then follow the instructions for #5 of the This stupid thing does not work! section.

2010-07-14 09:00:05,128 ERROR    The file (/media/virtual/Miro/CNET-s-Top-5/cnet_2010-07-09-183135-4085-3-0-0.2500.mp4) must exist to create a symbolic link
2010-07-14 09:00:05,128 - mirobridge - CRITICAL - The file (/media/virtual/Miro/CNET-s-Top-5/cnet_2010-07-09-183135-4085-3-0-0.2500.mp4) must exist to create a videometadata record

These messages are not generated by Miro Bridge and hopefully will be eliminated sometime in the future. They do not impact Miro Bridge in any way.

/var/lib/python-support/python2.6/miro/eventloop.py:179: DeprecationWarning: socket.ssl() is deprecated.  Use ssl.wrap_socket() instead.
 result = func(*args, **kwargs)
/var/lib/python-support/python2.6/miro/util.py:38: DeprecationWarning: the sha module is deprecated; use the hashlib module
         instead import sha

Occasionally you may see the following warning messages. These warnings can safely be ignored.

WARNING  MessageHandler doesn't have a handle_search_complete method to handle the <class 'miro.messages.SearchComplete'> message
WARNING  Error downloading guide:

Statistics Reports

At the end of Miro Bridge processing a statistics report is displayed:

-------------------Statistics--------------------
Number of Watch Recording's watched...... (    2)
Number of Miro videos marked as seen..... (    2)
Number of Miro videos deleted............ (    0)
Number of New Miro videos downloaded..... (    1)
Number of Miro/MythVideo's removed....... (    0)
Number of Miro/MythVideo's added......... (    1)
Number of Miro videos copies to MythVideo (    0)
-------------------------------------------------
Total Unwatched Miro/Watch Recordings.... (    1)
Total Miro/MythVideo videos to expire.... (   10)
Total Miro/MythVideo videos.............. (   29)
-------------------------------------------------

Miro Bridge limitations

  1. Miro Bridge will not integrate with MythTV any video that Miro downloaded via a torrent source. This was done because of legal concerns and to be consistent with MythTV policy. Unfortunately this also includes torrents from legal sources.
  2. Miro Bridge can only be run with a MythTV back end on which a Miro distribution is also installed. In the case where a MythTV back end has no GUI packages installed a Miro distribution may require the missing GUI packages. You can import the Miro Channel configuration that you exported from a separate Miro install. See Miro Channel import support. Miro Bridge does not require a GUI but the Miro package probably will.
  3. The MythTV back end which runs Miro Bridge must have Internet access so the Channel feed updates and video downloads can occur.
  4. Miro Bridge only supports Miro video feeds and ignores audio feeds.

A few extras

The following archive contains a few graphic files:

  • A MythVideo Miro subdirectory cover art "folder.png"
  • A Miro channel icon "Miro_channel icon.png"
  • The Miro Channel "Linux Journal" cover art does not display without alteration. The "Linux Journal.jpg" file is a corrected replacement. Put the jpg file in your MythTV posters directory on the MythTV back end that you will be running Miro Bridge.

Graphic extras archive: [9]

Tips

  • If you do not like the cover art for a Miro Channel you can change the "folder.png/jpg" file to an alternate png or jpg file of your choice. An excellent source of ready made high quality cover art can be found in the free icon collections at Gnome/KDE theme sites like [10]. The large 128x128 high quality scalable icons make the best cover art substitutes. You can also use these icons as posters by coping the icon file to your poster directory and then rename the file to the Channel name. You would have to remove the existing Channel poster graphic file.

Credits

  • Robert McNamara “alpha tester extraordinaire” assisted in the development of Miro Bridge with insightful suggestions, alpha testing and all the storage group testing.
  • The whole Miro development team that took the hard part out of developing this MythTV enhancement. Miro can be found at Get Miro or from your Linux distribution's repository. Be sure to check that you are installing a Miro version that is compatible with Miro Bridge.
  • The Miro developers who created the command line interface which demonstrated how to develop a Miro front end to initiate various Miro functionality. That was Miro Bridge's starting point.
  • The Miro channel icon, the Miro poster and folder cover art found in the extras archive come from the Miro Web site. While the Linux Journal jpg file is a Linux Journal Miro Channel icon.