Hauppauge HD-PVR

From MythTV Official Wiki
Revision as of 12:16, 5 March 2012 by Iceberg (Talk | contribs)

Jump to: navigation, search
Hauppage HD-PVR
Vendors Website http://www.hauppauge.com/site/products/data_hdpvr.html
Input Formats component, S-Video, and composite (stereo and S/PDIF for audio)
Support Status Supported since 0.22
Driver hdpvr (part of the kernel since ~2.6.29.1)
Sound Driver not applicable
Chipset not applicable


The Hauppauge HD-PVR Model 1212.

The Hauppauge HD-PVR is the first consumer-level analog HD capture device available. The HD-PVR is a USB device that captures the component video outputs and analog/optical audio outputs of any consumer device (including cable/satellite set-top-boxes, HD disk players, video game consoles, and various other home media devices). The HD-PVR is a highly popular capture device because it captures video via component output, permitting the user to capture high-definition video from most sources and without concern for encryption. In other words, since component video is not and cannot be encrypted, previously uncapturable HD sources such as satellite and premium television will now be fully accessible in MythTV. Prior to this device, component capture devices were cost-prohibitive and were not directly supportable within Linux.

The HD PVR captures at resolutions from VGA/D1 (480i) up to 1080i, and encodes the component inputs in real time using the H.264/MPEG-4 video codec and the AAC audio codec. The streams are mulitplexed into a slightly modified MPEG-2 Transport Stream container. Capture resolution is dependent on the source (ie 720p video will be captured as 720p, 1080i as 1080i, etc.) but the bitrate is user-selectable from 1 megabit/second up to 13.5 megabits/second. The H.264 video codec is, bit-for-bit, up to 40% more efficient than the MPEG-2 video codec commonly used in US HDTV broadcasts today. A 13.5 Mb/s H.264 stream is roughly equivalent to a full-channel-bitrate MPEG-2 recording at approximately 19 Mb/s.

The HD-PVR uses modern codecs capable of exceptional compression rates at excellent quality. The tradeoff is that decoding H.264 material is very processor-intensive. If not using VDPAU, even systems which easily play back US broadcast HD are likely to fail altogether when playing back a recording from the HD-PVR. Hauppauge recommends a dual-core CPU as a minimum if not using VDPAU; a frequently cited minimum for medium-bitrate H.264 playback is a Core 2 Duo 1.8 Ghz processor. HD Playback Reports acts as a repository for processor requirements to play high definition material. HD-PVR users are encouraged to contribute to the page to ascertain real-world playback requirements with MythTV.

In all HD-PVR firmwares later than 1.0.3.53, AC-3 mulitplexing via S/PDIF is available, allowing one to multiplex the original 5.1 channel audio track into the captured stream. To enable this functionality, be sure to set the audio input to S/PDIF by editing the capture card definition in mythtv-setup and setting the preferred input device to S/PDIF.


Important.png Note: If you are running a firmware earlier than 1.5.6, you should update the firmware as soon as possible. Hauppauge has fixed a bug that can under certain conditions cause the HD-PVR to become inoperable.


Important.png Note: 29-Aug-2011: The latest version of the firmware, 1.6.29207, dated July 27, 2011, causes oversaturation and color issues with the encoding of the analog signal. Until this is resolved, you do not want to upgrade to this version. Version 1.5.7, from June 17, 2010 appears to work. Hauppauge has acknowledged the issue and provided a link to the earlier firmware for non-Windows systems on their support page: Hauppauge HD-PVR support

A patch has been submitted upstream to fix this issue and it has been merged into Linux kernel v3.3-rc5.


Possible Countermeasures

Some UK television providers (notably Virgin and Freesat) have attempted to counter the HD-PVR and similar devices by selectively disabling the component outputs of their set top boxes. In the US, the Motion Picture Association of America has requested that the Federal Communications Commission allow providers to disable the component outputs of their devices when showing recently released movies.

There is a new solution to this countermeasure. A company called HDFury makes HDCP-compliant HDMI converters. The HD-FURY2 converts HDMI input into sound and component outputs. It is available from http://www.curtpalme.com. The original HDFury converts HDMI to RGB. It is available from Monoprice or http://www.curtpalme.com. The RGB output of the HDFury can be converted to component with a second device called Box1020. A user with an HDMI-only device could use the following path to convert HDMI to component video:

HDMI source -> HDMI to DVI cable -> HD Fury -> Box1020 -> component cable -> HD-PVR or using the HD Fury2 the chain could be shorted to HDMI source -> HD Fury2 -> component cable -> HD-PVR

At the time of this writing, the original HDFury and Box1020 cost approximately $210 US. The HD Fury2 sells for $249 US, but it eliminates the need for the Box1020 and adds a host of picture quality and stability improvements. Some users will be put off by the high cost and circuitousness of the solution, but for an increasing number of MythTV users, it may be the only option.

Firmware Upgrade Process

The firmware on the device cannot be upgraded through a GNU/Linux system at this time. Use the following process within a MS Windows installation:

  1. Visit the Hauppauge website and download the latest driver
  2. Unpack the driver into a folder
  3. Connect the HD-PVR to your computer via the USB cable and connect the power
  4. A window may pop-up asking you if you want to search for a driver, press the cancel button if possible
  5. Run the executable in the folder you created above
  6. If necessary, your firmware will be updated
  7. Disconnect the HD-PVR and reconnect to your backend system

HD-PVR Driver Compilation Howto

Important.png Note: As of Linux Kernel 2.6.30 the driver for the HD-PVR is now included by default. However, the driver may not have the necessary bits to enable the IR transmitter. You only have to follow this procedure if

  • your kernel does not include the driver
  • you want to use the IR transmitter and those bits are not in your kernel
  • you need a newer driver (A newer driver may also be necessary if you have a newer device as Hauppauge introduced a new USB device ID for the F1 revision.)


  • Fedora 12 (and above) includes backports of the relevant drivers for the HD-PVR and IR Blasting, no compilation is necessary.
  • Ubuntu 10.10 (as well as MythBuntu) do not have the IR driver bits. In addtion, the USB ID for the latest hardware revision (Rev F1) isn't detected. Compiling from the source is necessary to correct this.
  • Ubuntu 11.04 and above, as well as MythBuntu, includes the relevant drivers for the HD-PVR and IR Blasting, no compilation is necessary.


Important.png Note: This how-to has been upgraded to support a more current kernel versions (2.6.32 and greater). The historical Mercurial [instructions] may still work on older kernels.)


The development branch of the HD-PVR Linux driver is available from the LinuxTV project. - http://linuxtv.org/wiki/index.php/How_to_Obtain,_Build_and_Install_V4L-DVB_Device_Drivers

Currently, firmware loading is unimplemented in the driver. As a result, if you have a "rev c1" or newer unit you must install the HD-PVR at least once on a Windows machine to load the firmware into it. If you have a Revision 2 unit (including a sticker marked "rev c2" on the bottom of the unit) then it will come loaded with a firmware. Once you have done so, you will need a working build environment, git, and kernel headers installed on your system. In Debian and debian-based distros, the following command should install all necessary dependencies to build the driver.

sudo apt-get install build-essential git linux-headers-`uname -r`

On some systems (e.g. Ubuntu 10.04), it is git-core instead of git, so use:

sudo apt-get install build-essential git-core linux-headers-`uname -r`

In RPM based distros such as Mythdora, the following command should suffice, assuming the proper development tools, kernel-headers and kernel-devel have already been installed.

sudo yum install git

In best case scenarios, the following should be enough to compile and install the driver:

git clone git://linuxtv.org/media_build.git
cd media_build
./check_needs.pl
make -C linux/ download
make -C linux/ untar
make stagingconfig
make
sudo make install


Important.png Note: Compilation errors do occur some times:

  • If compilation fails with timblogiw.c:XXX: error: implicit declaration of function 'mfd_get_data' then edit v4l/.config, and change any line like CONFIG_*_TIMBERALE to equal n Then rerun "make" and continue on.
  • If compilation fails due to an error with the firedtv driver, then edit the file "v4l-dvb/v4l/.config" and change the line: "CONFIG_DVB_FIREDTV=m" to "CONFIG_DVB_FIREDTV=n". In addition, changing all lines to "=n" except for CONFIG_VIDEO_HDPVR will greatly speed up compile time.
  • For other errors, realize that keeping the latest media tree code compiling on older kernels is a losing battle. If you report build failures to linux-media@vger.kernel.org you'll usually either see them fixed and/or receive suggested workarounds.


If compilation and installation succeeded, it should be possible to load the HD-PVR driver with:

sudo modprobe hdpvr

If dmesg only shows "registered new interface driver hdpvr" and no /dev/video# device has been created, you probably have a newer device than your kernel module supports.

If dmesg shows "wrong firmware version," and "device init failed," then you did not install the device in Windows first and the firmware has not been loaded. Install the HD-PVR on a Windows machine, install the drivers, and after that the device should work fine in Linux.

In Ubuntu, the module may fail to load and refer you to the dmesg command. If this happens, reboot and see if the error resolves itself. It is also possible that Ubuntu is prioritizing another, older copy of the v4l-dvb modules above the one you just installed, and the HD-PVR will fail because the two versions do not match. Try a command like:

locate cx88-dvb.ko |grep `uname -r`

This will search for the cx88-dvb kernel module, which is provided in the Hg tree you just built, and also in default Ubuntu installs. If you see more than one copy of this file, you may need to move the older versions out of the way. In at least one case, alternate versions of all the modules were located in "/opt/ltsp/amd64/lib/modules/kernel version number/ubuntu/". The symbol mismatch was solved by moving the "/opt/ltsp/amd64/lib/modules/kernel version number/ubuntu/media" directory into a backup directory in the user's home, then rebooting.

Testing the Driver

Even if you didn't compile your own kernel module, you should always test your box outside of MythTV before trying inside of MythTV. Once the module has loaded successfully, you can check dmesg for output and to determine which /dev/video node it has created. You can then test the device as with any hardware encoder:

cat /dev/video1 > test.ts

Press your interrupt character (usually ctrl-C) to stop the capture, and play it back with any compatible media player (i.e., mplayer, xine, mythfrontend).

Bitrate and Picture Controls

The HD-PVR driver is compatible with the v4l2-ctl command line utility included in ivtv-tools. To see a list of adjustable controls, use the following command:

v4l2-ctl --device=/dev/video0 -l

Substitute the correct video# in the example above. The following controls are presently supported in the driver:

Control Name Values Default Description
brightness 0 to 255 134 Brightness picture control over recordings.
contrast 0 to 255 128 Contrast picture control over recordings.
hue 0 to 255 128 Hue picture control over recordings.
saturation 0 to 255 128 Saturation picture control over recordings.
sharpness 0 to 255 128 Sharpness picture control over recordings.
audio_encoding 3 to 4 3 Control for audio encoding. 3=AAC, 4=AC3.
video_encoding 2 2 Non-adjustable control for video encoding (H.264).
video_bitrate_mode 0 to 1 1 Control for VBR versus CBR. 0=VBR, 1=CBR.
video_bitrate 1000000 to 13500000 6500000 Bitrate control over recordings in bits, from 1 Mbit/s to 13.5 Mbit/s.
video_peak_bitrate 1100000 to 20200000 9000000 Peak bitrate control in bits, from 1.1 Mbit/s to 20.2 Mbit/s.

You can adjust any of these values with a command like:

v4l2-ctl --device=/dev/video0 --set-ctrl=controlname=value

Or, for example:

v4l2-ctl --device=/dev/video0 --set-ctrl=video_bitrate=13500000

This command will set the bitrate to the maximum of 13.5 Mbit/s for the HD-PVR at /dev/video0.

The audio_encoding selection only works for PCM input. If the HD-PVR is fed AC3, then AC3 will always be multiplexed into the H.264.

Note that the picture controls did not have any known effect prior to firmware version 0x16 (1.6.29199).

Firmware 0x16+ Picture Control Defaults

Control Name Values Default Description
brightness 0 to 255 128 Brightness picture control over recordings.
contrast 0 to 255 64 Contrast picture control over recordings.
hue 0 to 30 15 Hue picture control over recordings (shown as even numbers between -30 and 30 in Windows).
saturation 0 to 255 64 Saturation picture control over recordings.
sharpness 0 to 255 128 Sharpness picture control over recordings.

Until a patch that sets the new defaults is committed to the kernel, you can use v4l2-ctl --set-ctrl brightness=0x80 --set-ctrl contrast=0x40 --set-ctrl hue=0xf --set-ctrl saturation=0x40 --set-ctrl sharpness=0x80 to set the proper defaults.

Miscellaneous Kernel Module Options

Several options exist that may be of assistance when troubleshooting or for certain use cases. If the audio output is too low, you can boost the audio signal by adding the following module option for the hdpvr module:

boost_audio=1

If you wish to see more verbose dmesg output, you can use the following module option:

hdpvr_debug=#

Where # = an integer between 1 and 7, increasing in level of verbosity.

video_nr=#

Sets the device node to /dev/video#

default_video_input=#

default video input: 0=component, 1=S-Video, 2=composite

default_audio_input=#

default audio input: 0=RCA back, 1=RCA front, 2=S/PDIF.

Important.png Note: For firmware 0xf, default audio input must apparently be set to 2 to enable spdif/optical recording. This does not change the encoding default (AAC) and does not up-convert to 5.1 if the spdif/optical input is stereo. Simply edit /etc/modprobe.d/hdpvr.conf to have this info (without quotes): "options hdpvr default_audio_input=2". If this doesn't work for you or if you want to be able to easily change it on the fly, try this script.

Configuring the HD-PVR in MythTV

MythTV 0.22 now includes support for the HD-PVR. See below for caveats and setup information.

Caveats

Once the tuner has been added as an encoder in MythTV, it is vital that the user not access the tuner in outside programs such as cat, VLC, and mplayer. This can lead to MythTV's connection with the driver becoming unstable, and subsequent recordings failing until the driver is reloaded and power is cycled on the HD-PVR.

The last sync with libavcodec did greatly improve stability when playing material from the HD-PVR. If you still get playback crashes, try compiling myth with --disable-ssse3.

For Motorola STBs, it is also important to set the "4:3 Override" option to Off or Stretch. For some Motorola STBs, both the aspect ratio settings and output resolution controls can be found by powering down the STB and then pressing the Menu button.

Myth can become non-responsive due to run-away "mythbackend --generate-preview" processes. If you check your mythbackend logs and see it being flooded with ac3 or faac errors, it is likely the "generate-preview" process doing it. A "pkill -f generate-preview" will return your myth system to a usable state. You may even want to add that pkill to a cron job.

The HD-PVR previously had problems gracefully dealing with resolution changes but those issues have been fixed in MythTV. You can now allow your receiver to float between 480i, 480p, 720p and 1080i without causing the HD-PVR or MythTV to hang.

Tracking Progress

The HD-PVR is completely usable when using Myth 0.22; just make sure you are using the latest HD-PVR firmware.

Steps to Add the HD-PVR as a Capture Device in MythTV (0.22 or later)

  1. Compile the driver and test it for proper operation as described above (if necessary)
  2. Run mythtv-setup, and enter option 2, Capture Cards.
  3. Add a new capture card. When prompted, select "H.264 Encoder Card (HD-PVR)" as the card type. Set the /dev/video node to the number of your HD-PVR. Finish adding the new capture card. You can also set the audio input on this screen. All cables must be functional and properly attached in order for capture to succeed with the HD-PVR. If every recording fails with a "Unknown type, recording width was 0" error in the mythbackend log, it is possible that one of your cables is faulty or has become disconnected.
  4. Enter option 3, "Video Sources." Set up a video source for your HD-PVR's tuner as described in the manual.
  5. Enter option 4, "Input Connections." Connect the video source to the appropriate input on the HD-PVR. Important Note: You must set a channel change script for the HD-PVR to work properly. If you don't care about channel changes, you can set it to /bin/true, but there absolutely must be a channel change script defined. Important note 2: You must leave Preset tuner to channel empty or LiveTV and channel changes will not work.

Assuming you followed the directions carefully, you should now be able to record with the HD-PVR. If you get "Select Timeout" errors, these can sometimes be overcome by stopping the backend, removing the hdpvr module, cycling the power on the HD-PVR, modprobe-ing the hdpvr module, and restarting the backend.

You can set the bitrate for the HD-PVR by going into Recording Profiles, and editing the profiles associated with HD-PVR encoders. These recording profiles have bitrate settings for low (480i/p), medium (720p), and high (1080i) resolution material, allowing you to set appropriate bitrates based upon the resolution of the material. If the max bitrate is set lower than the average bitrate, the result is CBR (constant bit rate) at the rate specified by the average slider. If you want VBR (variable bit rate), set the max slider to maximum, and then use the average slider to achieve the desired bitrate.

IR Transmitter Support

As of September 1, 2009 IR Blasting and receiving is tentatively working. Jarod Wilson has created patches for the lirc and hdpvr drivers. He's in the process of having his patches approved and committed.

  • These patches are included if you follow the build process above.
  • Mythdora IR How-To
  • Fedora Core 12 currently has built-in support for the HD-PVR's IR Blaster. In Fedora 12 follow the steps below to enable the IR transmitter. Other distributions may need custom-compiled drivers. See the section below to compile drivers for the IR transmitter.
  • For Ubuntu/MythBuntu 10.10 the above compilation process was necessary.
  • Ubuntu/MythBuntu 11.04 currently has built-in support for the HD-PVR's IR Blaster. Follow the steps below to enable the IR transmitter.


Important.png Note: As of April 2011, numbers of users have reported instability if the HD-PVR is configured as an IR receiver. To workaround this, make sure that "options lirc_zilog tx_only=1" is set in the modprobe.conf or /etc/modprobe.d/hdpvr.conf depending on the distribution


The HD-PVR, as with many other Hauppauge on-card emitters, only supports a fixed set of IR codes. The HD-PVR includes a wide variety of codes for most common set top boxes, but it may or may not contain codes for special buttons like arrow or menu buttons. See below for more information on codesets and lircd.conf.

Compile LIRC Modules for IR Transmitter Support

The HD-PVR's IR Blaster must be supported in both the LinuxTV driver and the LIRC driver. If your distribution doesn't include support for the IR Blaster you may build it yourself. Follow the steps mentioned above to download and compile the hdpvr driver from linuxtv.org (lirc_zilog.ko and lirc_dev.ko are also included in that process).

  1. Load the HD-PVR driver (sudo modprobe hdpvr) and check dmesg for errors.
  2. Load the LIRC module (sudo modprobe lirc_zilog) and check dmesg for errors. Note: Be sure the HD-PVR firmware file is in place before you load the driver. If the firmware is missing, modprobe will segfault and the new modules may lock up.
  3. Follow the steps to enable the IR transmitter.
Steps to Enable IR Transmitter
  1. Plug the IR emitter in to the HD-PVR. Affix the sticky portion to the front of your set top box, aligned towards the box's IR receiver.
  2. Install LIRC as appropriate for your distribution. Note: If your distribution does not package a sufficiently recent copy of LIRC to include support for the HD-PVR IR emitter, you may need to compile it yourself.
  3. Download the HD-PVR IR firmware. Put the firmware in your distribution's firmware directory, (commonly /lib/firmware).
  4. Download the lircd.conf file and place it where your distribution keeps LIRC configuration files (commonly /etc/lirc/).
  5. If necessary (usually not), set LIRC to start at boot (service lirc on in Fedora, or update-rc.d lirc defaults in Debian-based distributions)
  6. Find the LIRC hardware.conf file in the LIRC configuration directory and edit it to include the following. If the HD PVR is the only IR device attached to your system, make sure and comment out all other TRANSMITTER and RECEIVER blocks that may already be in there. You may have to adjust the device and socket values depending on your particular setup.
#Chosen IR transmitter
TRANSMITTER="HD-PVR"
TRANSMITTER_MODULES="lirc_dev lirc_zilog"
TRANSMITTER_DRIVER=""
TRANSMITTER_DEVICE="/dev/lirc0"
TRANSMITTER_SOCKET=""
TRANSMITTER_LIRCD_CONF=""
TRANSMITTER_LIRCD_ARGS=""
  1. Restart LIRC and if needed load the module, lirc_zilog (modprobe lirc_zilog). Check dmesg to see if the module has successfully loaded. Check your devices (e.g. ls /dev/lirc*). If the HD-PVR is the only device attached, then /dev/lirc0 and /dev/lircd should be the only devices. If there exists an lircd1 then hardware.conf may not be set up properly.
  2. Look at the codesets supported by the HD-PVR. The codes that start with a 0_ are for cable and 1_ are satellite.
  3. Use this script to send a power command to your set top box.
  4. When the STB changes power state, the terminal will show which command set was used. Edit /etc/lirc/lircd.conf and remove the codes you don't need and (optionally) rename the ones you do. For instance 0_125_KEY_POWER becomes KEY_POWER.

At this point the IR transmitter should send the codes properly to the STB. Channel changes will still require a channel change script. (In this example, 0_74 was the remote number supported.)

 #!/bin/bash

 REMOTE_NAME=blaster
 DEVICE=/dev/lircd
 SLEEP_TIME="0.4"
 STB=0_74

 send () {
   irsend --device=${DEVICE} SEND_ONCE ${REMOTE_NAME} ${STB}_${1}
   sleep ${SLEEP_TIME}
 }

 for DIGIT in $(echo ${1} | sed -e 's/./& /g'); do
   send KEY_${DIGIT}
 done

 send KEY_ENTER

 #
 # If your cable box is slow to change channels, sleep so that Mythtv doesn't
 # move forward until after the resolution has changed
 #
 sleep 7