Difference between revisions of "Build from Source"

From MythTV Official Wiki
Jump to: navigation, search
(version 28.0 -> 0.28)
(Remove no longer relevant note about the renaming of 0.28 to 28.0)
Line 12: Line 12:
  
 
This guide shows how to build from source code downloaded from github.
 
This guide shows how to build from source code downloaded from github.
 
===Version Note===
 
Version 0.28 of MythTV is known in github branches and tags as 0.28.
 
  
 
==Raspberry Pi==
 
==Raspberry Pi==

Revision as of 15:10, 16 April 2016

Software-update-available.png This page is up-to-date as of MythTV version 0.28, the current release is 34.0

Introduction

For most people, it will be far easier to install a pre-built package for MythTV rather than building from source. Reasons for building from source include:

  • There is no pre-built package for your Linux distribution.
  • The pre-built package for your distribution is out of date.
  • You want to run a pre-release version of the software.
  • Users choose to test/write patches.

If you have already installed a pre-built package and you have a need to try out a source code change, it would be preferable to use your distribution's build process to build a version that is compatible with the already installed version. There are differences in the placement of files between the downloaded packages and the code you build yourself.

This guide shows how to build from source code downloaded from github.

Raspberry Pi

Starting from version 0.28 It is possible to build and run MythTV frontend on a Raspberry Pi 2 or Raspberry Pi 3. Since the Raspberry Pi has limited resources there are some steps you can take to ensure a successful build.

Setting up a Raspberry Pi for building MythTV
MythTV can be built on any linux variant that runs on Raspberry Pi. That includes Raspbian, Ubuntu Mate, Arch Linux. Before attempting to build you should take these steps.


Install the operating system on an external USB hard drive.

Use a hard drive that has its own power supply. If you have an old hard drive around that you no longer use you can buy a USB enclosure for it. You need a hard drive of 50 GB or more.

These steps can be done on the Raspberry Pi itself but are easier if done from an desktop computer running Linux. Install your Raspberry Pi operating system on an SD card as normal. If you are going to use the Raspberry Pi to prepare the hard drive you will need to prepare a second SD card. Make sure your SD cards boot correctly into the operating system. Partition your hard drive. Create an ext4 partition of at least 50 GB for your operating system. I recommend using gparted. Format it as ext4 (gparted can do that for you). Then copy your SD card contents to that drive. If using the raspberry pi to do this do not copy the SD card from which you are booted. You will need an SD card reader plugged into a USB port to read the SD card that you are copying from. Use lsblk to determine the device names. If you are running a Graphical environment it may automatically mount the devices. Otherwise mount them in an appropriate place. On the SD card you are copying from use the second partition (e.g. /dev/sda2).

sudo cp -av /source/directory/* /dest/directory/

Edit the /boot/cmdline.txt file on the SD card you are copying from. Change the parameter root=/dev/mmcblk0p2 to root=/dev/sda1. If you are not using the first partition on the hard drive change sda1 to the correct partition.

Edit the /etc/fstab file on the hard drive. Find the line for the root mount. Change the device name at the beginning of the line from /dev/mmcblk0p2 to /dev/sda1, or the correct hard drive partition.

Now shut down your raspberry pi, insert the SD card you were copying from, and plug in the external hard drive. The raspberry pi will now boot with the hard drive as root partition.


Increase swap space

On your hard drive based system, run the following commands.

sudo apt-get install dphys-swapfile
sudo dphys-swapfile swapoff
sudo dphys-swapfile uninstall

edit the file /etc/dphys-swapfile and set CONF_SWAPSIZE=2048

sudo dphys-swapfile setup
sudo dphys-swapfile swapon

This should give you 2GB swap space. To check it run top. You should see KiB Swap: 2097148 total,.


Reduce GPU memory

Edit /boot/config.txt and set to following

gpu_mem=128

This is sufficient for testing. You may want to increase it to 256 for better quality viewing when you are not compiling.


Setup ccache

After installing the prerequisites make sure there is enough ccache as follows

ccache -M 5G -F 0

With all of these steps in place, the first build of MythTV will take around 2 hours on a Raspberry Pi 2. Subsequent builds can take as little as 2 minutes. With ccache, even a full rebuild can complete in 10 minutes, because it caches the compiler results and if the source does not change it re-uses them.

Dependencies

One of the most difficult parts of building the code is getting the correct dependencies installed first. The syntax for installing these will vary from one distribution to another, and package names may also vary between distributions.

Build Dependencies for version 0.27
All Environments build-essential ccache yasm libqt4-dev libqtwebkit-dev libqt4-opengl-dev po-debconf texi2html linux-kernel-headers libdvdnav-dev libfreetype6-dev libavc1394-dev libiec61883-dev liblircclient-dev libxinerama-dev libxxf86vm-dev libxvmc-dev libxext-dev libimlib2-dev libasound2-dev libmp3lame-dev libvorbis-dev libdts-dev lsb-release libpulse-dev libxrandr-dev libfftw3-dev libva-dev libvdpau-dev libudev-dev libclass-dbi-perl libnet-upnp-perl libio-socket-inet6-perl libdbd-mysql-perl libjson-perl libwww-perl python-oauth python-lxml python-mysqldb python-pycurl python-urlgrabber libgl1-mesa-dev libdvdread-dev fftw-dev libvorbis-dev libflac-dev libmad0-dev libcdaudio-dev libcdio-dev libcdparanoia-dev libsdl1.2-dev libfaad-dev libexif-dev libtiff5-dev libxv-dev libtag1-dev libvisual-0.4-dev libmysqlclient-dev libdate-manip-perl libxml-simple-perl libimage-size-perl libdatetime-format-iso8601-perl libsoap-lite-perl libx264-dev libvpx-dev libavahi-compat-libdnssd-dev libssl-dev libcdio-cdda-dev libcdio-paranoia-dev libxml2-dev libass-dev libcec-dev uuid-dev libxml-xpath-perl libtool-bin
i386/amd64 Add this: libcrystalhd-dev
debian-wheezy

ubuntu-precise

replace libtiff5-dev with libtiff4-dev (avoids conflict in libimlib2-dev).
Notes

If you are building a Debian or Ubuntu package using dpkg-buildpackage you will need these additional packages: debhelper quilt dh-python

On debian-wheezy and ubuntu-precise replace dh-python with python-central (avoids backports).

Build Dependencies for version 0.28
All Environments build-essential ccache yasm help2man qtdeclarative5-dev libqt5webkit5-dev libqt5opengl5-dev qtscript5-dev qt5-qmake po-debconf linux-kernel-headers libdvdnav-dev libfreetype6-dev libavc1394-dev libiec61883-dev liblircclient-dev libxinerama-dev libxxf86vm-dev libxvmc-dev libxext-dev libimlib2-dev libasound2-dev libmp3lame-dev libvorbis-dev libdts-dev lsb-release libpulse-dev libxrandr-dev libfftw3-dev libva-dev libvdpau-dev libudev-dev libclass-dbi-perl libnet-upnp-perl libio-socket-inet6-perl libdbd-mysql-perl libjson-perl libwww-perl python python-oauth python-lxml python-mysqldb python-pycurl python-urlgrabber libgl1-mesa-dev libdvdread-dev fftw-dev libvorbis-dev libflac-dev libmad0-dev libcdaudio-dev libcdio-dev libcdparanoia-dev libsdl1.2-dev libfaad-dev libexif-dev libtiff5-dev libxv-dev libtag1-dev libvisual-0.4-dev libmysqlclient-dev libdate-manip-perl libxml-simple-perl libimage-size-perl libdatetime-format-iso8601-perl libsoap-lite-perl libx264-dev libvpx-dev libavahi-compat-libdnssd-dev libssl-dev libcdio-cdda-dev libcdio-paranoia-dev libxml2-dev libass-dev libcec-dev libexiv2-dev uuid-dev libxml-xpath-perl git hello libtool-bin
i386/amd64 Add this: libcrystalhd-dev
debian-wheezy replace libtiff5-dev with libtiff4-dev (avoids conflict in libimlib2-dev).

wheezy will require wheezy-backports repository to then automatically pull in qt5

raspberry pi Add this: libraspberrypi-dev
Notes If you are building a Debian or Ubuntu package using dpkg-buildpackage you will need these additional packages:

debhelper quilt dh-python

On debian-wheezy replace dh-python with python-central (avoids backports).

Run Time Dependencies for version 0.27
mysql-server ntp libicu48 libqt4-sql-mysql
Run Time Dependencies for version 0.28
mysql-server-5.6 ntp libicu55 libqt5sql5-mysql mysql-client-5.6
Run Time Dependencies for MythWeb
All Environments apache2 php5 php5-mysql libhttp-date-perl
Ubuntu Xenial or where php5 is not available apache2 php7 php7-mysql libhttp-date-perl

The package mysql-server only needs to be installed on one backend, normally the master backend, or it can be installed on a separate database server, although this would be unusual.

On systems that do not have mysql-server (e.g. remote frontends, slave backends), you need to install mysql-client instead.

Install the build dependencies on your build machine. Install the Run Time dependencies on your MythTV machine (which may be the same as the build machine). If you plan to use MythWeb, install those dependencies on your master backend system.

Distribution Install Command Additional packages
Ubuntu, Debian, MythBuntu, other Debian based distributions. sudo apt-get install Dependency List
build-essential

Depending on your distribution, run the install command with the list of packages.

Getting and compiling the source code

Step Command to run
create a directory cd
mkdir ~/build
clone cd ~/build
git clone https://github.com/MythTV/mythtv.git mythtv
cd mythtv
Check versions available git branch -a
Choose your version. The current stable released version is 33-fixes. We recommend to use that version. git checkout fixes/0.28
If you have previously done a build in this directory, run this if you need a complete rebuild git clean -xfd

In general, you should probably choose the stable version. If you don't mind if your MythTV system is non-functional or has serious bugs that may prevent proper operation/result in lost recordings or inability to play back recordings, you may try using the unstable, development code. If using unstable, development code, you should follow the mythtv-commits and mythtv-dev mailing lists.

Build and Install MythTV

In the ~/build/mythtv/mythtv directory, run the ./configure script. You can see available options by using the --help parameter with configure:

./configure --help

By default the build will install mythtv in a directory structure under /usr/local/. Executables will be in /usr/local/bin. You can modify this behavior with the --prefix= parameter. The default prefix is /usr/local.

Normally you will not need to supply any options to configure, although 0.27 users should add --disable-mythlogserver (mythlogserver). Run it as follows:

Distribution Command to run
Raspbian,
Ubuntu MATE for Raspberry Pi
Note: Raspberry pi is only supported with version 0.28 or later

export CFLAGS="-I/opt/vc/include -I/opt/vc/include/IL -I/opt/vc/include/interface/vcos/pthreads -I/opt/vc/include/interface/vmcs_host/linux"
export CXXFLAGS="-I/opt/vc/include -I/opt/vc/include/IL -I/opt/vc/include/interface/vcos/pthreads -I/opt/vc/include/interface/vmcs_host/linux"
export LDFLAGS="-L/opt/vc/lib"
./configure --compile-type=release --disable-mythlogserver --disable-crystalhd --enable-lirc --enable-audio-alsa --enable-audio-oss --enable-dvb --enable-ivtv --enable-firewire --enable-joystick-menu --with-bindings=perl --enable-ffmpeg-pthreads --enable-pic --perl-config-opts="INSTALLDIRS=vendor" --enable-libvpx --enable-sdl --enable-libmp3lame --enable-libx264 --disable-vdpau --disable-opengl-video --disable-opengl --disable-vaapi

Others ./configure --compile-type=release

If you want to build with debugging info, use --compile-type=profile. There are problems with using debug as the compile type.

The configure step may identify dependencies that are missing. If so you will need to find them and install them before continuing. Please let us know via an update to this page or make a comment in th discussion page.

If the configure was successful, run the build as follows

make -j 5

The -j option is optional but can speed up the make by running multiple processes at the same time. Set the number to 1 higher than the number of cores in your system.
The build may identify missing dependencies. Install them and notify us via a comment in the discussion.
When the build is successful, install this way

sudo make install

This will install both backend and frontend software. Install this on all machines, backend or frontend. You will only start the backend on the backend machines. On frontend machines the backend software will exist but will not be used.

Build and Install Plugins

Building and installing the plugins is optional. I recommend that new users skip this step. Plugins are not needed for any of the main functionality of MythTV, including watching Videos and watching DVDs. Plugins are for Music, Weather, YouTube, Games, etc.

Plugins are only used on the frontend, so if you have a separate backend you need not install them on the backend.

In the ~/build/mythtv/mythplugins directory, run the same commands as above for building and installing MythTV. If you only want to build certain plugins, you can disable the others in the ./configure command (check the --help for the syntax for that).

./configure
make -j 5
sudo make install

Shared-Library requirements for MythTV

The runtime manager for shared libraries, /lib/ld.so, gets information about the locations and contents of shared libraries from /etc/ld.so.cache, a file created by ldconfig from information in /etc/ld.so.conf. Because MythTV installs shared libraries in /usr/local/lib, that directory needs to be added to the list of directories for ld.so to search when doing runtime linking of programs, if it is not already there. You do this, as root, by editing /etc/ld.so.conf, then running ldconfig. There are many ways to do this; to determine the way that your distribution is configured, type:

cat /etc/ld.so.conf
cat /etc/ld.so.conf.d/*

Check if /usr/local/lib is included in the list displayed. If so then no action is needed.

If /usr/local/lib is not already included, then create as root a file under /etc/ld.so.conf.d that contains a line containing

/usr/local/lib

Make sure that /etc/ld.so.conf contains a line as follows

include /etc/ld.so.conf.d/*.conf

To ensure the cache has been updated, run this command:

sudo /sbin/ldconfig

Test Setup

Instead of setting up the shared library cache as described above, if you have customized the location of the libraries using for example ./configure --prefix=/home/peter/work/mythtv, you can install and run the backend and frontend in your home directory by setting the path of the lib files as follows:

export LD_LIBRARY_PATH=/home/peter/work/mythtv/lib
export PATH="$PATH:/home/peter/work/mythtv/bin"

Install MythWeb

If you plan to run MythWeb, install it on your master backend server. Install the dependencies, listed above. Check out Mythweb from git:

Step Command to run
clone cd ~/build
git clone https://github.com/MythTV/mythweb.git mythweb
cd mythweb
Check versions available git branch -a
Choose your version. The current stable released version is 33-fixes. We recommend to use that version. git checkout fixes/0.xx

Set up the web application as follows:

cd ~/build/mythweb/
sudo cp -r ~/build/mythweb /usr/local/share/mythtv/mythweb
sudo ln -s /usr/local/share/mythtv/mythweb/ /var/www/html/
sudo cp -v /usr/local/share/mythtv/mythweb/mythweb.conf.apache /etc/apache2/sites-available/mythweb.conf

Edit file /etc/apache2/sites-available/mythweb.conf using gedit or vi, for example:

sudo vi /etc/apache2/sites-available/mythweb.conf

Change the lines containing <Directory "/var/www/html/data"> and <Directory "/var/www/html" > so that they read <Directory "/var/www/html/mythweb/data"> and <Directory "/var/www/html/mythweb" >, i.e. add the mythweb subdirectory.

sudo a2enmod rewrite
sudo a2ensite mythweb.conf
sudo chown -R www-data:www-data /usr/local/share/mythtv/mythweb/data/
sudo chmod -R g+w /usr/local/share/mythtv/mythweb/data/

Restart your apache server as follows to get the changes applied:

sudo /etc/init.d/apache2 restart

the database and backend must be running for MythWeb to work. At this point you have not yet set up the database or the backend so you cannot try MythWeb. Once those things have been set up and are running, test MythWeb by navigating to http://servername/mythweb where servername is your master backend server on which mythweb is running. If running from a different system you may have to add servername plus its ip address to your /etc/hosts file.

For more advanced and detailed instructions on MythWeb see the file mythweb/INSTALL in the download from github.

Post-install tasks

After installing the software there are a number of steps that must be taken before you have a working environment. If you installed from a pre-built package these would be done automatically.

Creating the mythtv user

MythTV backend needs to run as its own user. This should be a system account. Create a user as follows:

sudo useradd --system mythtv

Users might want to add --groups cdrom,audio,video to the above.

MythTV Database Setup

Run these commands from the command line. The mysql command will prompt for your root database password, which you would have supplied during mysql installation. The mysql daemon must be running.

mysql -u root -p
create database mythconverg;
create user 'mythtv'@'%' identified by 'mythtv';
create user 'mythtv'@'localhost' identified by 'mythtv';
set password for 'mythtv'@'%' = password('mythtv');
set password for 'mythtv'@'localhost' = password('mythtv');
connect mythconverg;
grant all privileges on *.* to 'mythtv'@'%' with grant option;
grant all privileges on *.* to 'mythtv'@'localhost' with grant option;
flush privileges;
exit;

Run the following command to set up time zone tables:

mysql_tzinfo_to_sql /usr/share/zoneinfo | mysql -u root -p mysql

Ignore warnings like "Warning: Unable to load '/usr/share/zoneinfo/iso3166.tab' as time zone. Skipping it.".

Run mythbackend. This will automatically create your database or upgrade your previous mythconverg database schema to the latest version:

mythbackend

mythbackend will start up and create the database tables, after which it will shut down. Further attempts to start it will result in a message as follows:

 E  Scheduler: No capture cards are defined in the database.
 Perhaps you should re-read the installation instructions?

If there are problems with the database, see the article Database Setup.

Before you can get the backend to start up and stay running, you have to configure at least one capture card correctly, plus one video source and connect these with an input. See Configuring_MythTV. Note that if you had installed the Ubuntu pre-built package there would not be this restriction, the backend can run without any configuration being done.

Backend Startup

For MythTV to be able to schedule and make recordings, the backend must be running at the time of the scheduled recordings. Normally this means running the backend at all times while the server is running. It should be set up to be automatically started when the server starts. This is handled automatically for you in the pre-built packages, but if you are building it yourself you have to set up some mechanism. Possible ways of doing it are systemd, Upstart, init script, /etc/rc.local. Ubuntu packages run it from Upstart (but is likely to switch to systemd in 16.04), which has the ability to restart the process if it fails.

The simplest way will be by editing the rc.local. Use gksudo gedit to edit rc.local and add the following line:

/usr/local/bin/mythbackend -d --logpath /tmp/ --user mythtv

This is a very basic and simplistic approach, but will work. For a reliable system you need to use something more advanced like Upstart. If you install from the Ubuntu or MythBuntu package the Upstart setup is done for you. Also you should create a directory other than /tmp/ for your logs. /var/log/mythtv is the popular location. Note that whatever directory you create for logs must be writeable by the mythtv user as well as frontend users. The frontend user if your normal Linux login, which you will use for viewing MythTV.

You can get a list of options available with mythbackend by running mythbackend --help.

If the backend starts up before you have added any capture cards it will immediately shut down again. Proceed to Configuring MythTV and complete the configuration up to the point of setting up a capture card, a video source and an input connection, before trying to start it again.

Next Steps

At this point you need to perform the configuration steps. See the table of contents and proceed to Configuring_MythTV and then Configuring_Frontend. Until you have done that you will not be able to do anything useful with MythTV.