[mythtv-users] problem with Greek characters in storage group paths
Yianni Vidalis
yiannividalis at hotmail.com
Tue Jul 27 19:57:31 UTC 2010
Well, I've spent the last two days trying to isolate the problem.
It
turns out there were more than one:
I think the conversion of
the non-ascii storage group path relates to #8530, but it only creates
problem if the top storage group folder includes non-ascii characters.
Subfolders are scanned ok.
the command:
mysql -umythtv -p
mythconverg -e 'status;'
on my old database was giving me:
Server
characterset: latin1
Db characterset: latin1
Client
characterset: utf8
Conn. characterset: utf8
whilst the
newly created in opensuse 11.2
Server characterset: utf8
Db
characterset: utf8
Client characterset: utf8
Conn.
characterset: utf8
I included in my /etc/my.cnf under [mysqld]
default-character-set=latin1
character_set_server=latin1
and
fixed that part (of course, I recreated the database)
Now, the
main problem that I am still facing, and for which I would appreciate
any help, is that the backend cannot scan video folders that include
non-ascii subfolders or files but only when it is started by the
/etc/init.d/mythbackend script.
If I start mythbackend as the
mythtv user or root, and start mythfrontend on another terminal,
everything is perfectly ok and the database gets updated with the
videos.
I scanned some old tickets (including one of mine) and
came accross #7487. I think it is very similar to that.
Here is a very small part of the log (mythfrontend -v all)
that shows what the frontend reads in the folders. It actually creates
incremental paths with tens of '/' until it stops and starts on the next
file. It's almost fun to watch!
---------------------
2010-07-27 20:23:57.159 MythVideo::ScanVideoDirectory Scanning Group (myth://Videos@al2kpro/myth/video/)
2010-07-27 20:23:57.160 MSqlQuery::exec(DBManager0) SELECT DISTINCT dirname FROM storagegroup WHERE groupname = 'Videos' AND hostname = 'al2kpro' <<<< Returns 1 row(s)
2010-07-27 20:23:57.160 MSqlQuery::next(DBManager0) Result: "dirname = /myth/video/"
2010-07-27 20:23:57.160 MythSocket(189e410:32): write -> 32 66 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video/[]:[]0
2010-07-27 20:23:57.160 MythSocket(189e410:32): writeBlock(0x34198648, 74)
2010-07-27 20:23:57.163 MythSocket(189e410:32): readBlock(0x33681224, 8) called
2010-07-27 20:23:57.163 MythSocket(189e410:32): readBlock(0x33682008, 143) called
2010-07-27 20:23:57.163 MythSocket(189e410:32): read <- 32 143 dir::al2kpro::0[]:[]file::folder.jpg::0[]:[]file::mythtv_backup.sql::2549872[]:[]dir::storage::0[]:[]file::storage.txt::37[]:[]dir::torrents::0
2010-07-27 20:23:57.163 Got data on select
2010-07-27 20:23:57.163 Processing ready reads
2010-07-27 20:23:57.163 MythSocket(189e410:32): write -> 32 74 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro[]:[]0
2010-07-27 20:23:57.163 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.163 Reacquired ready read lock
2010-07-27 20:23:57.163 MythSocket(189e410:32): writeBlock(0x33682712, 82)
2010-07-27 20:23:57.163 ProcessAddRemoveQueues
2010-07-27 20:23:57.163 Construct FD_SET
2010-07-27 20:23:57.163 Waiting on select..
2010-07-27 20:23:57.165 MythSocket(189e410:32): readBlock(0x33681704, 8) called
2010-07-27 20:23:57.165 MythSocket(189e410:32): readBlock(0x33682856, 200) called
2010-07-27 20:23:57.165 MythSocket(189e410:32): read <- 32 200 file::Babylon AD.mkv::2066189725[]:[]dir::Comedies::0[]:[]dir::Documentaries::0[]:[]dir::Historical::0[]:[]dir::Social::0[]:[]dir::Thrillers::0[]:[]dir::TV::0[]:[]dir::Videos::0[]:[]dir::War Movies::0
2010-07-27 20:23:57.165 Got data on select
2010-07-27 20:23:57.165 Processing ready reads
2010-07-27 20:23:57.165 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.165 Reacquired ready read lock
2010-07-27 20:23:57.165 ProcessAddRemoveQueues
2010-07-27 20:23:57.165 Construct FD_SET
2010-07-27 20:23:57.165 Waiting on select..
2010-07-27 20:23:57.165 MythSocket(189e410:32): write -> 32 83 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Comedies[]:[]0
2010-07-27 20:23:57.165 MythSocket(189e410:32): writeBlock(0x33681512, 91)
2010-07-27 20:23:57.167 MythSocket(189e410:32): readBlock(0x33682280, 8) called
2010-07-27 20:23:57.167 MythSocket(189e410:32): readBlock(0x33683448, 203) called
2010-07-27 20:23:57.167 MythSocket(189e410:32): read <- 32 203 file::Big Buck Bunny.avi::928670754[]:[]file::folder.jpg::80751[]:[]file::Fun with Dick and Jane.avi::1128029272[]:[]file::Mamma Mia.mkv::1710559055[]:[]file::What Did You Do at War Daddy.avi::1461189334
2010-07-27 20:23:57.167 Got data on select
2010-07-27 20:23:57.167 Processing ready reads
2010-07-27 20:23:57.167 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.167 Reacquired ready read lock
2010-07-27 20:23:57.167 ProcessAddRemoveQueues
2010-07-27 20:23:57.167 Construct FD_SET
2010-07-27 20:23:57.167 Waiting on select..
2010-07-27 20:23:57.168 MythSocket(189e410:32): write -> 32 88 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Documentaries[]:[]0
2010-07-27 20:23:57.168 MythSocket(189e410:32): writeBlock(0x33683704, 96)
2010-07-27 20:23:57.169 MythSocket(189e410:32): readBlock(0x34881256, 8) called
2010-07-27 20:23:57.169 MythSocket(189e410:32): readBlock(0x34881608, 56) called
2010-07-27 20:23:57.169 MythSocket(189e410:32): read <- 32 56 file::1453.avi::714827674[]:[]file::kemal.avi::823369268
2010-07-27 20:23:57.169 Got data on select
2010-07-27 20:23:57.169 Processing ready reads
2010-07-27 20:23:57.169 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.169 Reacquired ready read lock
2010-07-27 20:23:57.169 ProcessAddRemoveQueues
2010-07-27 20:23:57.169 Construct FD_SET
2010-07-27 20:23:57.169 Waiting on select..
2010-07-27 20:23:57.169 MythSocket(189e410:32): write -> 32 85 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical[]:[]0
2010-07-27 20:23:57.169 MythSocket(189e410:32): writeBlock(0x33682088, 93)
2010-07-27 20:23:57.171 MythSocket(189e410:32): readBlock(0x33681656, 8) called
2010-07-27 20:23:57.171 MythSocket(189e410:32): readBlock(0x34003512, 176) called
2010-07-27 20:23:57.171 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.171 Got data on select
2010-07-27 20:23:57.171 Processing ready reads
2010-07-27 20:23:57.171 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.171 Reacquired ready read lock
2010-07-27 20:23:57.171 ProcessAddRemoveQueues
2010-07-27 20:23:57.171 Construct FD_SET
2010-07-27 20:23:57.171 Waiting on select..
2010-07-27 20:23:57.171 MythSocket(189e410:32): write -> 32 86 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical/[]:[]0
2010-07-27 20:23:57.171 MythSocket(189e410:32): writeBlock(0x34883176, 94)
2010-07-27 20:23:57.173 MythSocket(189e410:32): readBlock(0x33683176, 8) called
2010-07-27 20:23:57.173 MythSocket(189e410:32): readBlock(0x34883320, 176) called
2010-07-27 20:23:57.173 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.173 Got data on select
2010-07-27 20:23:57.173 Processing ready reads
2010-07-27 20:23:57.173 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.173 Reacquired ready read lock
2010-07-27 20:23:57.173 ProcessAddRemoveQueues
2010-07-27 20:23:57.173 Construct FD_SET
2010-07-27 20:23:57.173 Waiting on select..
2010-07-27 20:23:57.173 MythSocket(189e410:32): write -> 32 87 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical//[]:[]0
2010-07-27 20:23:57.173 MythSocket(189e410:32): writeBlock(0x36206008, 95)
2010-07-27 20:23:57.174 MythSocket(189e410:32): readBlock(0x33999816, 8) called
2010-07-27 20:23:57.174 MythSocket(189e410:32): readBlock(0x36205592, 176) called
2010-07-27 20:23:57.174 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.174 Got data on select
2010-07-27 20:23:57.175 Processing ready reads
2010-07-27 20:23:57.175 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.175 Reacquired ready read lock
2010-07-27 20:23:57.175 ProcessAddRemoveQueues
2010-07-27 20:23:57.175 Construct FD_SET
2010-07-27 20:23:57.175 Waiting on select..
2010-07-27 20:23:57.175 MythSocket(189e410:32): write -> 32 88 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical///[]:[]0
2010-07-27 20:23:57.175 MythSocket(189e410:32): writeBlock(0x36207736, 96)
2010-07-27 20:23:57.176 MythSocket(189e410:32): readBlock(0x36205752, 8) called
2010-07-27 20:23:57.176 MythSocket(189e410:32): readBlock(0x36207048, 176) called
2010-07-27 20:23:57.176 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.176 Got data on select
2010-07-27 20:23:57.176 Processing ready reads
2010-07-27 20:23:57.176 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.176 Reacquired ready read lock
2010-07-27 20:23:57.176 ProcessAddRemoveQueues
2010-07-27 20:23:57.176 Construct FD_SET
2010-07-27 20:23:57.176 Waiting on select..
2010-07-27 20:23:57.176 MythSocket(189e410:32): write -> 32 89 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical////[]:[]0
2010-07-27 20:23:57.176 MythSocket(189e410:32): writeBlock(0x36209464, 97)
2010-07-27 20:23:57.178 MythSocket(189e410:32): readBlock(0x36207208, 8) called
2010-07-27 20:23:57.178 MythSocket(189e410:32): readBlock(0x36208776, 176) called
2010-07-27 20:23:57.178 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.178 Got data on select
2010-07-27 20:23:57.178 Processing ready reads
2010-07-27 20:23:57.178 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.178 Reacquired ready read lock
2010-07-27 20:23:57.178 ProcessAddRemoveQueues
2010-07-27 20:23:57.178 Construct FD_SET
2010-07-27 20:23:57.178 Waiting on select..
2010-07-27 20:23:57.178 MythSocket(189e410:32): write -> 32 90 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical/////[]:[]0
2010-07-27 20:23:57.178 MythSocket(189e410:32): writeBlock(0x36211192, 98)
2010-07-27 20:23:57.180 MythSocket(189e410:32): readBlock(0x36208936, 8) called
2010-07-27 20:23:57.180 MythSocket(189e410:32): readBlock(0x36210248, 176) called
2010-07-27 20:23:57.180 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.180 Got data on select
2010-07-27 20:23:57.180 Processing ready reads
2010-07-27 20:23:57.180 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.180 Reacquired ready read lock
2010-07-27 20:23:57.180 ProcessAddRemoveQueues
2010-07-27 20:23:57.180 Construct FD_SET
2010-07-27 20:23:57.180 Waiting on select..
2010-07-27 20:23:57.180 MythSocket(189e410:32): write -> 32 91 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical//////[]:[]0
2010-07-27 20:23:57.180 MythSocket(189e410:32): writeBlock(0x36213112, 99)
2010-07-27 20:23:57.181 MythSocket(189e410:32): readBlock(0x34882136, 8) called
2010-07-27 20:23:57.181 MythSocket(189e410:32): readBlock(0x36212696, 176) called
2010-07-27 20:23:57.181 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.181 Got data on select
---------------------
Can somebody guess what the
mythbackend script misses out and cannot scan non-ascii files?
Sorry
for topposting before, that's hotmail's fault.
Thanks,
Yianni.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mythtv.org/pipermail/mythtv-users/attachments/20100727/9ede5869/attachment.htm>
More information about the mythtv-users
mailing list