[mythtv-users] problem with Greek characters in storage group paths

Yianni Vidalis yiannividalis at hotmail.com
Tue Jul 27 19:57:31 UTC 2010


Well, I've spent the last two days trying to isolate the problem.

It
 turns out there were more than one:

I think the conversion of 
the non-ascii storage group path relates to #8530, but it only creates 
problem if the top storage group folder includes non-ascii characters. 
Subfolders are scanned ok.

the command:

mysql -umythtv -p 
mythconverg -e 'status;' 

on my old database was giving me:

Server
 characterset:    latin1
Db     characterset:    latin1
Client 
characterset:    utf8
Conn.  characterset:    utf8

whilst the 
newly created in opensuse 11.2 

Server characterset:    utf8
Db    
 characterset:    utf8
Client characterset:    utf8
Conn.  
characterset:    utf8

I included in my /etc/my.cnf under [mysqld]
default-character-set=latin1
character_set_server=latin1

and
 fixed that part (of course, I recreated the database)

Now, the 
main problem that I am still facing, and for which I would appreciate 
any help, is that the backend cannot scan video folders that include 
non-ascii subfolders or files but only when it is started by the 
/etc/init.d/mythbackend script.

If I start mythbackend as the 
mythtv user or root, and start mythfrontend on another terminal, 
everything is perfectly ok and the database gets updated with the 
videos.

I scanned some old tickets (including one of mine) and 
came accross #7487. I think it is very similar to that.

Here is a very small part of the log (mythfrontend -v all) 
that shows what the frontend reads in the folders. It actually creates 
incremental paths with tens of '/' until it stops and starts on the next
 file. It's almost fun to watch!

---------------------
2010-07-27 20:23:57.159 MythVideo::ScanVideoDirectory Scanning Group (myth://Videos@al2kpro/myth/video/)
2010-07-27 20:23:57.160 MSqlQuery::exec(DBManager0) SELECT DISTINCT dirname FROM storagegroup WHERE groupname = 'Videos' AND hostname = 'al2kpro' <<<< Returns 1 row(s)
2010-07-27 20:23:57.160 MSqlQuery::next(DBManager0) Result: "dirname = /myth/video/"
2010-07-27 20:23:57.160 MythSocket(189e410:32): write -> 32 66      QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video/[]:[]0
2010-07-27 20:23:57.160 MythSocket(189e410:32): writeBlock(0x34198648, 74)
2010-07-27 20:23:57.163 MythSocket(189e410:32): readBlock(0x33681224, 8) called
2010-07-27 20:23:57.163 MythSocket(189e410:32): readBlock(0x33682008, 143) called
2010-07-27 20:23:57.163 MythSocket(189e410:32): read  <- 32 143     dir::al2kpro::0[]:[]file::folder.jpg::0[]:[]file::mythtv_backup.sql::2549872[]:[]dir::storage::0[]:[]file::storage.txt::37[]:[]dir::torrents::0
2010-07-27 20:23:57.163 Got data on select
2010-07-27 20:23:57.163 Processing ready reads
2010-07-27 20:23:57.163 MythSocket(189e410:32): write -> 32 74      QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro[]:[]0
2010-07-27 20:23:57.163 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.163 Reacquired ready read lock
2010-07-27 20:23:57.163 MythSocket(189e410:32): writeBlock(0x33682712, 82)
2010-07-27 20:23:57.163 ProcessAddRemoveQueues
2010-07-27 20:23:57.163 Construct FD_SET
2010-07-27 20:23:57.163 Waiting on select..
2010-07-27 20:23:57.165 MythSocket(189e410:32): readBlock(0x33681704, 8) called
2010-07-27 20:23:57.165 MythSocket(189e410:32): readBlock(0x33682856, 200) called
2010-07-27 20:23:57.165 MythSocket(189e410:32): read  <- 32 200     file::Babylon AD.mkv::2066189725[]:[]dir::Comedies::0[]:[]dir::Documentaries::0[]:[]dir::Historical::0[]:[]dir::Social::0[]:[]dir::Thrillers::0[]:[]dir::TV::0[]:[]dir::Videos::0[]:[]dir::War Movies::0
2010-07-27 20:23:57.165 Got data on select
2010-07-27 20:23:57.165 Processing ready reads
2010-07-27 20:23:57.165 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.165 Reacquired ready read lock
2010-07-27 20:23:57.165 ProcessAddRemoveQueues
2010-07-27 20:23:57.165 Construct FD_SET
2010-07-27 20:23:57.165 Waiting on select..
2010-07-27 20:23:57.165 MythSocket(189e410:32): write -> 32 83      QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Comedies[]:[]0
2010-07-27 20:23:57.165 MythSocket(189e410:32): writeBlock(0x33681512, 91)
2010-07-27 20:23:57.167 MythSocket(189e410:32): readBlock(0x33682280, 8) called
2010-07-27 20:23:57.167 MythSocket(189e410:32): readBlock(0x33683448, 203) called
2010-07-27 20:23:57.167 MythSocket(189e410:32): read  <- 32 203     file::Big Buck Bunny.avi::928670754[]:[]file::folder.jpg::80751[]:[]file::Fun with Dick and Jane.avi::1128029272[]:[]file::Mamma Mia.mkv::1710559055[]:[]file::What Did You Do at War Daddy.avi::1461189334
2010-07-27 20:23:57.167 Got data on select
2010-07-27 20:23:57.167 Processing ready reads
2010-07-27 20:23:57.167 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.167 Reacquired ready read lock
2010-07-27 20:23:57.167 ProcessAddRemoveQueues
2010-07-27 20:23:57.167 Construct FD_SET
2010-07-27 20:23:57.167 Waiting on select..
2010-07-27 20:23:57.168 MythSocket(189e410:32): write -> 32 88      QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Documentaries[]:[]0
2010-07-27 20:23:57.168 MythSocket(189e410:32): writeBlock(0x33683704, 96)
2010-07-27 20:23:57.169 MythSocket(189e410:32): readBlock(0x34881256, 8) called
2010-07-27 20:23:57.169 MythSocket(189e410:32): readBlock(0x34881608, 56) called
2010-07-27 20:23:57.169 MythSocket(189e410:32): read  <- 32 56      file::1453.avi::714827674[]:[]file::kemal.avi::823369268
2010-07-27 20:23:57.169 Got data on select
2010-07-27 20:23:57.169 Processing ready reads
2010-07-27 20:23:57.169 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.169 Reacquired ready read lock
2010-07-27 20:23:57.169 ProcessAddRemoveQueues
2010-07-27 20:23:57.169 Construct FD_SET
2010-07-27 20:23:57.169 Waiting on select..
2010-07-27 20:23:57.169 MythSocket(189e410:32): write -> 32 85      QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical[]:[]0
2010-07-27 20:23:57.169 MythSocket(189e410:32): writeBlock(0x33682088, 93)
2010-07-27 20:23:57.171 MythSocket(189e410:32): readBlock(0x33681656, 8) called
2010-07-27 20:23:57.171 MythSocket(189e410:32): readBlock(0x34003512, 176) called
2010-07-27 20:23:57.171 MythSocket(189e410:32): read  <- 32 176     dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.171 Got data on select
2010-07-27 20:23:57.171 Processing ready reads
2010-07-27 20:23:57.171 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.171 Reacquired ready read lock
2010-07-27 20:23:57.171 ProcessAddRemoveQueues
2010-07-27 20:23:57.171 Construct FD_SET
2010-07-27 20:23:57.171 Waiting on select..
2010-07-27 20:23:57.171 MythSocket(189e410:32): write -> 32 86      QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical/[]:[]0
2010-07-27 20:23:57.171 MythSocket(189e410:32): writeBlock(0x34883176, 94)
2010-07-27 20:23:57.173 MythSocket(189e410:32): readBlock(0x33683176, 8) called
2010-07-27 20:23:57.173 MythSocket(189e410:32): readBlock(0x34883320, 176) called
2010-07-27 20:23:57.173 MythSocket(189e410:32): read  <- 32 176     dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.173 Got data on select
2010-07-27 20:23:57.173 Processing ready reads
2010-07-27 20:23:57.173 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.173 Reacquired ready read lock
2010-07-27 20:23:57.173 ProcessAddRemoveQueues
2010-07-27 20:23:57.173 Construct FD_SET
2010-07-27 20:23:57.173 Waiting on select..
2010-07-27 20:23:57.173 MythSocket(189e410:32): write -> 32 87      QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical//[]:[]0
2010-07-27 20:23:57.173 MythSocket(189e410:32): writeBlock(0x36206008, 95)
2010-07-27 20:23:57.174 MythSocket(189e410:32): readBlock(0x33999816, 8) called
2010-07-27 20:23:57.174 MythSocket(189e410:32): readBlock(0x36205592, 176) called
2010-07-27 20:23:57.174 MythSocket(189e410:32): read  <- 32 176     dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.174 Got data on select
2010-07-27 20:23:57.175 Processing ready reads
2010-07-27 20:23:57.175 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.175 Reacquired ready read lock
2010-07-27 20:23:57.175 ProcessAddRemoveQueues
2010-07-27 20:23:57.175 Construct FD_SET
2010-07-27 20:23:57.175 Waiting on select..
2010-07-27 20:23:57.175 MythSocket(189e410:32): write -> 32 88      QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical///[]:[]0
2010-07-27 20:23:57.175 MythSocket(189e410:32): writeBlock(0x36207736, 96)
2010-07-27 20:23:57.176 MythSocket(189e410:32): readBlock(0x36205752, 8) called
2010-07-27 20:23:57.176 MythSocket(189e410:32): readBlock(0x36207048, 176) called
2010-07-27 20:23:57.176 MythSocket(189e410:32): read  <- 32 176     dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.176 Got data on select
2010-07-27 20:23:57.176 Processing ready reads
2010-07-27 20:23:57.176 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.176 Reacquired ready read lock
2010-07-27 20:23:57.176 ProcessAddRemoveQueues
2010-07-27 20:23:57.176 Construct FD_SET
2010-07-27 20:23:57.176 Waiting on select..
2010-07-27 20:23:57.176 MythSocket(189e410:32): write -> 32 89      QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical////[]:[]0
2010-07-27 20:23:57.176 MythSocket(189e410:32): writeBlock(0x36209464, 97)
2010-07-27 20:23:57.178 MythSocket(189e410:32): readBlock(0x36207208, 8) called
2010-07-27 20:23:57.178 MythSocket(189e410:32): readBlock(0x36208776, 176) called
2010-07-27 20:23:57.178 MythSocket(189e410:32): read  <- 32 176     dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.178 Got data on select
2010-07-27 20:23:57.178 Processing ready reads
2010-07-27 20:23:57.178 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.178 Reacquired ready read lock
2010-07-27 20:23:57.178 ProcessAddRemoveQueues
2010-07-27 20:23:57.178 Construct FD_SET
2010-07-27 20:23:57.178 Waiting on select..
2010-07-27 20:23:57.178 MythSocket(189e410:32): write -> 32 90      QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical/////[]:[]0
2010-07-27 20:23:57.178 MythSocket(189e410:32): writeBlock(0x36211192, 98)
2010-07-27 20:23:57.180 MythSocket(189e410:32): readBlock(0x36208936, 8) called
2010-07-27 20:23:57.180 MythSocket(189e410:32): readBlock(0x36210248, 176) called
2010-07-27 20:23:57.180 MythSocket(189e410:32): read  <- 32 176     dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.180 Got data on select
2010-07-27 20:23:57.180 Processing ready reads
2010-07-27 20:23:57.180 MythSocketThread: Total read time: 0ms, on sockets
2010-07-27 20:23:57.180 Reacquired ready read lock
2010-07-27 20:23:57.180 ProcessAddRemoveQueues
2010-07-27 20:23:57.180 Construct FD_SET
2010-07-27 20:23:57.180 Waiting on select..
2010-07-27 20:23:57.180 MythSocket(189e410:32): write -> 32 91      QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical//////[]:[]0
2010-07-27 20:23:57.180 MythSocket(189e410:32): writeBlock(0x36213112, 99)
2010-07-27 20:23:57.181 MythSocket(189e410:32): readBlock(0x34882136, 8) called
2010-07-27 20:23:57.181 MythSocket(189e410:32): readBlock(0x36212696, 176) called
2010-07-27 20:23:57.181 MythSocket(189e410:32): read  <- 32 176     dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668
2010-07-27 20:23:57.181 Got data on select
---------------------




Can somebody guess what the 
mythbackend script misses out and cannot scan non-ascii files?

Sorry
 for topposting before, that's hotmail's fault.

Thanks,

Yianni. 		 	   		  
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mythtv.org/pipermail/mythtv-users/attachments/20100727/9ede5869/attachment.htm>


More information about the mythtv-users mailing list