[mythtv] [mythtv-commits] Ticket #6265: Mythvideo removed all (remote)files with umlauts in filename and don't readd them

Markus Schulz msc at antzsystem.de
Fri Aug 14 07:46:08 UTC 2009


Am Wednesday 12 August 2009 schrieb MythTV:
> #6265: Mythvideo removed all (remote)files with umlauts in filename
> and don't readd them
> -----------------------------------------------+---------------------
>------- Reporter:  Markus Schulz <msc at antzsystem.de>  |        Owner: 
> awithers Type:  defect                             |       Status: 
> closed Priority:  minor                              |    Milestone: 
> unknown Component:  Plugin - MythVideo                 |     
> Version:  head Severity:  medium                             |  
> Resolution:  worksforme Mlocked:  0                                 
> |
> -----------------------------------------------+---------------------
>------- Changes (by robertm):
>
>   * status:  new => closed
>   * resolution:  => worksforme
>
>
> Comment:
>
>  This appears to be a non-bug setup (locale or mySQL) issue.  Closing
> this for now, but I encourage discussion on the dev list so that we
> can determine what the cause is so that we can troubleshoot it for
> people. For reference, this (including all above examples) works
> properly here.

Sorry, but still not working:


$ echo $LANG
de_DE.UTF-8

$ mv 'Haende Wie Samt.avi' 'Hände Wie Samt.avi'

2009-08-14 09:28:36.748 buildFileList directory = /data/dvd
2009-08-14 09:28:36.750 MythVideo::ScanVideoDirectory Scanning 
(/data/dvd)
2009-08-14 09:28:36.751 buildFileList directory = /data/upload
2009-08-14 09:28:36.751 MythVideo::ScanVideoDirectory Scanning 
(/data/upload)
2009-08-14 09:28:36.766 buildFileList directory = 
myth://Videos@mythtv/data/media/
2009-08-14 09:28:36.766 MythVideo::ScanVideoDirectory Scanning Group 
(myth://Videos@mythtv/data/media/)
2009-08-14 09:28:37.158 Removing file SG(mythtv) :filme/Adriano 
Celentano/Haende Wie Samt.avi:


The old file was removed but the new not added.


$ awk '/^CREATE TABLE/ { NAME=$3 } /ENGINE/ { print NAME"->"$0 }'  
mythconvergdump.sql                     
`archiveitems`->) ENGINE=MyISAM AUTO_INCREMENT=41 DEFAULT CHARSET=utf8;                                                
`callsignnetworkmap`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                            
`capturecard`->) ENGINE=MyISAM AUTO_INCREMENT=17 DEFAULT CHARSET=utf8;                                                 
`cardinput`->) ENGINE=MyISAM AUTO_INCREMENT=17 DEFAULT CHARSET=utf8;                                                   
`channel`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                       
`channelgroup`->) ENGINE=MyISAM AUTO_INCREMENT=3 DEFAULT CHARSET=utf8;                                                 
`channelgroupnames`->) ENGINE=MyISAM AUTO_INCREMENT=2 DEFAULT 
CHARSET=utf8;                                            
`channelscan`->) ENGINE=MyISAM AUTO_INCREMENT=14 DEFAULT CHARSET=utf8;                                                 
`channelscan_channel`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                           
`channelscan_dtv_multiplex`->) ENGINE=MyISAM AUTO_INCREMENT=192 DEFAULT 
CHARSET=utf8;                                  
`codecparams`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                   
`credits`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                       
`customexample`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                 
`diseqc_config`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                 
`diseqc_tree`->) ENGINE=MyISAM AUTO_INCREMENT=2 DEFAULT CHARSET=utf8;                                                  
`displayprofilegroups`->) ENGINE=MyISAM AUTO_INCREMENT=34 DEFAULT 
CHARSET=utf8;                                        
`displayprofiles`->) ENGINE=MyISAM AUTO_INCREMENT=129 DEFAULT 
CHARSET=utf8;                                            
`dtv_multiplex`->) ENGINE=MyISAM AUTO_INCREMENT=785 DEFAULT 
CHARSET=utf8;                                              
`dtv_privatetypes`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                              
`dvdbookmark`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                   
`dvdinput`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                      
`dvdtranscode`->) ENGINE=MyISAM AUTO_INCREMENT=12 DEFAULT CHARSET=utf8;                                                
`eit_cache`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                     
`filemarkup`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                    
`gallerymetadata`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                               
`gamemetadata`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                  
`gameplayers`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                   
`housekeeping`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                  
`inputgroup`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                    
`inuseprograms`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;                                                                 
`jobqueue`->) ENGINE=MyISAM AUTO_INCREMENT=188 DEFAULT CHARSET=utf8;                                                   
`jumppoints`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`keybindings`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`keyword`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`movies_movies`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`movies_showtimes`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`movies_theaters`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`music_albumart`->) ENGINE=MyISAM AUTO_INCREMENT=80 DEFAULT 
CHARSET=utf8;
`music_albums`->) ENGINE=MyISAM AUTO_INCREMENT=984 DEFAULT CHARSET=utf8;
`music_artists`->) ENGINE=MyISAM AUTO_INCREMENT=711 DEFAULT 
CHARSET=utf8;
`music_directories`->) ENGINE=MyISAM AUTO_INCREMENT=151 DEFAULT 
CHARSET=utf8;
`music_genres`->) ENGINE=MyISAM AUTO_INCREMENT=79 DEFAULT CHARSET=utf8;
`music_playlists`->) ENGINE=MyISAM AUTO_INCREMENT=12 DEFAULT 
CHARSET=utf8;
`music_smartplaylist_categories`->) ENGINE=MyISAM AUTO_INCREMENT=4 
DEFAULT CHARSET=utf8;
`music_smartplaylist_items`->) ENGINE=MyISAM AUTO_INCREMENT=9 DEFAULT 
CHARSET=utf8;
`music_smartplaylists`->) ENGINE=MyISAM AUTO_INCREMENT=9 DEFAULT 
CHARSET=utf8;
`music_songs`->) ENGINE=MyISAM AUTO_INCREMENT=2305 DEFAULT CHARSET=utf8;
`music_stats`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`mythlog`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`mythweb_sessions`->) ENGINE=MyISAM DEFAULT CHARSET=latin1;
`netflix`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`networkiconmap`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`newssites`->) ENGINE=MyISAM DEFAULT CHARSET=latin1;
`oldfind`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`oldprogram`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`oldrecorded`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`people`->) ENGINE=MyISAM AUTO_INCREMENT=43650 DEFAULT CHARSET=utf8;
`phonecallhistory`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`phonedirectory`->) ENGINE=MyISAM AUTO_INCREMENT=3 DEFAULT CHARSET=utf8;
`pidcache`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`playgroup`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`powerpriority`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`profilegroups`->) ENGINE=MyISAM AUTO_INCREMENT=15 DEFAULT CHARSET=utf8;
`program`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`programgenres`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`programrating`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`recgrouppassword`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`record`->) ENGINE=MyISAM AUTO_INCREMENT=925 DEFAULT CHARSET=utf8;
`record_tmp`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`recorded`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`recordedcredits`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`recordedfile`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`recordedmarkup`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`recordedprogram`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`recordedrating`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`recordedseek`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`recordingprofiles`->) ENGINE=MyISAM AUTO_INCREMENT=61 DEFAULT 
CHARSET=utf8;
`recordmatch`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`romdb`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`schemalock`->) ENGINE=MyISAM DEFAULT CHARSET=latin1;
`settings`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`storagegroup`->) ENGINE=MyISAM AUTO_INCREMENT=8 DEFAULT CHARSET=utf8;
`streams`->) ENGINE=MyISAM DEFAULT CHARSET=latin1;
`tvchain`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`tvosdmenu`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`upnpmedia`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`videocast`->) ENGINE=MyISAM AUTO_INCREMENT=5524 DEFAULT CHARSET=utf8;
`videocategory`->) ENGINE=MyISAM AUTO_INCREMENT=5 DEFAULT CHARSET=utf8;
`videocountry`->) ENGINE=MyISAM AUTO_INCREMENT=7 DEFAULT CHARSET=utf8;
`videogenre`->) ENGINE=MyISAM AUTO_INCREMENT=21 DEFAULT CHARSET=utf8;
`videometadata`->) ENGINE=MyISAM AUTO_INCREMENT=16480 DEFAULT 
CHARSET=utf8;
`videometadatacast`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`videometadatacountry`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`videometadatagenre`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`videosource`->) ENGINE=MyISAM AUTO_INCREMENT=6 DEFAULT CHARSET=utf8;
`videotypes`->) ENGINE=MyISAM AUTO_INCREMENT=30 DEFAULT CHARSET=utf8;
`weatherdatalayout`->) ENGINE=MyISAM DEFAULT CHARSET=utf8;
`weatherscreens`->) ENGINE=MyISAM AUTO_INCREMENT=15 DEFAULT 
CHARSET=utf8;
`weathersourcesettings`->) ENGINE=MyISAM AUTO_INCREMENT=31 DEFAULT 
CHARSET=utf8;
`websites`->) ENGINE=MyISAM AUTO_INCREMENT=3 DEFAULT CHARSET=utf8;


I don't know why there are still tables with latin1, perhaps some old 
mythplugins?
Additionally there are some columns with latin1 encoding set:

$ awk '/^CREATE TABLE/ { NAME=$3 } /latin1/ { print NAME"->"$0 }'  
mythconvergdump.sql | grep -v ENGINE

`archiveitems`->  `type` set('Recording','Video','File') character set 
latin1 default NULL,
`credits`->  `role` 
set('actor','director','producer','executive_producer','writer','guest_star','host','adapter','presenter','commentator','guest') 
character set latin1 NOT NULL default '',
`music_smartplaylists`->  `matchtype` set('All','Any') character set 
latin1 NOT NULL default 'All',
`program`->  `audioprop` 
set('STEREO','MONO','SURROUND','DOLBY','HARDHEAR','VISUALIMPAIR') 
character set latin1 NOT NULL,
`program`->  `subtitletypes` 
set('HARDHEAR','NORMAL','ONSCREEN','SIGNED') character set latin1 NOT 
NULL,
`program`->  `videoprop` set('HDTV','WIDESCREEN','AVC') character set 
latin1 NOT NULL,
`recordedcredits`->  `role` 
set('actor','director','producer','executive_producer','writer','guest_star','host','adapter','presenter','commentator','guest') 
character set latin1 NOT NULL default '',
`recordedprogram`->  `audioprop` 
set('STEREO','MONO','SURROUND','DOLBY','HARDHEAR','VISUALIMPAIR') 
character set latin1 NOT NULL,
`recordedprogram`->  `subtitletypes` 
set('HARDHEAR','NORMAL','ONSCREEN','SIGNED') character set latin1 NOT 
NULL,

msc


More information about the mythtv-dev mailing list