How to transliterate Cyrillic to Latin using Python 2.7? - not correct translation output -

-

i trying transliterate cyrillic latin excel file. working bottom , can not figure out why isn't working.
when try translate simple text string, python outputs "eeeee eee" instead of correct translation. how can fix give me right translation?? have been trying figure out day! 

symbols = (u"абвгдеёзийклмнопрстуфхъыьэАБВГДЕЁЗИЙКЛМНОПРСТУФХЪЫЬЭ",            u"abvgdeezijklmnoprstufh'y'eabvgdeezijklmnoprstufh'y'e")  tr = {ord(a):ord(b) a, b in zip(*symbols)}  text = u'Добрый Ден' print text.translate(tr)  >>eeeeee eee

i appreciate help!

your source input wrong. entered source , text literals, python did not read right unicode codepoints.

instead, suspect pythonioencoding variable has been set error handler set replace. causes python replace codepoints does not recognize question marks. all cyrillic input treated not-recognized.

as result, codepoint in translation map 63, question mark, mapped last character in symbols[1] (which expected behaviour dictionary comprehension 1 unique key):

>>> unichr(63) u'?' >>> unichr(69) u'e'

the same problem applies text unicode string; too consists of question marks. translation mapping replaces each letter e:

>>> u'?????? ???'.translate({63, 69}) u'eeeeee eee'

you need either avoid entering cyrillic literal characters or fix input method.

in terminal, function of codec terminal (or windows console) supports. configure correct codepage (windows) or locale (posix systems) input , output encoding supports cyrillic (utf-8 best).

in python source file, tell python encoding used string literals codec comment @ top of file.

avoiding literals means using unicode escape sequences:

symbols = (     u'\u0430\u0431\u0432\u0433\u0434\u0435\u0451\u0437\u0438\u0439\u043a\u043b\u043c'     u'\u043d\u043e\u043f\u0440\u0441\u0442\u0443\u0444\u0445\u044a\u044b\u044c\u044d'     u'\u0410\u0411\u0412\u0413\u0414\u0415\u0401\u0417\u0418\u0419\u041a\u041b\u041c'     u'\u041d\u041e\u041f\u0420\u0421\u0422\u0423\u0424\u0425\u042a\u042b\u042c\u042d',     u"abvgdeezijklmnoprstufh'y'eabvgdeezijklmnoprstufh'y'e" ) tr = {ord(a):ord(b) a, b in zip(*symbols)}  text = u'\u0414\u043e\u0431\u0440\u044b\u0439 \u0414\u0435\u043d'  print text.translate(tr)

Comments

Post a Comment

Popular posts from this blog

c# - How Configure Devart dotConnect for SQLite Code First? -

-
can configure following sample code ? when run following code, error : no entity framework provider found ado.net provider invariant name 'devart.data.sqlite' setting in machine.config <system.data> <dbproviderfactories> <add name="dotconnect sqlite" invariant="devart.data.sqlite" description="devart dotconnect sqlite" type="devart.data.sqlite.sqliteproviderfactory, devart.data.sqlite, version=4.6.287.0, culture=neutral, publickeytoken=09af7300eec23701" /> </dbproviderfactories> </system.data> after add below block code in app.config <?xml version="1.0"?> <configuration>   <configsections> <!-- more information on entity framework configuration, visit http://go.microsoft.com/fwlink/?linkid=237468 --> <section name="entityframework" type="system.data.entity.internal.configfile.entityframeworksection, entit...
Read more

java - Copying object fields -

-
what best way of copying classes when need have 2 independent variables? have simple class: public class myclass { boolean = false; string b= "not empty"; } do need make method : assign(myclass data ) { a= data.a; b= data.b; } is there automatic method copy (duplicate) objects in java? do need make method : pretty close. instead of making method, should make constructor. such constructors called copy constructor , , create them this: myclass(myclass data) { = data.a; b = data.b; } and create copy of instance, use constructor this: myclass obj1 = new myclass(); myclass obj2 = new myclass(obj1); copy constructor can tedious : using copy constructor create deep-copy can tedious, when class has mutable fields. in case, assignment create copy of reference, , not object itself. have create copy of fields (if want deep copy). can go recursive. a better way create deep copy serialize , deserialize object. why not use clone()? ...
Read more

c++ - Clear the memory after returning a vector in a function -

-
i have function processes , stores lot of data in , returns results vector of class. amount of data stored in function tremendous , want clear storage memory of function after finished job. necessary (does function automatically clear memory) or should clear memory function? update: vector<customers> process(char* const *filename, vector<int> id) { vector<customers> list_of_customers; (perform actions) return list_of_customers; } variables defined locally within function automatically released @ end of function scope. destructors objects called, should free memory allocated objects (if objects coded correctly). example of such object std::vector . anything you've allocated new must have corresponding delete release storage. try avoid doing own allocation , use raii instead, i.e. containers or smart pointers.
Read more