Changeset 784:64b8c0a5c0bc

Timestamp:

06/16/16 17:42:51 (8 years ago)

Author:

István Váradi <ivaradi@…>

Branch:

version_0.37_maint

hg-Phase:

(<MercurialRepository 1 'hg:/home/ivaradi/mlx/hg' '/'>, 'public')

Message:

Made the handling of non-Unicode strings more robust

File:

• src/mlx/util.py (modified) (1 diff)

src/mlx/util.py

@@ -170 +170 @@
 
 _utf8decoder = codecs.getdecoder("utf-8")
+_latin2decoder = codecs.getdecoder("iso8859-2")
 
 def utf2unicode(text):
     """Convert the given text from UTF-8 encoding to unicode."""
-    return unicode(_utf8decoder(text)[0])
+    try:
+        return unicode(_utf8decoder(text)[0])
+    except:
+        try:
+            return unicode(_latin2decoder(text)[0])
+        except:
+            return unicode(list(text))