Changeset 787:7fa0ff7749c5

Timestamp:

06/16/16 17:42:51 (8 years ago)

Author:

István Váradi <ivaradi@…>

Branch:

default

Phase:

public

transplant_source:

d¸À¥À¼«LRÿìc,s1etÑ

Message:

Made the handling of non-Unicode strings more robust

File:

• src/mlx/util.py (modified) (1 diff)

src/mlx/util.py

@@ -170 +170 @@
 
 _utf8decoder = codecs.getdecoder("utf-8")
+_latin2decoder = codecs.getdecoder("iso8859-2")
 
 def utf2unicode(text):
     """Convert the given text from UTF-8 encoding to unicode."""
-    return unicode(_utf8decoder(text)[0])
+    try:
+        return unicode(_utf8decoder(text)[0])
+    except:
+        try:
+            return unicode(_latin2decoder(text)[0])
+        except:
+            return unicode(list(text))