UnicodeEncodeError: 'latin-1'编解码器无法在位置0-1编码字符：序号不在范围内(256)。

Question

我是一个Python的新手。今天在编写一些搜索功能时，遇到了一个错误。好吧，我使用SQLAlchemy ORM来完成这个功能，在我的函数中，我输入了一个中文单词作为关键字。HTML页面在/user/search处给我返回了一个UnicodeEncodeError错误:'latin-1' codec can't encode characters in position 0-1: ordinal not in range(256)。

我的代码如下：

def user_search(request):
    name = request.GET.get('name').strip()
    user_list = list()

    if name:
        user_list = User.get_by_name(name)

class User(object):
    @classmethod
    def get_by_name(cls, name):
        return DBSession.query(cls).filter(cls.name==name)

而且 Traceback 在这里:

Traceback:
    File "/usr/local/lib/python2.6/dist-packages/django/core/handlers/base.py" in get_response
  111.                         response = callback(request, *callback_args, **callback_kwargs)
File "/home/jiankong/git/admin-server/lib/decorators.py" in wrapper
  75.                     return func(request, *args, **kwargs)
File "/home/jiankong/git/admin-server/lib/decorators.py" in wrapper
  39.             output = function(request, *args, **kwargs)
File "/home/jiankong/git/admin-server/apps/user/user_views.py" in user_search
  47.     users = jump_page(paginator, page)
File "/home/jiankong/git/admin-server/apps/user/utils.py" in jump_page
  92.         return paginator.page(1)
File "/usr/local/lib/python2.6/dist-packages/django/core/paginator.py" in page
  37.         number = self.validate_number(number)
File "/usr/local/lib/python2.6/dist-packages/django/core/paginator.py" in validate_number
  28.         if number > self.num_pages:
File "/usr/local/lib/python2.6/dist-packages/django/core/paginator.py" in _get_num_pages
  60.             if self.count == 0 and not self.allow_empty_first_page:
File "/usr/local/lib/python2.6/dist-packages/django/core/paginator.py" in _get_count
  48.                 self._count = self.object_list.count()
File "/usr/local/lib/python2.6/dist-packages/SQLAlchemy-0.8.1dev-py2.6-linux-i686.egg/sqlalchemy/orm/query.py" in count
  2414.         return self.from_self(col).scalar()
File "/usr/local/lib/python2.6/dist-packages/SQLAlchemy-0.8.1dev-py2.6-linux-i686.egg/sqlalchemy/orm/query.py" in scalar
  2240.             ret = self.one()
File "/usr/local/lib/python2.6/dist-packages/SQLAlchemy-0.8.1dev-py2.6-linux-i686.egg/sqlalchemy/orm/query.py" in one
  2209.         ret = list(self)
File "/usr/local/lib/python2.6/dist-packages/SQLAlchemy-0.8.1dev-py2.6-linux-i686.egg/sqlalchemy/orm/query.py" in __iter__
  2252.         return self._execute_and_instances(context)
File "/usr/local/lib/python2.6/dist-packages/SQLAlchemy-0.8.1dev-py2.6-linux-i686.egg/sqlalchemy/orm/query.py" in _execute_and_instances
  2267.         result = conn.execute(querycontext.statement, self._params)
File "/usr/local/lib/python2.6/dist-packages/SQLAlchemy-0.8.1dev-py2.6-linux-i686.egg/sqlalchemy/engine/base.py" in execute
  664.                                                 params)
File "/usr/local/lib/python2.6/dist-packages/SQLAlchemy-0.8.1dev-py2.6-linux-i686.egg/sqlalchemy/engine/base.py" in _execute_clauseelement
  764.             compiled_sql, distilled_params
File "/usr/local/lib/python2.6/dist-packages/SQLAlchemy-0.8.1dev-py2.6-linux-i686.egg/sqlalchemy/engine/base.py" in _execute_context
  871.                                     context)
File "/usr/local/lib/python2.6/dist-packages/SQLAlchemy-0.8.1dev-py2.6-linux-i686.egg/sqlalchemy/engine/default.py" in do_execute
  324.         cursor.execute(statement, parameters)
File "/usr/local/lib/python2.6/dist-packages/MySQL_python-1.2.4-py2.6-linux-i686.egg/MySQLdb/cursors.py" in execute
  183.             query = query % db.literal(args)
File "/usr/local/lib/python2.6/dist-packages/MySQL_python-1.2.4-py2.6-linux-i686.egg/MySQLdb/connections.py" in literal
  264.         return self.escape(o, self.encoders)
File "/usr/local/lib/python2.6/dist-packages/MySQL_python-1.2.4-py2.6-linux-i686.egg/MySQLdb/connections.py" in unicode_literal
  202.                 return db.literal(u.encode(unicode_literal.charset))

Exception Type: UnicodeEncodeError at /user/search
Exception Value: 'latin-1' codec can't encode characters in position 0-1: ordinal not in range(256)`

当我遇到这个错误时，我在Python Shell中进行了测试，它可以正常工作。代码如下：

from apps.user.models import User user = User.get_by_name('某人').first() print user print user.name 某人

那么我该怎么做才能让它在我的HTML页面中正常工作呢？非常感谢！！

- jiank

---

我猜 User.name 的类型是字符串？试着将它改成 Unicode。 - schlamar

Answer 1

我假设你在这里使用的是MySQL和MySQLdb驱动程序。

MySQLdb驱动程序使用的默认编码是latin-1，不支持你的字符集。你需要使用UTF-8（或其他编码，但UTF-8最常见）才能通过MySQLdb与数据库通信（参见http://docs.sqlalchemy.org/en/rel_0_8/dialects/mysql.html#unicode）。

要实现这样的操作，请使用以下代码创建引擎：

create_engine('mysql+mysqldb://USER:@SERVER:PORT/DB?charset=utf8', encoding='utf-8')

你也可以使用 sqlalchemy.engine.url.URL 类构造引擎的 URL，并将其发送到 create engine 函数。我发现当你有一个配置文件时，这很有用。

import sqlalchemy.engine.url as url

engine_url = url.URL(
    drivername='mysql+' + cfg['MYSQL_PYTHON_DRIVER'],
    host=cfg['MYSQL_HOST'],
    port=cfg['MYSQL_PORT'],
    username=cfg['MYSQL_USER'],
    password=cfg['MYSQL_PWD'],
    database=cfg['MYSQL_DB'],
    query={'charset': 'utf8'}
)
db = create_engine(engine_url, encoding='utf-8')

希望这可以帮助到您。

- Balthazar Rouberol

Answer 2

根据您的堆栈跟踪，您正在使用打开了unicode编码的MySQL Python，因为它正在进行编码。因此，您可能需要指定兼容的编码（请注意，这是由MySQLdb DBAPI使用的所有设置，SQLalhcemy只是将它们传递）：

create_engine('mysql+mysqldb:///mydb?charset=utf8&use_unicode=1')

http://docs.sqlalchemy.org/en/rel_0_8/dialects/mysql.html#unicode

- zzzeek