logo标签列表

内置模块未找到错误：找不到名为'itemadapter'的模块。

pythonscrapy
3
我正在尝试在Scrapyhub上运行爬虫，但出现了以下错误。但是这个爬虫在本地机器上运行良好。我已经更改了爬虫项目和爬虫模块的名称。
      File "/usr/local/lib/python3.8/site-packages/scrapy/crawler.py", line 103, in _create_engine
        return ExecutionEngine(self, lambda _: self.stop())
      File "/usr/local/lib/python3.8/site-packages/scrapy/core/engine.py", line 70, in __init__
        self.scraper = Scraper(crawler)
      File "/usr/local/lib/python3.8/site-packages/scrapy/core/scraper.py", line 71, in __init__
        self.itemproc = itemproc_cls.from_crawler(crawler)
      File "/usr/local/lib/python3.8/site-packages/scrapy/middleware.py", line 53, in from_crawler
        return cls.from_settings(crawler.settings, crawler)
      File "/usr/local/lib/python3.8/site-packages/scrapy/middleware.py", line 34, in from_settings
        mwcls = load_object(clspath)
      File "/usr/local/lib/python3.8/site-packages/scrapy/utils/misc.py", line 50, in load_object
        mod = import_module(module)
      File "/usr/local/lib/python3.8/importlib/__init__.py", line 127, in import_module
        return _bootstrap._gcd_import(name[level:], package, level)
      File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
        
      File "<frozen importlib._bootstrap>", line 991, in _find_and_load
        
      File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
        
      File "<frozen importlib._bootstrap>", line 655, in _load_unlocked
        
      File "<frozen importlib._bootstrap>", line 618, in _load_backward_compatible
        
      File "<frozen zipimport>", line 259, in load_module
        
      File "/app/__main__.egg/internbit/pipelines.py", line 10, in <module>
        
    builtins.ModuleNotFoundError: No module named 'itemadapter'
1
在本地执行 python -m pip freeze 命令。你能看到一个名为 itemadapter 的包吗？如果是的话，你需要执行 pip install 安装它。 - Tin Nguyen
谢谢回复。但是我已经解决了这个问题。我创建了一个 requirement.txt 文件，并将其配置到 scrappinghub.yml 文件中，然后再次部署它，问题就解决了。注意：在 requirement.txt 文件中，我只指定了 itemadapter 模块。 - Tarun
1个回答
3

只需安装它：

pip install itemadapter

顺便提一句，itemadapter是scrapy模块而不是内置模块。

网页内容由stack overflow 提供, 点击上面的
可以查看英文原文，
原文链接