Tag Archives: ERROR: Error downloading & RequestGenerationFailed

[Solved] Scrapy Error: ERROR: Error downloading & RequestGenerationFailed

Pit review

In recent days, I have realized crawling Baidu hot search movies with scratch, which can be successfully crawled on windows, but when I put the code on Ubuntu 18.04 virtual machine, I didn’t get the content, and the following error occurred:

Solution:

I compared the following version information of their components, that is, this part of the information.

I found that the cryptography version of the virtual machine was obviously low, so I tried to upgrade to the lower level:

pip3 install --upgrade cryptography 

Then run again and find that suddenly it’s OK!