What are the following reasons why the crawler reported an error?

2018-10-18 15:23:52 [scrapy.core.engine] INFO: Spider opened
2018-10-18 15:23:52 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2018-10-18 15:23:52 [scrapy.extensions.telnet] DEBUG: Telnet console listening on 127.0.0.1:6023
2018-10-18 15:23:52 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://passport.36kr.com/passport/sign_in> (failed 1 times): 500 Internal Server Error
2018-10-18 15:23:52 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://passport.36kr.com/passport/sign_in> (failed 2 times): 500 Internal Server Error
2018-10-18 15:23:52 [scrapy.downloadermiddlewares.retry] DEBUG: Gave up retrying <GET https://passport.36kr.com/passport/sign_in> (failed 3 times): 500 Internal Server Error
2018-10-18 15:23:52 [scrapy.core.engine] DEBUG: Crawled (500) <GET https://passport.36kr.com/passport/sign_in> (referer: None)
2018-10-18 15:23:52 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <500 https://passport.36kr.com/passport/sign_in>: HTTP status code is not handled or not allowed
2018-10-18 15:23:52 [scrapy.core.engine] INFO: Closing spider (finished)
2018-10-18 15:23:52 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{"downloader/request_bytes": 854,
 "downloader/request_count": 3,

Aug.31,2021

GET https://passport.36kr.com/pas.; (failed 1 times): 500 Internal Server Error
for this information you give, the respones status code is 500, server error

Menu