ask,
scrapy crawler, why did I send it to scrapy.Request
https://www.tianyancha.com/reportContent/24505794/2017then print out the url in callback to become
https://www.tianyancha.com/login?from=https://www.tianyancha.com/reportContent/24505794/2017 Yes
I did a simulated login first
your simulated login failed, and the server redirected your request to the login page
if you are using cookie for simulated login, you can try to turn off the cookie function of scrapy
Previous: How is the HttpClient of C-sharp POST multipart/form-data?
Next: Adding Baidu statistics code to nuxt project does not take effect!