The question of Baidu's home page request

https://www.baidu.com/s?ie=utf-8&csq=1&pstg=20&mod=2&isbd=1&cqid=ab5b865a00011c0b&istc=360&ver=RAlqTgkJPbLaje7aovXUnu9W10JyWiCUCIO&chk=5beba533&isid=7AA7864EC7521136&ie=utf-8&f=8&rsv_bp=1&rsv_idx=1&tn=baidu&wd=%E5%88%BB%E7%BB%B4%E7%A7%91%E6%8A%80&oq=%25E5%2588%25BB%25E7%25BB%25B4%25E7%25A7%2591%25E6%258A%2580&rsv_pq=d2e8063d00015d19&rsv_t=363feGcXiJc4qv0CEHA8KtbYHzzey%2BJzjrrJqrUdOq2btQk8OcsJqVO18PM&rqlang=cn&rsv_enter=0&bs=%E5%88%BB%E7%BB%B4%E7%A7%91%E6%8A%80&f4s=1&_ck=110813.1.3.67.25.728.716&isnop=0&rsv_stat=-2&rsv_bp=1

this is the Baidu search page. I want to grab all the links on the first page of this search, but the catch is not the same as the manual request

[" http://www.baidu.com/link?url."," http://www.baidu.com/link?url.", " http://www.baidu.com/link?url."," http://www.baidu.com/link?url.", " http://www.baidu.com/link?url."," http://www.baidu.com/link?url.", " http://www.baidu.com/link?url."," http://www.baidu.com/link?url.", " http://www.baidu.com/link?url."," http://www.baidu.com/link?url."]

this is all I have caught. The address of the last connection is different from the address requested manually. To solve the problem, I can"t even add cookie reference

.
Nov.12,2021

you can get the final URL by visiting the address for a second time.

import requests
url='http://www.baidu.com/link?url=5lVvExLfIryperp6W3GyKOtw75yz8DcxPY_ht1RGe2jMGqq6dm9Bo4CKRwefK9f_zLAli5uss7LWxkFfDimvU0lB0goz9AgNJrkamueXvIK'
r=requests.get(url)
print(r.url)
Menu