The returned data that can be seen in the Network panel of the console is gone after crawling out with a crawler. Can it be cracked?

try to climb Weibo"s data. There is a since_id field for climbing the next page, which can be seen on the console, but there is no such field for the data obtained from the request initiated by code. There are all other fields, but this field is not available, so you can only climb one page of data. Is this the anti-climbing method of Sina? is it difficult to crack it?

Apr.22,2022

use seleniumselenium or splash

Menu