Why can't you climb to the label of Douban movie?

1. For example, I want to inquire about the movie (Infernal Affairs)

2.
15

3.

4.

Mar.03,2021

these data are generated by asynchronous requests, right? you can only climb Synchronize data when climbing a page. You need to climb the interface of the page


this tag is probably generated by js


this is data loaded asynchronously.
to crawl, you need to find the json where the data is stored.
find the way: open the developer tool, find the xhr item, and then analyze and extract the URL containing json.


check whether there is such data in the HTML page you directly requested. If not, it should be JS generated

.
Menu