Python crawler static page crawl

Kotlin
IOS
VB.Net
SQL
Node.js
Swift
Ruby
Go
Oracle
Git
Laravel
Mongodb
Asp.Net
More...

usually after python crawls a static website, you can use xpath or css selectors to match elements, but what to do if the html element is dynamically formed by js after obtaining the data? open the page source code

ul, ullijs

how to match these data

Static-website page-crawler

Mar.04,2021

needs to execute js.
you can try using webdriver

you can use the selenium simulation browser to load the js and then match it.

Previous: How does the socketio of the client native platform unlisten for events?

Next: What about Mac brew: Closed pull requests,?

False
Django, Why does the system automatically generate an empty session? every time the request is made?
Use python to convert dict1 to dict2, in the example. I tried for a long time but couldn't find a solution.
How to self-start the php-fpm service when building a LNMP environment with docker?
Can an array in react state be bound to a dom state using an element in the array?
Wechat browser version 6.6.5 cannot prevent the springback of pull-up and drop-down to the top under ios system.
In express+hbs, how do you define the routed data as a variable on the page?
How to use symbol reference of Iconfont in dva
How to elegantly add data to JSON objects?
Using node to build video streaming server
The proportional width of the echarts graph is inconsistent.
React uses axios to call the background data. After success, how to jump to the page based on the returned value?
I don't understand what a linux command means. Please explain it.
Vue introduces multiple components in vue-router by nesting named views, and does not refresh the same reference in other pages.
Running nodejs reports fewer errors ")"

How to get a vue instance in the axios.js of the axios configuration of the vue project?
A doubt in some promise polyfill
Can v-if bind the value in data when vue v-for loop
When mybatis generator automatically generates entity classes, what happens when there are several fields that do not have corresponding attributes?
JS rendering output string concatenation html should not have a comma