How does python (scrapy) work with php to crawl page content?

talk about my naive thinking:
1 my backend uses php as the api interface;
2 now the web page sends the name of an enterprise to the server through post requests;
3 processes the request using python through the server"s proxy;
4 gets the data sent by post, crawls the page with scrapy, and returns the json result;

although php can be handled completely, it seems that the scrapy analysis page is more convenient. Recently, I am learning python, to use the two together in the project, seeking boss education.

Jun.10,2021

is equivalent to the web page that php sends to python to visit? The contents of
php can be stored in redis. Scrapy inherits a RedisSpider class to obtain distributed crawling data from redis. You can check out

.
Menu