(unfaithful person) Crawler problem: how to generate automatically generated srand characters in url? Neither the package nor the source code can find the generation method. - Codes Helper - Programming Question Answer

(unfaithful person) Crawler problem: how to generate automatically generated srand characters in url? Neither the package nor the source code can find the generation method.

problem description

the website crawled is http://www.hljcredit.gov.cn/W.

.

Source

                <a href="WebCreditQueryService.do?sxbzxrQgDetail&dsname=hlj&dt=1&icautiouid=1230610007039893636&srandRe=J7137HK1408EJB2JQ9P05UF3949HWD"  style="text-decoration: underline;" target="_blank" title="" style="">

How is the url of

generated? After refreshing the page, the srandRe after this url will change randomly. If you want to access the WebCreditQueryService.do?sxbzxrQgDetail&dsname=hlj&dt=1&icautiouid=1230610007039893636&srandRe=J7137HK1408EJB2JQ9P05UF3949HWD connection, you need to take that random parameter with you, and I wonder how this random number is generated?

because the url is pulled down when the crawler is crawled, but the connection will expire in about 1 minute and cannot be accessed. So I think this random number is used to control your browsing buffer time.

the environmental background of the problems and what methods you have tried

related codes

/ / Please paste the code text below (do not replace the code with pictures)

what result do you expect? What is the error message actually seen?

Apr.07,2021

has said that it is rand, which means that a token, automatically generated by the server will prompt "do not visit and attack maliciously" after it is removed, indicating that it is a protection policy.

if you want to use it next time, I tested it. This srandRe can be generated on the spot, which has nothing to do with the previous id. When you need to use it, grab the srandRe on the list page on the spot and spell it to the corresponding link

.

Previous: Beginner go error cannot use'\ u0000' (type rune) as type string

Next: Why can't token be sent in bogus requests under unknown circumstances? isn't it all provided by browsers when sending requests?

Python3 creates a new BeautifulSoup object in a child thread for a specific web page, but there is no exception in the encoding error, main thread.
as in the title, write a simple function test to generate a soup object from the URL using Python requests and BeautifulSoup, (see the example below). If you call this function directly in the main thread, everything will be fine, but if you call this f...

Web-crawler multithreaded beautifulsoup python

Feb.26,2021
My websocket can only accept data on newly opened pages.
segmentfault dvaws.open().websocketwebsocketws ws.openfetchGETloginsendfetchCOOKIECOOKIEFETCHCOOKIECOOKIE ...

Websocket react.js

Feb.26,2021
Why did spring fail to automatically match fields?
Why did spring fail to automatically match fields? Wechat s front end reads as follows: Java: ...

Webapi spring-mvc spring java

Feb.26,2021
Conflicts between eslint and webstrom formatting
there are some conflicts between eslint rules and webstrom shortcut key formatting for example: <Route path=" list" component={TopicList} >, Under the airbnb specification, there must be a space in front of the of the self-closin...

Webstorm eslint

Feb.26,2021
Using HtmlWebpackPlugin to dynamically inject compiled files, output settings are useless
study online tutorials learn to package projects using webpack, a simple code implementation. the entry file index.html of the interface is as follows: <!DOCTYPE html> <html lang="en"> <head> <meta charset="UTF-8&qu...

Javascript webpack

Feb.26,2021
Webpack package react, error its MIME type ('text/html') is not executable
< H1 > github address < H1 > error will be reported when using npm run dev const path = require( path ); const merge = require( webpack-merge ); const common = require( . webpack.common.js ); dev-server let BundleAnalyzerPlugin = require( ...

React.js webpack

Feb.26,2021
How to use the mobile SPA developed by vue2.0 to call the navigation and calling function of the mobile phone?
want to use vue2.0 to develop a small web application for the company, running on the mobile side. How can the above functions be achieved? ...

Mobile-web vue.js front-end html5 javascript

Feb.26,2021
How to convert long data to ArrayBuffer 64-bit binary data?
the front and back end communicates with websocket. How does the front end convert long data into ArrayBuffer 64-bit binary data ...

Websocket

Feb.27,2021
React build Times wrong: syntax error: Unexpected token (26:6)
the npm start command runs normally, but the error will be reported when executing with npm run build as follows: syntax error: Unexpected token (Unexpected token (26:6) my index.js: import React, { Component } from react ; import ReactDOM from...

Webpack react.js javascript

Feb.27,2021
Global URL,dev.env.js in vue-cli
how to set the global URL here, you can use both in the development environment and online. ...

Html5 webpack

Feb.27,2021
Java: the front and rear ends are separated and the back-end (tomcat), is run with IDEA. How are the front-end pages deployed during the development phase?
for testing and production deployment, just throw the front-end page to nginx but at the time of development, how do you deploy the front-end page? ...

Web intellij-idea tomcat java

Feb.27,2021
Onload fails completely in safari
$(document).ready(function(){ $(".pageloading").show(); $(window).on("load", function() { $(".pageloading").fadeOut(); }); }); google chrome can, will $( ".pageloading "). FadeOut (); but the safari networ...

Safari-display-web-page-is-not-normal html5 css3 safari jquery

Feb.27,2021
Projects built with vue-cli always report errors when introducing static third-party plug-ins, and the path should be correct. Index.js has not changed.
...

Vue.js webpack vue-cli

Feb.27,2021
The problem of weblogic receiving message parsing message?
Today, the application receives the message in the production environment and reports an error in the parser, and then the weblogic console cannot log in, but the service of the background application is still there and can still receive the message. Th...

Weblogic message

Feb.27,2021
After vue-router lazily loads the configuration, the page becomes a blank page for solution and guidance.
after vue-router lazy loading configuration, the page becomes blank this problem does not occur when lazy loading is not configured, when configuring lazy loading *const product = resolve => { require.ensure([ . pages product.vue ], () =>...

Webpack vue-router

Feb.27,2021
How to keep the document stream from moving when using transform:scale
as shown in the figure above, use css to make a magnification effect when a mouse passes over a square, but as soon as you enlarge a square, the square next to it will be squeezed out or squeezed into the next row. Is there any way to fix the enlarge...

Html css css3 web front-end

Feb.27,2021
Require fs module in the project, using webpack, but always reporting errors?
require the fs module in the front-end project, but keep reporting errors? fs.readFileSync is not a function introduce code var fs = require( fs ); fs.readFileSync( index.html , utf8 ); this is the webpack configuration file const path = re...

Angularjs webpack

Feb.27,2021
How do I use webpack-dev-server proxyTable.bypass?
there is a bypass Filter in proxyTable. How do I use it? Is it the return path? Or return true false ...

Webpack front-end

Feb.27,2021
Report to babel of undefined after webpack4.1 configuration is completed
webpack project upgrade version configuration is as follows: webpack.json "scripts": { "dev": "webpack --mode development", "build": "webpack --mode production", "watch": &quo...

Node.js webpack javascript

Feb.27,2021
Webpack4 can't use dynamic import?
according to the demo in ...

Webpack

Feb.27,2021

Menu