How does the reptile's useragent see through the reptile?

that is, what can the server see through the useragent in header

Mar.21,2021

  • UserAgent refers to the browser, whose information includes hardware platform, system software, application software and users' personal preferences. The browser name, browser version number, rendering engine and operating system can be analyzed by UA. Use the method to open it directly and view it, or you can copy the UA of other browsers for analysis.

for example:

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/65.0.3325.181 Safari/537.36

means:

    Chrome
    65.0.3325.181
    WebKit 537.36
    Linux x86_64
    The
  • server can check whether the UserAgent is empty or whether it is normal and reasonable to determine whether the other party is a crawler.
  • of course, there are also many crawlers who fake UserAgent to evade the server's anti-crawler check.

if you ask many times in a short time, people will see exactly the same user-agent
is definitely a non-human operation, so you can see that you are a crawler

Menu