Crawling Google Earth data from https://kh.google.com Random 403 error

when crawling Google Maps data using scrapy, the url accessed is http://kh.google.com/flatfile., where the question mark is a parameter, and the following 403 errors will occur randomly:

.

the same url, may be downloaded normally after another try, or it may not work. Have you ever encountered a similar thing? Also, by grabbing the package, you can see that clients such as google earth client will post a request like "a href=" https://kh.google.com/geauth" rel= "nofollow noreferrer" > https://kh.google.com/geauth before downloading. Do you know what that means? I"m much obliged!

Jun.21,2021
Menu