found that a page still cannot get page data after configuring host,U-An in header routinely.
the get command sent is checked through the debugging tool, and there is no difference.
I really can"t find the reason. Is it because I lack that part of knowledge?
ask for help from all the bigwigs
address is as follows:
Target Collection Page
import requests
url_Header = {"Host": "www.realestate.com.au",
"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:59.0) Gecko/20100101 Firefox/59.0"}
url_tar = "https://www.realestate.com.au/property/unit-5-29-stephenson-st-pialba-qld-4655"
r = requests.get(url_tar,headers=url_Header)
if r.status_code == 200:
print(r.text)
else:
print(r.status_code)the error results collected by me are as follows
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<link rel="shortcut icon" href="about:blank">
<script src="https://cdnjs.cloudflare.com/ajax/libs/json3/3.3.2/json3.min.js"></script>
<script src="https://resources.kasadapolyform.io/kpfp.js"></script>
<script src="/149e9513-01fa-4fb0-aad4-566afd725d1b/2d206a39-8ed7-437e-a3be-862e0f06eea3/fingerprint/script/kpf.js?url=/149e9513-01fa-4fb0-aad4-566afd725d1b/2d206a39-8ed7-437e-a3be-862e0f06eea3/fingerprint&token=iqyvb0Jj-vnBK-gLSc-eYbn-qSQoY37FIfzn"></script>
</head>
<body>
</body>
</html> what kind of situation have I not taken into account?
there is no need to consider other xhr content, just need Get Hmtl to highlight the contents of this command.
I just don"t know why I can"t request the same content.
