Php curl cannot crawl content properly - Codes Helper - Programming Question Answer

Php curl cannot crawl content properly

function echo_var_dump($obj){
    echo "";
    echo var_dump($obj);
    echo " ";
}

Function GetCurl ($url) {

/ / curl forges useragent
$useragent = array (
"Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0)",
"Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2)",
"Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)",
"Mozilla/5.0 (Windows; U; Windows NT 5.2) Gecko/2008070208 Firefox/3.0.1",
"Opera/9.27 (Windows NT 5.2; U; zh-cn)",
"Opera/8.0 (Macintosh; PPC Mac OS X; U; en)",
"Mozilla/5.0 (Windows; U; Windows NT 5.2) AppleWebKit/525.13 (KHTML, like Gecko) Chrome/0.2.149.27 Safari/525.13",
"Mozilla/5.0 (Windows; U; Windows NT 5.2) AppleWebKit/525.13 (KHTML, like Gecko) Version/3.1 Safari/525.13"
);

$curl = curl_init ();
Curl_setopt ($curl, CURLOPT_HTTP_VERSION, CURL_HTTP_VERSION_1_0);
Curl_setopt ($curl, CURLOPT_RETURNTRANSFER, 1);
Curl_setopt ($curl, CURLOPT_URL, $url);

/ / set iP and useragent
Curl_setopt ($curl, CURLOPT_REFERER, "http://h5.eqxiu.com/s/Rwg9jFlv");
Curl_setopt ($curl, CURLOPT_USERAGENT, array_rand ($useragent));)

$resp = curl_exec ($curl);
Curl_close ($curl);
Return $resp;
}

$url = "http://s1.eqxiu.com/eqs/page/119805007?code=Rwg9jFlv&time=1523150497000";
$page_data = GetCurl ($url);
$page_arr = json_decode ($page_data, true);

Echo_var_dump ($page_arr);

I have set up REFERER, but the content is still incorrect. Visit the first link below to get the json content of the second link normally, and my program gets the prompt "data is illegal".

http://h5.eqxiu.com/s/Rwg9jFlv
http://s1.eqxiu.com/eqs/page/.

Mar.21,2021

//
curl_setopt($curl, CURLOPT_ENCODING, "gzip"); 
curl_setopt($curl, CURLOPT_HTTPHEADER, ['Origin: http://h5.eqxiu.com']);

look at the illegal data. Where is the error reported? Does
need to construct cookie??

array_rand returns the array key, not value,userAgent is critical. After fix, take a look at

the browser can get it, and you set the ua header to output the obtained data. It should be a problem with your processor

.

Previous: How do I get the number of rows in the textarea input box?

Next: Coding page domain name resolution problem

How php curl, gives undefined instead of null?
when I curl request to the counterparty $data = array( "a" => $a, "b" => $b ); $data_string = json_encode($data); assume that my value to the counterparty is valuable that the receipt will be null can it be tran...

Null undefined node.js curl php

Mar.02,2021
Give me a thousand statistics through curl json, how can I divide the front end?
Suppose I send me a thousand statistics directly via curl, via json , but it doesn t seem right to show a thousand dollars at a time. How to achieve a 20-year-old through php? Is there anything you can refer to? Blah, blah, blah! not at all function ...

Json curl php7 php foreach

Mar.02,2021
How does php CURL get 500 errors returned by the opposite party?
I am using curl to ask when the error is 500, for example, how can I catch the information he spits out here with me? because if there are no errors, the counterpart can send me a reply to json and receive it, it can show , but it will send back 5...

Php7 curl php json_encode json

Mar.03,2021
How to speed up using php curl?
I use php curl to interact with the data database of the counterparty curl I use the Google browser to see an item running for at least 3 seconds I wonder if it s a curl problem because I think all the others are ms units. It s not too slow....

Php7.1 curl php7 php

Mar.03,2021
How can I get the first number of json data obtained by curl?
I use curl to ask my counterparty for json data. the data given to me by the opposite party is 20 years old how can I get the first number of the opposite party? do I want to set it up this time, or do I want to do it on the right side? ...

Curl php7 php

Mar.03,2021
When initiating batch requests, can curl_multi_ Exec` end all requests when the first request is obtained?
curl_multi_exec you can initiate batch requests. For example, I initiate 10 requests at the same time, and when I receive the first request, all requests are terminated, regardless of whether the subsequent requests are successful or not. ...

Curl php

Mar.04,2021
How can I know when I use php to show the status of the opposite server 502404500?
the counterparty uses the nginx ubuntu server I use curl to communicate with him I would like to say how to make a php interview after entering this interview, I can find out the current server status of the counterparty but how can I write this co...

Nginx php7 curl php jquery

Mar.04,2021
How to print data through curl?
my mysql database has two pieces of data when I print_r, it looks like this: [{"errno":"1","errstr":"2","errfile":"3","errline":"4"},{"errno":"12",...

Php mysql mysqli curl php7

Mar.04,2021
Does php compare the square value through curl? The opposite party also uses curl
should mean I have written an api I want to list all the data of a certain table and then let the counterparty access but through php curl . what am I supposed to do? what should I do with the other side? I am stuck in array because my company ...

Array curl php7 php

Mar.05,2021
If PHP CURL has three figures, how can I write it correctly?
about PHP CURL there are three sets of data returned by default this means that it takes three foreach to implement . Are there any other ways? how else can I get the data of the second dishes-selected or even the third (options)? ...

Json array curl php7 php

Mar.07,2021
About the problem of obtaining web page data remotely by CURL in PHP.
on the problem of CURL remotely fetching web page data in PHP. needs to grab the contents of the dictionary, and the local test can return FALSE when placed on the server. I saw that some related questions were raised before https: codeshelper.com q...

Curl php

Mar.10,2021
Setting up an agent problem when using curl!
Code first public static function curl_get_https($url){ echo $url; $curl = curl_init(); CURL curl_setopt($curl, CURLOPT_URL, $url); curl_setopt($curl, CURLOPT_HEADER, 0); curl_setopt($curl, CURLOPT_RETURNTR...

Proxy-server curl php

Mar.10,2021
The quantity of the commodity is x, and then the total is added.
$dishPrice = 0; $dishAmount = 0; $dishPriceV = 0; $dishPrice = $dish->{ price }; $dishAmount = $dish->{ amount }; $dishPriceV += $dishPrice * $dishAmount; print out each box $dishPriceV he will add the above , for exam...

Php7 curl php

Mar.11,2021
Problems with the interface of the network card used in curl_setopt setup
added code to the original curl curl_setopt($ch, CURLOPT_INTERFACE, "ppp0"); but it s strange that you can see the result of calling when you run the command php test.php on the server, but remote access to this address, such as http: ...

Curl php

Mar.12,2021
What is the difference in the way php curl and browsers access scripts?
what is the difference between the way php curl and browsers access scripts? now requests to an api can correctly return a value by accessing the script in a browser, while sending a post with php-curl returns an error saying that the value of content-...

Nginx php-curl php

Mar.13,2021
Call the google fcm HTTP v1 API to send a group push to Android devices and receive a 411 error.
call the google fcm HTTP v1 API to send a group push to Android devices and receive 411. Http header does not have a content-length error, but I specified content-length in curl. $topic = topic ; $projectId = projectid ; $title = ha...

Gcm post php-curl php

Mar.13,2021
How does Ali Cloud win 2018 R2 php7.2+apache2.4 use curl extensions?
for example, I cannot load curl extensions according to various configurations on the Internet there is no curl information in phpinfo ask for help ...

Apache curl php

Mar.15,2021
Problems with using agents in PHP CURL
has been implementing a feature recently. Use php curl to submit data to post to query a station to query the order page (because the function of the station is not open to api, so I want to use curl to simulate the form to submit the query). After writi...

Proxy-server curl php-curl php

Mar.18,2021
The back-to-back interaction between ajax and curl?
check one of the features I need now is that ajax and curl interact with each other at least five times for example, I ajax-> call.php will call me back and then send it back to me I m going to call another call2.php and give it to me again. I ...

Ajax curl php jquery php7

Mar.20,2021
The interface on which the php curl post request executes one curl_exce request is executed twice.
1, php curl post request interface, print log curl_exce, is executed once, but the requested interface is repeated twice. 2, code: $ch = curl_init (); if(false === $ch){ writeRedisLog( create_curl , $activity_id, $mobile, $user_id, , 0, c...

Curl php

Mar.21,2021

Menu