How does the scrapy redis crawler get the url returned from redis?

problem description

you need to extract keywords from url to the crawler, so you need to get the url that redis sends to the crawler.

related codes

/ / Please paste the code text below (do not replace the code with pictures)

redis_key = "weibospider:start_urls"

-sharpnames=start_urls.split("q%3D")[1].split("&page")[0]
global  names
url = bytes_to_str(self.data, self.redis_encoding)
names= parse.unquote(str(redis_key).split("q%3D")[1].split("&page")[0])

what result do you expect?

I hope to get the text extracted by url in names.

Oct.24,2021
Menu