There is a need , Crawl general websites direct requestes.get(url) You can get the response , At present, the problem I encounter is that my target server is very unstable , Sometimes the request will be directly reported 502 Gateway error ( This problem also occurs when the web page is accessed normally ), I got all the addresses I wanted to request , Use an asynchronous method to request one by one , How to make it continue to request after encountering errors , Until the normal data is returned , Instead of not executing the request after encountering an error .