程序師世界是廣大編程愛好者互助、分享、學習的平台,程序師世界有你更精彩!
首頁
編程語言
C語言|JAVA編程
Python編程
網頁編程
ASP編程|PHP編程
JSP編程
數據庫知識
MYSQL數據庫|SqlServer數據庫
Oracle數據庫|DB2數據庫
您现在的位置: 程式師世界 >> 編程語言 >  >> 更多編程語言 >> Python

Network request module requests module and urllib module in Python

編輯:Python

requests Module function : Impersonate a browser to send a request .

Use :(requests Module coding process )

- Guide pack import requests

- Appoint url

- Initiate request (get,post)

- Get the data of the response ( page )

- Persistent storage ( Store response data )

Case study : Crawl the page data of Sogou homepage :

# Crawling search dog home page
import requests
url = "http://www.sogou.com"
#step2: Initiate request
response=requests.get(url=url)
#step3: Get response data .text Return response data of string type
page_text = response.text
print(page_text)
#step4: Persistent storage
with open('./sogou.html','w',encoding='utf-8') as fp:
fp.write(page_text)
print(" End of crawling data ")


  1. 上一篇文章:
  2. 下一篇文章:
Copyright © 程式師世界 All Rights Reserved