Right click “ View page source code ” and f12 Of Elements Dissimilarity .
If you use it directly urllib.request.urlopen('...') then read() You can only get the web page source code , Original html, Not by js machining , Not what I need Elements.
I checked all day today , I've been trying to , I haven't been able to figure it out .
I can't use xpath Methods , because xpath Skills also need to be found manually , And my need is ： Get a list of web pages from the search page url, And get several paragraphs of text from it , These words are only in Elements Only in the middle . The URLs of these pages are irregular , Out-of-service for i in range Method to obtain .
You can put the original html Save as character content , Then use regular expression matching to get the corresponding content .
