问题
I am creating a web scraper for different news outlets, for Nytimes and the Guardian it was easy since they have their own API.
Now, I want to scrape results from this newspaper GulfTimes.com. They do not provide an advanced search in their website, so I resorted to Google news. However, Google news Api has been deprecated. What i want is to retrieve the number of results from an advanced search like keyword = "Egypt" and begin_date="10/02/2011" and end_date="10/05/2011".
This is feasible in the Google News UI just by putting the source as "Gulf Times" and the corresponding query and date and simply counting manually the number of results but when I try to do this using python, I get a 403 error which is understandable.
Any idea on how I would do this? Or is there another service besides Google news that would allow me to do this? Keeping in mind that I would issue almost 500 requests at once.
import json
import urllib2
import cookielib
import re
from bs4 import BeautifulSoup
def run():
Query = "Egypt"
Month = "3"
FromDay = "2"
ToDay = "4"
Year = "13"
url='https://www.google.com/search?pz=1&cf=all&ned=us&hl=en&tbm=nws&gl=us&as_q='+Query+'&as_occt=any&as_drrb=b&as_mindate='+Month+'%2F'+FromDay+'%2F'+Year+'&as_maxdate='+Month+'%2F'+ToDay+'%2F'+Year+'&tbs=cdr%3A1%2Ccd_min%3A3%2F1%2F13%2Ccd_max%3A3%2F2%2F13&as_nsrc=Gulf%20Times&authuser=0'
cj = cookielib.CookieJar()
opener = urllib2.build_opener(urllib2.HTTPCookieProcessor(cj))
request = urllib2.Request(url)
response = opener.open(request)
htmlFile = BeautifulSoup(response)
print htmlFile
run()
回答1:
You can use awesome requests library:
import requests
URL = 'https://www.google.com/search?pz=1&cf=all&ned=us&hl=en&tbm=nws&gl=us&as_q={query}&as_occt=any&as_drrb=b&as_mindate={month}%2F%{from_day}%2F{year}&as_maxdate={month}%2F{to_day}%2F{year}&tbs=cdr%3A1%2Ccd_min%3A3%2F1%2F13%2Ccd_max%3A3%2F2%2F13&as_nsrc=Gulf%20Times&authuser=0'
def run(**params):
response = requests.get(URL.format(**params))
print response.content, response.status_code
run(query="Egypt", month=3, from_day=2, to_day=2, year=13)
And you'll get status_code=200.
And, btw, take a look at scrapy project. Nothing makes web-scraping more simple than this tool.
回答2:
hi you can scrap like this with easy way
from bs4 import BeautifulSoup
import requests
url="https://news.google.co.in/"
code=requests.get(url)
soup=BeautifulSoup(code.text,'html5lib')
for title in soup.find_all('span',class_="titletext"):
print title.text
回答3:
Disclosure: I work at SerpApi.
You can use google-search-results package to extract data from Google News. Check a demo at Repl.it.
from serpapi.google_search_results import GoogleSearchResults
month = 4
from_day = 2
to_day = 3
year = 2020
params = {
"engine": "google",
"q": "Trump",
"google_domain": "google.com",
"tbm": "nws",
"tbs": f"cdr:1,cd_min:{month}/{from_day}/{year},cd_max:{month}/{to_day}/{year}",
}
client = GoogleSearchResults(params)
data = client.get_dict()
print("News results")
for result in data['news_results']:
print(f"""
Title: {result['title']}
Snippet: {result['snippet']}
Date: {result['date']}
""")
Part of JSON response
{
"news_results": [
{
"position": 1,
"title": "Trump Promotes Oil Deal That May Not Exist",
"link": "https://www.nytimes.com/2020/04/02/us/politics/trump-russia-saudi-arabia-oil.html",
"source": "The New York Times",
"date": "15 hours ago",
"snippet": "WASHINGTON — When oil prices crashed in early March after a dispute between \nRussia and Saudi Arabia, President Trump put a positive spin on the news.",
"thumbnail": "data:image/jpeg;base64,/9j/4AAQSkZJRgABAQAAAQABAAD/2wCEAAkGBwgHBgkIBwgKCgkLDRYPDQwMDRsUFRAWIB0iIiAdHx8kKDQsJCYxJx8fLT0tMTU3Ojo6Iys/RD84QzQ5OjcBCgoKDQwNGg8PGjclHyU3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3N//AABEIAHAAcAMBIgACEQEDEQH/xAAbAAACAwEBAQAAAAAAAAAAAAACBAEDBQAGB//EADkQAAIBAwMCAgcHAwMFAAAAAAECAwAEEQUSITFBE1EGFCJhcYGhIzJSkbHB8EJi0STh8RUlc5Ky/8QAGQEAAwEBAQAAAAAAAAAAAAAAAQIDAAQF/8QAJBEAAgICAgEEAwEAAAAAAAAAAAECEQMxEiFhIjJBcRMUUQT/2gAMAwEAAhEDEQA/APQZrs1FdQMFmuzQ1NYxOa6ozXZrGJzU0GakGsYMVmaneXttcTRWMIlIGGBAJQ7N2Rkj49xxWiDzXmrmeSyuLm5VHQ3MjeMWPQeHIqlSRjqVqWS+iuOjas7i4kuZY5oyvh/ezjjIU9vjTlYujSFfU4AHdhFIJpyCBId2fL4D5VsE0cbuIMiXLoKoNRmozVCZXu4rkBkuLeMNtDyqp4zkE/8ANTaqkl/aLIPZ8dAeSMDPP899DaKraoix7huvSACxJGHP7CpzltFIxuidrR3VyjS71SZlTgcAUeaqfaLq6Ef3fHfjy5oqMPagSXbDzXZoM1O6mBQVdmhzXZrGoLNZnpHPD6nHH9puEyF/axyTwR8q0qw/SWHfCrbAd0iDt7Q+NJNdDwNXTpFeyg2tkrEoIxjB8qYzSWmR+FaKgXAwpHH9o/fNNZpo6Fkuwia7NBmozRBQenH/ALnZ8Z+3Tj5/5xQ2B8XVYg3s7rs57f1mrNH51ez/APMP3odKO7WYNx63Lcn4moT3L6KR0vspO1Z7jbwDO5+v+1EKqJzLMfOZ/wD6NGDVYe1Cy9zDrs0OaquJ0t4zJKWCDrtUt+lMKXg1xNVI4dVYZAI4yCD9aLdWCWA0lr7AabAGQSBn4Rs44I5/n6cUzmkdYvYo444wwLKjZDJuHUH9x8KSY0B62bdYWj/igUjNFmlNMmSbTrXaW3LEobI70zmmjoD2FmoqM11MKXaIc6zZ8gfa/sap0mdY9VtZCQwM7HOe3tV1raahaahbS3NtcIqYdpFKdSMYA56Zqq0tXs3QzKRJGzFRIMgZ6Hp86455U7f9R0xxtIC3lNyGZAAzSPgDtliRVgZWAMbBlIBB88jNV2Jit7k7LNlDOJHwxyPyX8h76suptHsxm59ZRRGGHO7HTphcnyorPQHisqZJBsnEhILlNm7jpnPSmtP2tqNsG6AnP/qaIXGjPM1kst140D5IKHqV8yvPHarbdtOt7iKX1iQlcsv2Z5GDk0HlTi09jLH6k1ozrUgQJtGOO5zVu6m4bbTjENk0y49nlDwfmBQvaRIrO12oVfvExkAdutWjmjSRKWKVi+6srUkjlMu5efCkI575H+DW3Hbwypviu0dcE5VSaSvNMWRrzbKsuy23AFMEE7s/tyaznF6NGLWxfQxssI1AA9kdD8a0M+dJ6ZYRLpsSreIgfcikRkZIdunHOc+Qrli8CKHbcqY2HsuiDDdjkEKRgg9aX88V0N+Fy7G6lQzZ2jOBk1mxslqrCe5IAY75dg9nJyM4z2opL6B7O4a3aVWO0hw/OSyAED41v2F/DPC72D/1yNrsK9/FdQycFI0IKDuT5cE9vKgSW4utQmiudPi9XZmXxRexDCjOMKoBweOM8ce+lvR+wk1OKeDSnsnkYF5XgeQnAI4G9iBzwcYqr0djhmvNVub26lfw5iYo0vmZQpJzkA+ycdj07dKg4pX4K23QxZsZZ3nayZX8OUHOooeNhP3gxHu6cU5ckSQNNFC/hNIyLHJMsgbBU7h5DDHjHGKWktrYpKInY24WXHizEhxsbGcnJ49/1zSzLNNokzxqvqVtGEQRgDazMuSSGJJbA6/CsldMEurQxpuoetPuubFTvGCWtwwLFRkjGPLp/itZ5HPhKumSAlXxi3PsnL/3cZ+fWvnaWM1pNEbm3CCaEug38KNp94/hrY1e60+2uLeC5hBURlVYTOnshiM8HmnlBX0LGTrs9NeanYxmQyeGwWZ42BIwGGPNh5j+c0T61p3gB9kAU7Sc8A5Ix/V8O9ZWi6MdS9G31S0toEhspXlEcztuO1Q2c8/XyrN0y/F5Be3VnZCJ5ZzkFva3nbn4cbfzNLxG5Weng1q0MrpH6rsMRkLRl9wHTz4599W6g0Nw+oBfV1PhiMbpNvtYIyCD15qzStMt5DcH1xEeaHw9nhocAg8DD9uaG20W9uEuJ5U8XxIxiTwUAbK54PxJ6eRqfJWPx6FNMu4LfTI5XjV5IpZsM8m053DsG4PPcU0ZbKSVVNrJ/ptyxuZJB97k5y/6/SlvRvSJLiyjhumddrS+xJFkqVdeCDz5dfKnzoVvPctJHqWGUEKPCwBkEcH/AH7Clco2MouhGbUNMBgPhKwJEvM7DaQTyCW56VVI+nxxwv6ozOeV/wBW56MrDksc8kf8VoXvozb30UsEl4GLIVXcudu4seBtPalL70ItvAif1iGFIQWZ2jfGNiqT90fgBNFSg/kVxkZ3o/f6PpeRHZRbhE0SoL0nG7rnk8ZAHmP1us5NKjaWT1J4ZbhQZgJ9xxnqeeOp7diPdWPF6RXLAeKYZPcyFfqOKZj1vw1GzTzhORs2Mq/SrvFNCLJA2pbHSbi1KSWzpERyvPGewwf0qbPRLCCD1G3t5VSR/us7AsQRjHn93+ZrFb00Yn7SzLKOxI7fOmIPSnT32hrcxkdeAM/lSPHkSGU4N7NqbQFuVjjaGdNqbFCufu4xVR9G0uoUM9tcOrdAVDdyeo95NUwa5ZOwaOYLweFmGT+eKjCTQReFeXcLqDnwnG089MHjvU/UvBT0/Bpadp9vHHe2fgu03iAABSojBVT2FFa+jVvbWi28do6RgkkBwM5x/gVjW8F2s05N1cRgkBZDLkvjv7qaPrqrtivrgt+Itk/pQryZLwOXmgSmEpaRKjbQoLYOBu3EcnnPPXz71NjY6pZwmBZZmTHC+IvsjGAMA4I+I7Vmlr9CFfVroN+HeB9MUtcXuoWUsPi6ndESNt++PgO3T2vpRp0A9HC+uAmSSGBHcHdsjQ8nqcgjyFUZ1JWdJtIhmUYw+1Pa8xjcPdWHcX17YD1q41q8kjbI8Pcu08E8YAPbzpiW4v4QGfV7yVRknIHUeWBQ4BUjRmknDFW9HVZdwBeOJeB8N5z5dKsT0gtdy2cUKSyNkPBGsoIbGdpGeuOeprOt9R1GVNyajOTkqctkcHy69K8rpTrbelq2iXl3LdWQcRtOoaKEFPLduJwcZyPnTRxJpiym10YK26/jP5VbFH4bbkZw3mDijAo1UsQAMk16TbODiMx3QbC3UQnXuTw351dc6SHiFxZEyRNnK4wwx1+Pw/WjttJmcbrki3j6ktjOPh2+eKYl1KCziEOnDO3P2h7E8Z95+WPdUm++iqXXZgNCR1FQjPE2Y2ZD5qauZ/PgeVVN76oTHIdZv4eFuGYf3AGm4fSOVT9rCjeZHFY4GTUOoFI8cX8Dqclpnp4fSOE9WeM+8E4rRg1RJipV0lI9wzXhgfLiiVipz0NTl/ni9FFnktnujPCWBliiJx/UmQKlrlW2Zdtq5wAOPhXlbTU5YsLI3iL7+v51rxSwzoHTB+hFQlj47LRyXo0knt1fduXd2O0ZFYtpbxQ+ll1f2l2zXXiKJYmjARYmABGc8kAdseVPDlccMPI813gJjIDRnzVyPpWUXG6ZnJOrP//Z"
},
{
"position": 2,
"title": "Trump’s Oil Summit",
"link": "https://www.wsj.com/articles/trumps-oil-summit-11585870063",
"source": "Wall Street Journal",
"date": "Opinion · 16 hours ago",
"snippet": "Trump's Oil Summit. Tariffs and quotas won't solve a price shock caused by \na pandemic and a Saudi Arabia-Russia feud.",
"thumbnail": "data:image/jpeg;base64,/9j/4AAQSkZJRgABAQAAAQABAAD/2wCEAAkGBwgHBgkIBwgKCgkLDRYPDQwMDRsUFRAWIB0iIiAdHx8kKDQsJCYxJx8fLT0tMTU3Ojo6Iys/RD84QzQ5OjcBCgoKDQwNGg8PGjclHyU3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3Nzc3N//AABEIAHAAcAMBIgACEQEDEQH/xAAbAAACAwEBAQAAAAAAAAAAAAAFBgIDBAABB//EADwQAAIBAgQEBAQDBgQHAAAAAAECAwQRAAUSIRMxQVEGFCJhMnGBkRWhwSNCYrHR8AczUnIWJEOCksLx/8QAFwEBAQEBAAAAAAAAAAAAAAAAAQACA//EABsRAQEBAAMBAQAAAAAAAAAAAAARARIhMQJB/9oADAMBAAIRAxEAPwD6D5od8d5od8LhrnFzwGAHMkMAMQ/EVbkQD21Y6RjkZ/NjvjvNjvhX/EQote56bnHLX3Nhc/fbBFyNHmx3x55sd8LXnxe1unOxxIZgLkaVuO5OKGmI1gHM48NYvfC2a1msQm9+g2v98ctedyFW/wDffFFTEa1e+ImsXvhefMZBv6ee22I/ibG3+Xb5YYqYfODvj0VgPXC9HXTyH9nHxL/6UvjmrqiPd4tIvsShF8UVMRq8eecthc/FJL3Gj/xx34lIbn0bew3xQUM/FJGGmoaVkYbgn9MZDVq8hKoyL2AH6Yr/ABN29DcOMhbEsL7jEC8czsFlJcdNgB/L3xnN1uDNJX5dDpNTTs3oKMqoLX6G5N7/AGwQgnDU0tXFQxmmQCyFbE/I2sR074TJaqT1IugyH0kagpwZ8K5rRxSSUOZUkEhkY6ZJUBZTt6QencYtDf52krxIIUSjqNV0JbUjDse2LJJVpL64lnQp6nRijD2K3sR8sbsxqkXJ5VzGninKORGEI1AX9NiLHlhPZppuH+ySMhdClYwmr3Nhv/PBm07gtFmtBxCy0ztp3ALkaflY4spp5a1mWkyiKVxc3jVyR731YBxJX08qrxkAJuVJsW/LF5qmp0kVJJIw5P8AlOwKnocOgWkgzNxpny6oijvsI4Dt9Tc48EVQhI4FULc2aK1/qbYDjMswiW8ecZip6ASE/wDsMd/xLnEABGeZhb+NT+pwcjBWTNayL0LVSxBeSgm1vvjNHWLMAauq1Mp2BJwKq8xmrv21TUNPUNYPIR8VuX1A264z8YsGuEH/AG2wclBmpqYQf2DHbnpJP64pNdJyWWSw5nUcCjMEU2sT3vj2Nysd99Xflg5iNUVDmVPKkcqnWtpHMMq3VDz33F9j3xjzLNIpagcGReEi+lCyltxvdlAuet7Ypr5Wq3RvPz1U5XRYRgbdrDE6fJ5WhZi/D4al3GqzqAR0G/XGj0jPPTzMDFI5QOdJDX1e9jjx5NUgIgYs3UkEfYAYI+HqChrM2jpZ0ldTHqIBtc+9t/zwxZ14cy4LTxUkb0c88iosjs7La1zccumBFV55JUtNGrlb7am3vzOLKGameVVqF4aNaxRltfcerbbnzwczTwlHRUUlTBmKvwoyxHB59ed8VeH3oM9pFyqsPlqlDeGWNlXXZTckkcu+LdUTyPL8urKiaCtM9BMgW+4fUTz08tvvzGCld4RqKfMkYmonysKXaUaEaMAH08zfpvbrhZcmgn/Cs9MLCL4JYZQeHcA3jJ5juuD+V+JTlwY5rHDVUlRtTzmPWrr17WPK4ti2/ixPO8xymjoFp6KAO7LotIQxC22Y+nGHL6jIIMsiFZTu0oFme8huepFjbDO1HltZV0telFliRiNrw+XsH1WsSO4sfvhfzbLVzjMpFyyOgy5aX0TDQY0nJAIIAB6dcWeGlII0gfnYG5B6DEo42ndI6aMySuQEWIamY9rdcHqbN6rwjUyUCTRF5DxbRNcNcAczbtyONOUx5XnLvmddVy0WY8dnUwIlwLW3B59emCKlvMcszGhVTmFJUQg/C0sLJq68zjIZkfb32uvI+/2wU8U1eZ5lUPRrO9ZRU8t45IodybWuQpOnmR2wutI8eqCfVvtvsRjO4c0xJVMhMNKrU7auUUVtQ5/Fa/8A9x5JrosulErK1TWMEUI3wx3BYmxtcmw788VzVMcczHy4ZpLk3Omxv8Vha+MubRtBV07zcFQItQCltWw/eDAEewxvWTX/AIdI8smZzCpjhRnWPSWsTYG1vbfBXxq/lMhaVKy7RyI2kN8N2tsw5c8Cv8O0olyVpiHWoeUiQg6gLctuXXF3jURHIKplkNlKH1AC5DC3tg7xNOUeIMubLIlqqqnMmgCTiShWv9d8DfEOV1r+IKdcpoTE81KXUw2UmxsWX3sV++FPwhDSVniCmjrxeE6i66Qxb0k9flh2zSWgop6mvhqCtRSuBCmpUXSbAhl69d7i1sG/W5vjWZk9dSVMHiemkyfxDLUU80UqiFEdAzELYn1i/cWPaxwr66rJKqfL62JJaZnKvTzuo4libMN9m7MMTz/MZJswpsxyuNxMoYysiEqG2G/QE7jF/iHManxBRUMrUJR/+o76VcDppc2Jt0+uD525V9ZNi2kq6jLKiDMsrrp6rKIJLzJ8bwfwsttxuNxtthwj/wASKOoVYxpl4g+FaV2v9MfPMriraCokq8vnSSWJdLmJhpYWvaQWPpsD/UYIRwy5nl7yeHZjR1aAmoy9ban90PUe3689Aa8KZtPlC1xqpLvNOX1yJqUKQLC9th8u+AXjTNqXM83jYS0BjWLS+hlW7XOxsb8rYVhR0zsyVhmSbkryLqCt11at7c+WBrQ1CMOF6gdgUFsIOuT5/FkkTpAWdHN2VRa23IH977DA/wAQ+IYM6lWcxVCtHHpR2ZQSb9d9xy6X98A48tq9N6qRIiOSu1z9hc42JRU6MwEQYKbB7c8FMMeV0yvMwyqj1zL6WaMiw/3S7Af7VF/fBVvAivSmoq8x4MlmLXW8Sg89ybn54bad4qeDg0FGVMYtplXhpF8zy+18LufeK6LK40aomSqmINxpvGD10r13tucHiLGZ5PmfhhWmgrtMDEC8MlrnkLg/0OANdV1lSAKqolmW97O2oX/kPoMbJ86zDPJalpyI6aYC/E7A3H9du2MJWKmE0SMsrfvWXe3TFTEopSra+FAL2N9JFvpvi+Od1eSVZOGDcDSbW+uMrUjpCk2rZ+QCnYDqcVVFLOrBZgy3ANmBHTbbCH0TwjlMXjHKGhnzZ1elbQ0QXU2jmLm4uLjt+mF3xdkP/DmZ+VqV1RSeunqNNhIvXlyI6j+uB/h2trshzTzmXVMUcwQqVYEhge4/vlhhnzWs8VwimzeoSQQHilQyoLgG5ACagLe/XDAV6rMEgWnqssjNLURsSZ4JGJ1dOZIt7YL0GYUOYJLXxJJT5lSoJHp6aVYlcD4pEuDb3XFGYRHK5SsNJQrGwJDeqVuZG4ZiAdjtbGbLc+lo6svIbIo9McUKxgnsQtrjn98FUMOYy02bq088UBr0UcRKdyZFW9gzmwHbpt9sLU3ladCJKmNSSdi4GGgx/jdJFnfhpzHW0kaJU0RILxAC3psPUtvbe3e4wInpaXOG4lHHFTZkd3praVm/ijPf+E/TliXgJ5uMSqqjiA82juw+d+WNBkvt07DGdw0bskilWU2KkWsceasI3aavEfjCvrKhqekQyyQNqlDxmKGNehbURve3M9MKU1JX18zVFVLHUSE81mQgDsAG2HsMCpamsaGOnnmmlp4/gTiEhfocQpn1kojR3tcBhzPbfrjEbzR3yVYJFeanWKIDeaS6RqP4jyH5XxfPPWPIdVAauFUsjwxF4zfe4Zdjb8sL0wZWN0RSTcAAbYtin8usa00syAoOKGAsHueXta2HMVhhfNs4MFPQNS1FPShwVhMRVXe/xam3v9bDpbFFVFm1bVI06mbc3eKVZAlzvqYGwPXc4ENmdbLxFWoqFjOzIkr6bH2v79cFPC+S1NbLLUQTRU0cC+qSQXFiOVh7b/bEkxl88iyJA8c0kak8KOeN2I62AJOMsAnUniMVHIdTgwVyCiqvM1HiBpatGDWpYtNiPnf+e+IPnuRoztR5XLUhr6zIDz7jUdsFUwO9BlSKsqzBEWGplQMVHQ6bjV98SzCGmlqoosqfjpwlszLZ3Y9CovY/0xsk8QVcbFKXK6OnZVDDcMdNr9Ljl0xRP4nziSjWFHRUjHwRIBq9+XQYuzMM/hLK6qgzapkpKadWEKiCtltaMlRrBW4DDUeRF9h156PE+X0cqrXtUQQV5sZ4IZBuw/eUqPr0P6K2S1VNWuj5vUzzrL+xMUkrDhuSLPsRcbG3Q7jGiLw5Q1HiNKRs2jjpJCwSd11nUDstr7A9z8sams7uWNbRxZ8P+YkhhrD6YKgAqs9h8Dk8n/n74X62lnoah4KhSrrzwazLIKrwpmklJXRNU01YoSGoRSsR3FywB2K87c+2NcZpayiFBmgeOK5FNXNCVZN7APcDUpPJ/wAwcQhBJxE6SLWFjzxG98dfAEo5XhXSpdkO2kWNvlfHQxS1AbgAtbmGFrfU7fniN8RIazBXYBviAOzfMYjRbXFBTChkh4cgIPFdQNQ3323t2+mG7KkgpfBSGN7GqJZmC7n1G9uXRR98fOkEkaaI5To/0MNS/Y7Y+g+DqalzTIK6SSiiEtOuhTe9/Te/3B2+mCNUpUUdFxRBUVCU0e5eURl9O3YbnfHLKuqXy8wdFHMfvC/O3TvjFMF4sqr8Gvlaw29rn+/tiKgKbrsR1GGM1qaRiUcOV0kWN+R98e+ZdKg641ViRdlxRT1DU6ujRCaNt7X3B/XE+PSCGP8AZTNIZLyq0Oyr7MJN/sPyxHBSZS7pLHrifk+gE3H0/v8APEGqPJvFJTwhXVSole+mx5owFtj2PfAd5X4jeXV0jvdQz2P2AOI8Wqv6XVQOlzy7dMWYt2nnMfHEs/h4ZXUQRywstmM6F2W3JQwYcjuG58vqs1OeZhKlCxZf+Uplp0G+hkW+5UmxJvvgaaio06ZArqeg3t9CcTR4HYIYmueRjNifof0xrexnT//Z"
}
]
}
Output
News results
Title: Trump Promotes Oil Deal That May Not Exist
Snippet: WASHINGTON — When oil prices crashed in early March after a dispute between
Russia and Saudi Arabia, President Trump put a positive spin on the news.
Date: 15 hours ago
Title: Trump’s Oil Summit
Snippet: Trump's Oil Summit. Tariffs and quotas won't solve a price shock caused by
a pandemic and a Saudi Arabia-Russia feud.
Date: Opinion · 16 hours ago
Title: OPEC and allies reportedly set for video meeting as analysts pour
skepticism on Trump's intervention
Snippet: “Donald Trump's tweet … It's nonsense, really,” Patrick Armstrong, chief
investment officer at Plurimi Investment Managers, told CNBC's “Squawk Box
Europe” on ...
Date: 5 hours ago
Title: Trump again tests negative for coronavirus
Snippet: President Donald Trump on Thursday again tested negative for the
coronavirus after being tested by the White House physician, according to
two White House ...
Date: 17 hours ago
Title: Trump passes the buck as deadly ventilator shortage looms
Snippet: (CNN) President Donald Trump is pinning the blame on states for a shortage
of ventilators that governors warn could effectively condemn coronavirus
patients to ...
Date: 10 hours ago
If you want more information, check out SerpApi documentation or live playground.
来源：https://stackoverflow.com/questions/15550655/web-scraping-google-news-with-python