luzy99 / news-spider Goto Github PK

有办法更改成百度吗

(env) E:\Spider\news-spider>scrapy crawl peopleNews -a kw=关键词 -a site=people.com.cn
2020-12-21 15:28:49 [scrapy.utils.log] INFO: Scrapy 2.1.0 started (bot: news_search)
2020-12-21 15:28:49 [scrapy.utils.log] INFO: Versions: lxml 4.6.1.0, libxml2 2.9.5, cssselect 1.1.0, parsel 1.6.0, w3lib 1.22.0, Twisted 20.3.0, Python 3.7.2 (tags/v3.7.2:9a3ffc0492, Dec 23 2018, 23:09:28) [MSC v.1916 64 bit (AMD64)], pyOpenSSL 19.
1.0 (OpenSSL 1.1.1d 10 Sep 2019), cryptography 2.8, Platform Windows-10-10.0.19041-SP0
2020-12-21 15:28:49 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.selectreactor.SelectReactor
2020-12-21 15:28:49 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'news_search',
'DOWNLOAD_DELAY': 2,
'NEWSPIDER_MODULE': 'news_search.spiders',
'RETRY_TIMES': 5,
'SPIDER_MODULES': ['news_search.spiders'],
'USER_AGENT': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 '
'(KHTML, like Gecko) Chrome/85.0.4183.83 Safari/537.36 '
'Edg/85.0.564.41'}
2020-12-21 15:28:49 [scrapy.extensions.telnet] INFO: Telnet Password: e4a1729bd74d8c8d
2020-12-21 15:28:49 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.logstats.LogStats']
2020-12-21 15:28:49 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2020-12-21 15:28:49 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2020-12-21 15:28:49 [scrapy.middleware] INFO: Enabled item pipelines:
['news_search.pipelines.NewsSitePipeline']
2020-12-21 15:28:49 [scrapy.core.engine] INFO: Spider opened
2020-12-21 15:28:50 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-12-21 15:28:50 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2020-12-21 15:28:50 [scrapy.core.engine] INFO: Closing spider (finished)
2020-12-21 15:28:50 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.004998,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2020, 12, 21, 7, 28, 50, 246491),
'log_count/INFO': 10,
'start_time': datetime.datetime(2020, 12, 21, 7, 28, 50, 241493)}
2020-12-21 15:28:50 [scrapy.core.engine] INFO: Spider closed (finished)