cnblogs scrapy shell response 443

Question

[s] Available Scrapy objects:
[s] scrapy scrapy module (contains scrapy.Request, scrapy.Selector, etc)
[s] crawler <scrapy.crawler.Crawler object at 0x10f2c48b0>
[s] item {}
[s] request <GET https://news.cnblogs.com/n/702424/>
[s] response <200 https://account.cnblogs.com:443/signin?ReturnUrl=https%3A%2F%2Fnews.cnblogs.com%2Fn%2F702424%2F>
[s] settings <scrapy.settings.Settings object at 0x10f2c4a60>
[s] spider <DefaultSpider ‘default’ at 0x10f646190>
[s] Useful shortcuts:
[s] fetch(url[, redirect=True]) Fetch URL and update local objects (by default, redirects are followed)
[s] fetch(req) Fetch a scrapy.Request and update local objects
[s] shelp() Shell help (print this help)
[s] view(response) View response in a browser

有人遇到类似问题吗？怎么解决的，谢谢🙏

Answer 1

bobby 2021-09-17 18:54:11

需要登录之后才能访问，先参考一下模拟登录，可以先看看知乎的模拟登录 然后再回过头来看看这个

• 摩卡星冰乐 #1

  已经登录还是出现这个

Answer 2

bobby 2022-03-31 09:42:09

模拟登录成功了？有没有在settings中设置cookie_enabled？

Answer 3

提问者 朗月清风 2021-09-17 22:50:23

好的，谢谢您