请稍等 ...
×

采纳答案成功!

向帮助你的同学说点啥吧!感谢那些助人为乐的人

登录抖音失败

同样的代码(更换访问网站域名的链接)登录博客园等网站是成功的;
但是登录抖音网页版失败,返回的报错信息如下:

C:\Users\seven\AppData\Local\Programs\Python\Python310\python.exe “C:/Program Files/JetBrains/PyCharm 2022.3.3/plugins/python/helpers/pydev/pydevd.py” --multiprocess --qt-support=auto --client 127.0.0.1 --port 56580 --file C:\Users\seven\article\main.py
已连接到 pydev 调试器(内部版本号 223.8836.43)2023-03-19 01:17:38 [scrapy.utils.log] INFO: Scrapy 2.8.0 started (bot: article)
2023-03-19 01:17:38 [scrapy.utils.log] INFO: Versions: lxml 4.9.2.0, libxml2 2.9.12, cssselect 1.2.0, parsel 1.7.0, w3lib 2.1.1, Twisted 22.10.0, Python 3.10.10 (tags/v3.10.10:aad5f6a, Feb 7 2023, 17:20:36) [MSC v.1929 64 bit (AMD64)], pyOpenSSL 23.0.0 (OpenSSL 3.0.8 7 Feb 2023), cryptography 39.0.2, Platform Windows-10-10.0.22621-SP0
2023-03-19 01:17:38 [scrapy.crawler] INFO: Overridden settings:
{‘BOT_NAME’: ‘article’,
‘FEED_EXPORT_ENCODING’: ‘utf-8’,
‘NEWSPIDER_MODULE’: ‘article.spiders’,
‘REQUEST_FINGERPRINTER_IMPLEMENTATION’: ‘2.7’,
‘ROBOTSTXT_OBEY’: True,
‘SPIDER_MODULES’: [‘article.spiders’],
‘TWISTED_REACTOR’: ‘twisted.internet.asyncioreactor.AsyncioSelectorReactor’}
2023-03-19 01:17:38 [asyncio] DEBUG: Using selector: SelectSelector
2023-03-19 01:17:38 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2023-03-19 01:17:38 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.windows_events.WindowsSelectorEventLoop
2023-03-19 01:17:38 [scrapy.extensions.telnet] INFO: Telnet Password: 473c98073e70b526
2023-03-19 01:17:38 [scrapy.middleware] INFO: Enabled extensions:
[‘scrapy.extensions.corestats.CoreStats’,
‘scrapy.extensions.telnet.TelnetConsole’,
‘scrapy.extensions.logstats.LogStats’]
2023-03-19 01:17:38 [scrapy.middleware] INFO: Enabled downloader middlewares:
[‘scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware’,
‘scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware’,
‘scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware’,
‘scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware’,
‘scrapy.downloadermiddlewares.useragent.UserAgentMiddleware’,
‘scrapy.downloadermiddlewares.retry.RetryMiddleware’,
‘scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware’,
‘scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware’,
‘scrapy.downloadermiddlewares.redirect.RedirectMiddleware’,
‘scrapy.downloadermiddlewares.cookies.CookiesMiddleware’,
‘scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware’,
‘scrapy.downloadermiddlewares.stats.DownloaderStats’]
2023-03-19 01:17:38 [scrapy.middleware] INFO: Enabled spider middlewares:
[‘scrapy.spidermiddlewares.httperror.HttpErrorMiddleware’,
‘scrapy.spidermiddlewares.offsite.OffsiteMiddleware’,
‘scrapy.spidermiddlewares.referer.RefererMiddleware’,
‘scrapy.spidermiddlewares.urllength.UrlLengthMiddleware’,
‘scrapy.spidermiddlewares.depth.DepthMiddleware’]
2023-03-19 01:17:38 [scrapy.middleware] INFO: Enabled item pipelines:
[]
2023-03-19 01:17:38 [scrapy.core.engine] INFO: Spider opened
2023-03-19 01:17:39 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2023-03-19 01:17:39 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2023-03-19 01:17:39 [undetected_chromedriver.patcher] DEBUG: getting release number from /LATEST_RELEASE
2023-03-19 01:17:40 [undetected_chromedriver.patcher] DEBUG: downloading from https://chromedriver.storage.googleapis.com/111.0.5563.64/chromedriver_win32.zip
2023-03-19 01:17:43 [undetected_chromedriver.patcher] DEBUG: unzipping C:\Users\seven\AppData\Local\Temp\tmp7t2p9h6b
2023-03-19 01:17:43 [undetected_chromedriver.patcher] INFO: patching driver executable C:\Users\seven\appdata\roaming\undetected_chromedriver\undetected_chromedriver.exe
2023-03-19 01:17:43 [undetected_chromedriver.patcher] DEBUG: found block:
b’{window.cdc_adoQpoasnfa76pfcZLmcfl_Array = window.Array;window.cdc_adoQpoasnfa76pfcZLmcfl_Promise = window.Promise;window.cdc_adoQpoasnfa76pfcZLmcfl_Symbol = window.Symbol;}‘
replacing with:
b’{console.log(“undetected chromedriver 1337!”)} '
2023-03-19 01:17:43 [undetected_chromedriver.patcher] DEBUG: patching took us 0.38 seconds
2023-03-19 01:17:43 [uc] DEBUG: created a temporary folder in which the user-data (profile) will be stored during this
session, and added it to chrome startup arguments: --user-data-dir=C:\Users\seven\AppData\Local\Temp\tmpnohqav16
2023-03-19 01:17:43 [uc] DEBUG: did not find a bad exit_type flag
2023-03-19 01:17:44 [selenium.webdriver.common.service] DEBUG: Started executable: C:\Users\seven\appdata\roaming\undetected_chromedriver\undetected_chromedriver.exe in a child process with pid: 20580
2023-03-19 01:17:44 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://localhost:56600/session {“capabilities”: {“firstMatch”: [{}], “alwaysMatch”: {“browserName”: “chrome”, “pageLoadStrategy”: “normal”, “goog:chromeOptions”: {“extensions”: [], “binary”: “C:\Program Files\Google\Chrome\Application\chrome.exe”, “args”: ["–remote-debugging-host=127.0.0.1", “–remote-debugging-port=56599”, “–user-data-dir=C:\Users\seven\AppData\Local\Temp\tmpnohqav16”, “–lang=zh-CN”, “–no-default-browser-check”, “–no-first-run”, “–no-sandbox”, “–test-type”, “–window-size=1920,1080”, “–start-maximized”, “–no-sandbox”, “–log-level=0”], “debuggerAddress”: “127.0.0.1:56599”}}}}
2023-03-19 01:17:44 [urllib3.connectionpool] DEBUG: Starting new HTTP connection (1): localhost:56600
2023-03-19 01:17:45 [urllib3.connectionpool] DEBUG: http://localhost:56600 “POST /session HTTP/1.1” 200 737
2023-03-19 01:17:45 [selenium.webdriver.remote.remote_connection] DEBUG: Remote response: status=200 | data={“value”:{“capabilities”:{“acceptInsecureCerts”:false,“browserName”:“chrome”,“browserVersion”:“111.0.5563.65”,“chrome”:{“chromedriverVersion”:“111.0.5563.64 (c710e93d5b63b7095afe8c2c17df34408078439d-refs/branch-heads/5563@{#995})”},“goog:chromeOptions”:{“debuggerAddress”:“127.0.0.1:56599”},“pageLoadStrategy”:“normal”,“platformName”:"",“proxy”:{},“setWindowRect”:false,“strictFileInteractability”:false,“timeouts”:{“implicit”:0,“pageLoad”:300000,“script”:30000},“unhandledPromptBehavior”:“dismiss and notify”,“webauthn:extension:credBlob”:true,“webauthn:extension:largeBlob”:true,“webauthn:extension:minPinLength”:true,“webauthn:extension:prf”:true,“webauthn:virtualAuthenticators”:true},“sessionId”:“393336fb77f45ba2d8c04e5b0cb5a116”}} | headers=HTTPHeaderDict({‘Content-Length’: ‘737’, ‘Content-Type’: ‘application/json; charset=utf-8’, ‘cache-control’: ‘no-cache’})
2023-03-19 01:17:45 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
2023-03-19 01:17:45 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://localhost:56600/session/393336fb77f45ba2d8c04e5b0cb5a116/url {“url”: “https://www.douyin.com/”}
2023-03-19 01:17:50 [urllib3.connectionpool] DEBUG: http://localhost:56600 “POST /session/393336fb77f45ba2d8c04e5b0cb5a116/url HTTP/1.1” 200 14
2023-03-19 01:17:50 [selenium.webdriver.remote.remote_connection] DEBUG: Remote response: status=200 | data={“value”:null} | headers=HTTPHeaderDict({‘Content-Length’: ‘14’, ‘Content-Type’: ‘application/json; charset=utf-8’, ‘cache-control’: ‘no-cache’})
2023-03-19 01:17:50 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
输入回车继续:
2023-03-19 01:18:17 [selenium.webdriver.remote.remote_connection] DEBUG: GET http://localhost:56600/session/393336fb77f45ba2d8c04e5b0cb5a116/cookie {}
2023-03-19 01:18:17 [urllib3.connectionpool] DEBUG: http://localhost:56600 “GET /session/393336fb77f45ba2d8c04e5b0cb5a116/cookie HTTP/1.1” 200 9392
2023-03-19 01:18:17 [selenium.webdriver.remote.remote_connection] DEBUG: Remote response: status=200 | data={“value”:[{“domain”:".www.douyin.com",“httpOnly”:false,“name”:“passport_fe_beating_status”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“true”},{“domain”:".douyin.com",“expiry”:1684343884,“httpOnly”:true,“name”:“ssid_ucp_v1”,“path”:"/",“sameSite”:“None”,“secure”:true,“value”:“1.0.0-KDgzZDFkNWZkNTRkZTZkODhjOTc3MTYwNjBhODQ5MDE3NDhmZTQ4NzIKGwintoDzrIzMARDS5NegBhjvMSAMOAZA9AdIBBoCaGwiIGJjNmY0MTM0NzM4OTU2YWU4NDAxMTM3MDNjMmJjMjNi”},{“domain”:“www.douyin.com”,“httpOnly”:false,“name”:“bd_ticket_guard_server_data”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:""},{“domain”:".douyin.com",“expiry”:1710695891,“httpOnly”:true,“name”:“store-region”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“cn-zj”},{“domain”:".douyin.com",“expiry”:1684343884,“httpOnly”:true,“name”:“sid_ucp_v1”,“path”:"/",“sameSite”:“Lax”,“secure”:true,“value”:“1.0.0-KDgzZDFkNWZkNTRkZTZkODhjOTc3MTYwNjBhODQ5MDE3NDhmZTQ4NzIKGwintoDzrIzMARDS5NegBhjvMSAMOAZA9AdIBBoCaGwiIGJjNmY0MTM0NzM4OTU2YWU4NDAxMTM3MDNjMmJjMjNi”},{“domain”:".douyin.com",“expiry”:1679764694,“httpOnly”:false,“name”:“FOLLOW_NUMBER_YELLOW_POINT_INFO”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:"%22MS4wLjABAAAAChKFYDbCAD1iTXibr8bIlmqNq782XyEPmzVS1NS_cWg%2F1679241600000%2F0%2F1679159888859%2F0%22"},{“domain”:".douyin.com",“expiry”:1684343884,“httpOnly”:true,“name”:“sessionid_ss”,“path”:"/",“sameSite”:“None”,“secure”:true,“value”:“bc6f4134738956ae840113703c2bc23b”},{“domain”:".douyin.com",“expiry”:1684343884,“httpOnly”:true,“name”:“uid_tt_ss”,“path”:"/",“sameSite”:“None”,“secure”:true,“value”:“0d48b1cee9f4b41aa73e8ec7f61d30f3”},{“domain”:".douyin.com",“expiry”:1681751886,“httpOnly”:true,“name”:“passport_auth_status_ss”,“path”:"/",“sameSite”:“None”,“secure”:true,“value”:“2946ba76cc8b93fcf8f1eccf5f4ed612%2C”},{“domain”:".douyin.com",“expiry”:1681751886,“httpOnly”:true,“name”:“passport_auth_status”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“2946ba76cc8b93fcf8f1eccf5f4ed612%2C”},{“domain”:".douyin.com",“expiry”:1710695886,“httpOnly”:true,“name”:“odin_tt”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“0fe7bdd33a71172f71bc6968bbc9d567869cff093dc1b1cc5cc2edf5f19faffd69b814c6e7919575c6e8061101109f8ac8aaf3ab0112ac963ca327048332beee”},{“domain”:".douyin.com",“expiry”:1710263890,“httpOnly”:true,“name”:“sid_guard”,“path”:"/",“sameSite”:“Lax”,“secure”:true,“value”:“bc6f4134738956ae840113703c2bc23b%7C1679159890%7C5183994%7CWed%2C+17-May-2023+17%3A18%3A04+GMT”},{“domain”:".douyin.com",“expiry”:1684343885,“httpOnly”:true,“name”:“sid_ucp_sso_v1”,“path”:"/",“sameSite”:“Lax”,“secure”:true,“value”:“1.0.0-KDI1OGUyOTdiYjIxYzY5OWViNWE1ZmIxNDIzNjNmZTBjZjk0YTIzMGIKHwintoDzrIzMARDM5NegBhjvMSAMMMSlxIEGOAZA9AcaAmxxIiA3YzdiZjkyMDQwYzBjYWYzYWExNTcyN2Q2MWZkMmVjOA”},{“domain”:“www.douyin.com”,“httpOnly”:false,“name”:“bd_ticket_guard_client_data”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“eyJiZC10aWNrZXQtZ3VhcmQtdmVyc2lvbiI6MiwiYmQtdGlja2V0LWd1YXJkLWNsaWVudC1jZXJ0IjoiLS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tXG5NSUlDRkRDQ0FicWdBd0lCQWdJVVlYV2xUZ3FQajR6RWZSWjZGMDJUQlJtZTA4Y3dDZ1lJS29aSXpqMEVBd0l3XG5NVEVMTUFrR0ExVUVCaE1DUTA0eElqQWdCZ05WQkFNTUdYUnBZMnRsZEY5bmRXRnlaRjlqWVY5bFkyUnpZVjh5XG5OVFl3SGhjTk1qTXdNekU0TVRjeE9EQTJXaGNOTXpNd016RTVNREV4T0RBMldqQW5NUXN3Q1FZRFZRUUdFd0pEXG5UakVZTUJZR0ExVUVBd3dQWW1SZmRHbGphMlYwWDJkMVlYSmtNRmt3RXdZSEtvWkl6ajBDQVFZSUtvWkl6ajBEXG5BUWNEUWdBRXp1RDRlMlFXQ2J2SEQ1M1BRU3d3MTJ5NkpRSnZFM0drRzFxblNSQ0RIVFFZRmtXVEtKdmZJN2tIXG5sQnlySy9pVFdXQ1NlMjE1YTVZUjFhSzFqVnN5WHFPQnVUQ0J0akFPQmdOVkhROEJBZjhFQkFNQ0JhQXdNUVlEXG5WUjBsQkNvd0tBWUlLd1lCQlFVSEF3RUdDQ3NHQVFVRkJ3TUNCZ2dyQmdFRkJRY0RBd1lJS3dZQkJRVUhBd1F3XG5LUVlEVlIwT0JDSUVJQXZJWHFFNWdtd2YxS3pIZWxwMDJXdTdLaDEyWWlSY1VWVEtaL2Nlazh6d01Dc0dBMVVkXG5Jd1FrTUNLQUlES2xaK3FPWkVnU2pjeE9UVUI3Y3hTYlIyMVRlcVRSZ05kNWxKZDdJa2VETUJrR0ExVWRFUVFTXG5NQkNDRG5kM2R5NWtiM1Y1YVc0dVkyOXRNQW9HQ0NxR1NNNDlCQU1DQTBnQU1FVUNJUUQyanhNNTFIQ3pQWS94XG5XMEJ3dGZzVFFyQ1FhK01JZWxyZkpqOTNqQis1QndJZ1VjY21TemZLNnUwb2ZCeVlKYkYzc1Q4TUMyMnVjTFJTXG4rWnIxYXNJelhXST1cbi0tLS0tRU5EIENFUlRJRklDQVRFLS0tLS1cbiJ9”},{“domain”:“www.douyin.com”,“expiry”:1679764676,“httpOnly”:false,“name”:“tt_scid”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“DxxQtXyeGTSNswbEKT1hi5Oc5273XIQAieBVQygx9MGtVO1YmFYC0M0wBZvE9xwAdac2”},{“domain”:".douyin.com",“expiry”:1684343885,“httpOnly”:true,“name”:“sso_uid_tt”,“path”:"/",“sameSite”:“Lax”,“secure”:true,“value”:“2b78935c48b92b8e339e5df43d2261b1”},{“domain”:".douyin.com",“expiry”:1713719894,“httpOnly”:false,“name”:“my_rd”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“1”},{“domain”:".douyin.com",“expiry”:1679764688,“httpOnly”:false,“name”:“VIDEO_FILTER_MEMO_SELECT”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:"%7B%22expireTime%22%3A1679764688578%2C%22type%22%3A1%7D"},{“domain”:".douyin.com",“expiry”:1713719885,“httpOnly”:false,“name”:“passport_assist_user”,“path”:"/",“sameSite”:“Lax”,“secure”:true,“value”:"CkDDsLpdvDUDwmR8XrKxqVvYnuDrsf_oINnwj0p5qdCDBFBUaYFycXH0KL2WBmIXetunYkyn3o5utiOCIRkLXLfOGkgKPOSWhS5na2yj2pkKonhpUMw0EEFux3xRSM4f4HHX1dsJooSu7IVlE5srunKgbJzbq9AZMIFWRN2tZqqUORCZkKwNGImv1lQiAQNHSb6
"},{“domain”:".douyin.com",“expiry”:1684343884,“httpOnly”:true,“name”:“sid_tt”,“path”:"/",“sameSite”:“Lax”,“secure”:true,“value”:“bc6f4134738956ae840113703c2bc23b”},{“domain”:".douyin.com",“expiry”:1689527885,“httpOnly”:true,“name”:“n_mh”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“Rf-IcFyb5ovp3QG0ltU4Yok_jnGCel1iOpjdSoEJ-ZE”},{“domain”:".douyin.com",“expiry”:1684343885,“httpOnly”:true,“name”:“toutiao_sso_user”,“path”:"/",“sameSite”:“Lax”,“secure”:true,“value”:“7c7bf92040c0caf3aa15727d61fd2ec8”},{“domain”:".douyin.com",“expiry”:1710695891,“httpOnly”:true,“name”:“store-region-src”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“uid”},{“domain”:“www.douyin.com”,“expiry”:1679764676,“httpOnly”:false,“name”:“ttcid”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“b9bd771c8e3c43d3b5bec17b7dd5332b37”},{“domain”:".douyin.com",“expiry”:1684343884,“httpOnly”:true,“name”:“sessionid”,“path”:"/",“sameSite”:“Lax”,“secure”:true,“value”:“bc6f4134738956ae840113703c2bc23b”},{“domain”:“www.douyin.com”,“httpOnly”:false,“name”:“csrf_session_id”,“path”:"/",“sameSite”:“None”,“secure”:true,“value”:“dbb5f29fedeae9e8ca34b7e0786ffa4b”},{“domain”:“www.douyin.com”,“expiry”:1679764673,“httpOnly”:false,“name”:“msToken”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“RU9US_VnNATEODCmT-AyT3KsiBelCxBri71KLP8ohp5dOqQna_9noLAMoBHwweHUhw0Iob-0z04NEwG1GUZGR0GRuy4vEcGXuUpNIkRSKYGyszUPV_KJLE4TttJ9eGA=”},{“domain”:".douyin.com",“expiry”:1684343868,“httpOnly”:false,“name”:“passport_csrf_token”,“path”:"/",“sameSite”:“None”,“secure”:true,“value”:“c6b79b06ac3d778f7b64f877dc90dd94”},{“domain”:".douyin.com",“expiry”:1679764695,“httpOnly”:false,“name”:“home_can_add_dy_2_desktop”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:"%221%22"},{“domain”:".douyin.com",“expiry”:1679764667,“httpOnly”:false,“name”:“strategyABtestKey”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:"%221679159867.89%22"},{“domain”:".douyin.com",“expiry”:1710263892,“httpOnly”:true,“name”:“ttwid”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“1%7CAUe6H31UfeVJQcoofrbsuWzH5q_zUFFdP1ykOu1KjBA%7C1679159865%7Cc384d9449156b3393f6c0da13326bfbc304d8bd914dc90ea92fac66fd8cea718”},{“domain”:".douyin.com",“expiry”:1684343885,“httpOnly”:true,“name”:“ssid_ucp_sso_v1”,“path”:"/",“sameSite”:“None”,“secure”:true,“value”:“1.0.0-KDI1OGUyOTdiYjIxYzY5OWViNWE1ZmIxNDIzNjNmZTBjZjk0YTIzMGIKHwintoDzrIzMARDM5NegBhjvMSAMMMSlxIEGOAZA9AcaAmxxIiA3YzdiZjkyMDQwYzBjYWYzYWExNTcyN2Q2MWZkMmVjOA”},{“domain”:“www.douyin.com”,“httpOnly”:false,“name”:"",“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“douyin.com”},{“domain”:".douyin.com",“expiry”:1684343884,“httpOnly”:true,“name”:“uid_tt”,“path”:"/",“sameSite”:“Lax”,“secure”:true,“value”:“0d48b1cee9f4b41aa73e8ec7f61d30f3”},{“domain”:“www.douyin.com”,“expiry”:1684343869,“httpOnly”:false,“name”:“s_v_web_id”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“verify_lfe8fjax_jUAKmlT8_LC4j_4pfm_9XE9_GkMsq4hGtWNf”},{“domain”:".douyin.com",“expiry”:1679764689,“httpOnly”:false,“name”:“msToken”,“path”:"/",“sameSite”:“None”,“secure”:true,“value”:“XKuFhQt13RyrIUEtQfTsuO4i-Z14V-PFGmV62imKvd9C0Uvja1QQuV4NndIQfMAibA8_ADLr-bxOWqTNXq_ztwyeahqQUY-T8oXWfWMIKPaWnDdQla5fIi92839xBT8=”},{“domain”:".douyin.com",“expiry”:1713719888,“httpOnly”:false,“name”:“LOGIN_STATUS”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“1”},{“domain”:“www.douyin.com”,“httpOnly”:false,“name”:"",“path”:"/user",“sameSite”:“Lax”,“secure”:false,“value”:“douyin.com”},{“domain”:".douyin.com",“expiry”:1684343885,“httpOnly”:true,“name”:“toutiao_sso_user_ss”,“path”:"/",“sameSite”:“None”,“secure”:true,“value”:“7c7bf92040c0caf3aa15727d61fd2ec8”},{“domain”:".douyin.com",“expiry”:1684343885,“httpOnly”:true,“name”:“sso_uid_tt_ss”,“path”:"/",“sameSite”:“None”,“secure”:true,“value”:“2b78935c48b92b8e339e5df43d2261b1”},{“domain”:“www.douyin.com”,“expiry”:1710695865,“httpOnly”:false,“name”:"__ac_signature",“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:"_02B4Z6wo00f01VnD50QAAIDB2cEdBXjBJRVZ4-PAADJof9"},{“domain”:".douyin.com",“expiry”:1684343868,“httpOnly”:false,“name”:“passport_csrf_token_default”,“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“c6b79b06ac3d778f7b64f877dc90dd94”},{“domain”:“www.douyin.com”,“expiry”:1679161665,“httpOnly”:false,“name”:"__ac_nonce",“path”:"/",“sameSite”:“Lax”,“secure”:false,“value”:“06415f2390003c1bc99ee”}]} | headers=HTTPHeaderDict({‘Content-Length’: ‘9392’, ‘Content-Type’: ‘application/json; charset=utf-8’, ‘cache-control’: ‘no-cache’})
2023-03-19 01:18:17 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
2023-03-19 01:18:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.douyin.com/robots.txt> (referer: None)
2023-03-19 01:18:18 [scrapy.downloadermiddlewares.robotstxt] DEBUG: Forbidden by robots.txt: <GET https://www.douyin.com/>
2023-03-19 01:18:18 [scrapy.core.engine] INFO: Closing spider (finished)
2023-03-19 01:18:18 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{‘downloader/exception_count’: 1,
‘downloader/exception_type_count/scrapy.exceptions.IgnoreRequest’: 1,
‘downloader/request_bytes’: 224,
‘downloader/request_count’: 1,
‘downloader/request_method_count/GET’: 1,
‘downloader/response_bytes’: 1143,
‘downloader/response_count’: 1,
‘downloader/response_status_count/200’: 1,
‘elapsed_time_seconds’: 39.117756,
‘finish_reason’: ‘finished’,
‘finish_time’: datetime.datetime(2023, 3, 18, 17, 18, 18, 457694),
‘httpcompression/response_bytes’: 621,
‘httpcompression/response_count’: 1,
‘log_count/DEBUG’: 26,
‘log_count/INFO’: 11,
‘response_received_count’: 1,
‘robotstxt/forbidden’: 1,
‘robotstxt/request_count’: 1,
‘robotstxt/response_count’: 1,
‘robotstxt/response_status_count/200’: 1,
‘scheduler/dequeued’: 1,
‘scheduler/dequeued/memory’: 1,
‘scheduler/enqueued’: 1,
‘scheduler/enqueued/memory’: 1,
‘start_time’: datetime.datetime(2023, 3, 18, 17, 17, 39, 339938)}
2023-03-19 01:18:18 [scrapy.core.engine] INFO: Spider closed (finished)
2023-03-19 01:18:18 [uc] INFO: ensuring close
2023-03-19 01:18:18 [uc] DEBUG: webdriver process ended
2023-03-19 01:18:18 [uc] DEBUG: gracefully closed browser
2023-03-19 01:18:18 [uc] DEBUG: When removing the temp profile, a PermissionError occured: [WinError 32] 另一个程序正在使用此文件,进程无法访问。: 'C:\Users\seven\AppData\Local\Temp\tmpnohqav16\Default\Affiliation Database’
retrying…
2023-03-19 01:18:18 [uc] DEBUG: When removing the temp profile, a PermissionError occured: [WinError 32] 另一个程序正在使用此文件,进程无法访问。: 'C:\Users\seven\AppData\Local\Temp\tmpnohqav16\Default\Affiliation Database’
retrying…
2023-03-19 01:18:18 [uc] DEBUG: When removing the temp profile, a PermissionError occured: [WinError 32] 另一个程序正在使用此文件,进程无法访问。: 'C:\Users\seven\AppData\Local\Temp\tmpnohqav16\Default\Affiliation Database’
retrying…
2023-03-19 01:18:18 [uc] DEBUG: When removing the temp profile, a PermissionError occured: [WinError 32] 另一个程序正在使用此文件,进程无法访问。: 'C:\Users\seven\AppData\Local\Temp\tmpnohqav16\Default\Affiliation Database’
retrying…
2023-03-19 01:18:18 [uc] DEBUG: When removing the temp profile, a PermissionError occured: [WinError 32] 另一个程序正在使用此文件,进程无法访问。: 'C:\Users\seven\AppData\Local\Temp\tmpnohqav16\Default\Affiliation Database’
retrying…
2023-03-19 01:18:18 [undetected_chromedriver.patcher] DEBUG: successfully unlinked C:\Users\seven\appdata\roaming\undetected_chromedriver\undetected_chromedriver.exe

进程已结束,退出代码0

正在回答 回答被采纳积分+3

1回答

bobby 2023-03-19 18:14:47

先使用普通方法 分析一下抖音能否抓取 https://cloud.tencent.com/developer/article/1936885 ,如果没有问题再集成到scrapy中

0 回复 有任何疑惑可以回复我~
问题已解决,确定采纳
还有疑问,暂不采纳
微信客服

购课补贴
联系客服咨询优惠详情

帮助反馈 APP下载

慕课网APP
您的移动学习伙伴

公众号

扫描二维码
关注慕课网微信公众号