Goal Reached Thanks to every supporter — we hit 100%!

Goal: 1000 CNY · Raised: 1336 CNY

100%
Buy Us a Coffee

CVE-2021-41125— HTTP authentication credential leak to target websites in scrapy

Quick assessment

Affected
scrapy scrapy
Exploitation
No confirmed in-the-wild exploitation; assess based on exposure
Recommended action
Check the vendor advisory and references for a fixed version. If immediate upgrade is impossible, restrict exposure and increase monitoring.

Scrapy是一个用Python编写的自由且开源的网络爬虫框架。 Scrapy 存在信息泄露漏洞，如果您使用HttpAuthMiddleware（即http_user和http_pass属性）进行HTTP 身份验证，则所有请求都将向请求目标公开您的凭据。

CVSS 5.7 · Medium EPSS 1.25% · P67

Possible ATT&CK Techniques 1 AI

T1552.005 · Cloud Instance Metadata API
Get alerts for future matching vulnerabilities Log in to subscribe

I. Basic Information for CVE-2021-41125

Vulnerability Information
Have questions about the vulnerability? See if Shenlong's analysis helps!
View Shenlong Deep Dive ↗

Although we use advanced large model technology, its output may still contain inaccurate or outdated information.Shenlong tries to ensure data accuracy, but please verify and judge based on the actual situation.

Vulnerability Title
HTTP authentication credential leak to target websites in scrapy
Source: CVE Program / CVE List V5
Vulnerability Description
Scrapy is a high-level web crawling and scraping framework for Python. If you use `HttpAuthMiddleware` (i.e. the `http_user` and `http_pass` spider attributes) for HTTP authentication, all requests will expose your credentials to the request target. This includes requests generated by Scrapy components, such as `robots.txt` requests sent by Scrapy when the `ROBOTSTXT_OBEY` setting is set to `True`, or as requests reached through redirects. Upgrade to Scrapy 2.5.1 and use the new `http_auth_domain` spider attribute to control which domains are allowed to receive the configured HTTP authentication credentials. If you are using Scrapy 1.8 or a lower version, and upgrading to Scrapy 2.5.1 is not an option, you may upgrade to Scrapy 1.8.1 instead. If you cannot upgrade, set your HTTP authentication credentials on a per-request basis, using for example the `w3lib.http.basic_auth_header` function to convert your credentials into a value that you can assign to the `Authorization` header of your request, instead of defining your credentials globally using `HttpAuthMiddleware`.
Source: CVE Program / CVE List V5
CVSS Information
CVSS:3.1/AV:N/AC:L/PR:L/UI:R/S:U/C:H/I:N/A:N
Source: CVE Program / CVE List V5
Vulnerability Type
信息暴露
Source: CVE Program / CVE List V5
Vulnerability Title
Scrapy 信息泄露漏洞
Source: CNNVD (China National Vulnerability Database)
Vulnerability Description
Scrapy是一个用Python编写的自由且开源的网络爬虫框架。 Scrapy 存在信息泄露漏洞，如果您使用HttpAuthMiddleware（即http_user和http_pass属性）进行HTTP 身份验证，则所有请求都将向请求目标公开您的凭据。
Source: CNNVD (China National Vulnerability Database)
CVSS Information
N/A
Source: CNNVD (China National Vulnerability Database)
Vulnerability Type
N/A
Source: CNNVD (China National Vulnerability Database)

Affected Products

Vendor Product Affected Versions CPE Subscribe
scrapy scrapy < 1.8.1 -

II. Public POCs for CVE-2021-41125

# POC Description Source Link Shenlong Link
AI-Generated POC Premium

No public POC found.

Login to generate AI POC

III. Intelligence Information for CVE-2021-41125

请登录查看更多情报信息。

Patches & Fixes for CVE-2021-41125 (1)

Vendor Advisories for CVE-2021-41125 (1)

Mailing List Discussions for CVE-2021-41125 (1)

Other References for CVE-2021-41125 (2)

IV. Related Vulnerabilities

Same vendor: scrapy
Same weakness: CWE-200

V. Comments for CVE-2021-41125

No comments yet

Leave a comment