Vulnerability Information
Although we use advanced large model technology, its output may still contain inaccurate or outdated information.Shenlong tries to ensure data accuracy, but please verify and judge based on the actual situation.
Vulnerability Title
Protego: Exponential backtracking ReDoS in robots.txt URL wildcard matching
Vulnerability Description
Protego is a pure-Python robots.txt parser with support for modern conventions. Prior to 0.6.2, protego._urlpattern._URLPattern._prepare_pattern_for_regex translates every asterisk in an Allow or Disallow directive into a lazy regular-expression wildcard, so a directive containing many asterisks creates exponential backtracking. After protego.Protego.parse processes a crafted robots.txt file, protego.Protego.can_fetch can spend an attacker-controlled period matching a near-miss URL and deny service to the crawler. The vulnerable path is src/protego/_urlpattern.py in the _URLPattern match logic. This issue is fixed in version 0.6.2.
CVSS Information
CVSS:4.0/AV:N/AC:L/AT:N/PR:N/UI:P/VC:N/VI:N/VA:H/SC:N/SI:N/SA:N
Vulnerability Type
未加控制的资源消耗(资源穷尽)
Vulnerability Title
Scrapy Protego 资源管理错误漏洞
Vulnerability Description
Scrapy Protego是Scrapy团队开源的一款解析robots协议的库。 Scrapy Protego 0.6.2之前版本存在资源管理错误漏洞,该漏洞源于src/Protego/_urlpattern.py中的正则表达式处理不当,将Allow或Disallow指令中的星号转换为惰性通配符,导致指数回溯,攻击者利用特制的robots.txt文件可导致拒绝服务。
CVSS Information
N/A
Vulnerability Type
N/A