Metadata-Version: 2.3
Name: hssp
Version: 0.4.4
Summary: 一个简单快速的异步爬虫框架
Project-URL: homepage, https://github.com/x-haose/hssp
Project-URL: repository, https://github.com/x-haose/hssp
Project-URL: documentation, https://github.com/x-haose/hssp
Author-email: 昊色居士 <xhrtxh@gmail.com>
License-Expression: MIT
License-File: LICENSE
Keywords: 异步,爬虫,爬虫框架
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: MacOS :: MacOS X
Classifier: Operating System :: Microsoft :: Windows
Classifier: Operating System :: POSIX :: BSD
Classifier: Operating System :: POSIX :: Linux
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Internet :: WWW/HTTP
Classifier: Topic :: Software Development :: Libraries :: Application Frameworks
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Requires-Python: >=3.10
Requires-Dist: aiohttp>=3.9.5
Requires-Dist: apscheduler>=3.10.4
Requires-Dist: blinker>=1.8.2
Requires-Dist: curl-cffi>=0.7.2
Requires-Dist: drissionpage>=4.0.5.6
Requires-Dist: fake-useragent>=1.5.1
Requires-Dist: furl>=2.1.3
Requires-Dist: httpx[http2]>=0.27.0
Requires-Dist: loguru>=0.7.2
Requires-Dist: parsel>=1.9.1
Requires-Dist: pycryptodomex>=3.20.0
Requires-Dist: pydantic-settings[toml,yaml]>=2.2.1
Requires-Dist: pydantic[dotenv]>=2.7.3
Requires-Dist: requests>=2.32.3
Requires-Dist: tenacity>=8.3.0
Requires-Dist: uvloop; sys_platform != 'win32' and implementation_name == 'cpython'
Description-Content-Type: text/markdown

# HSSP 爬虫框架

一个基于python asyncio开发的爬虫框架 (开发中)

## 作者

- [@昊色居士](https://github.com/x-haose)

## 特性

- 使用scrapy框架的选择器`parsel`作为内置网页选择器
- 基于tenacity的自动异常重试
- 基于fake-useragent的可选随机UA
- 可选的多种下载器: httpx、aiohttp、requests等
- 请求前、响应后、重试后监听

## 安装

###

使用 pip 安装 hssp

```bash
pip install hssp
```

###

使用 rye 安装 hssp

```bash
rye add hssp
```

## 路线图

- 基于fake-useragent的随机UA
- curl-cff的支持
- drissionpage的支持

## 支持

如需支持，请发送电子邮件至 xhrtxh@gmail.com。

## 开发测试

项目使用`rye`管理依赖，需先安装rye

```bash
    rye sync
```
