scrapy / scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
scrapy / scrapy
TikHub / TikHub-API-Python-SDK
High-performance asynchronous Douyin(抖音) TikTok Xiaohongshu(小红书) Kuaishou(快手) Weibo(微博) Instagram YouTube(油管) Twitter(X) Captcha Solver(验证码解决器) Temp Mail(临时邮箱) API(接口).
alltheplaces / alltheplaces
A set of spiders and scrapers to extract location information from places that post their location on the internet.
wistbean / learn_python3_spider
python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifulSoup、selenium、appium、scrapy等，以及IP代理，验证码识别，Mysql，MongoDB数据库的python使用，多线程多进程爬虫的使用，css 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等
scrapy / scrapyd
A service daemon to run Scrapy spiders
RayXBuilds / Movie_Recommend
历史学习项目：Spark 电影推荐、爬虫、Web 与后台。新版持续开发见 cinematch-recommender。
scrapy-plugins / scrapy-playwright
🎭 Playwright integration for Scrapy
scrapy / parsel
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
raawaa / jav-scrapy
批量抓取AV磁链或封面的苦劳力
juancarlospaco / faster-than-requests
Faster requests on Python 3
scrapinghub / scrapyrt
HTTP API for Scrapy spiders
scrapinghub / spidermon
Scrapy Extension for monitoring spiders execution.
490720818 / qq-pet-copilot
基于 uiautomator2 控件定位的 QQ 宠物自动化工具，支持真机、模拟器，支持多开、后台运行。