MediaCrawler
NanmiCoder/MediaCrawler
MediaCrawler is a versatile multi-platform social media data collection tool built on Playwright, enabling public data extraction from major platforms like Xiaohongshu, Douyin, and Bilibili.
62.3k 12.2kNo licenseUpdated 2026-08-12
64
GoodOverview
MediaCrawler simplifies social media data acquisition by leveraging browser automation and persistent session contexts instead of complex JavaScript reverse-engineering. It supports keyword searches, specific post retrieval, comments, creator profiles, and proxy integration across several popular platforms, outputting structured data into multiple formats or databases.
Capabilities
- ▸Multi-platform scraping (Xiaohongshu, Douyin, Kuaishou, Bilibili, Weibo, Tieba, Zhihu)
- ▸Keyword-based search and direct post ID scraping
- ▸Nested comment extraction and word cloud generation
- ▸Session persistence via CDP mode or QR code login
- ▸Proxy pool support and multiple data storage options
Best for
Collecting public social media content and user comments for market research and sentiment analysis, Extracting creator profile details and post metrics from platforms like Xiaohongshu and Douyin, Exporting scraped data into various formats such as CSV, JSON, Excel, or databases for analytics
Works with
CursorClaude Code
Evoa Score breakdown= Σ (score × weight)
64Task usefulness20%88 → +17.6
実タスクにどれだけ役立つか（機能の豊富さ・用途の明確さ）。 — AIによるcapabilities/use-cases解析
Code quality15%85 → +12.8
実装・指示の品質。 — AIによるSKILL.md/README解析
Maintenance15%100 → +15.0
リポジトリがどれだけ活発に保守されているか。 — GitHub 最終push日時の新しさ
Documentation12%39 → +4.7
ドキュメントの充実度・分かりやすさ。 — README/独自要約の情報量
Security15%50 → +7.5
危険・不審な挙動が無いか。 — AIによるセキュリティレビュー
Originality10%70 → +7.0
ありふれたラッパーではない独自性。 — AIによる独自性判定
Popularity8%100 → +8.0
コミュニティの採用度。 — GitHub Stars/Forks（対数スケール）
Compatibility5%50 → +2.5
対応AIエージェントの広さ。 — AIによる対応エージェント判定
Weighted total75.0 / 100
ライセンス不明/制限あり（Red）のSkillは総合スコアに0.85倍の補正を適用します。 ランキングはこのScoreのみで決まり、広告で変わりません。 算出方法の詳細 →
Security considerations
Web scraping tools interact with external platforms and may trigger account bans or security flags if run at high frequencies. Users must ensure compliance with target platform terms of service and local data protection regulations.
Categories
Summary and analysis are original content generated by AI Skills Rank. The skill's source text is not reproduced here — view it on the linked repository.