ethical-scraping
1 stories total
- Capcat is a command-line tool for ethical web scraping and content preservation.
- It offers two modes: CLI for automation/TUI for visual exploration, with a unified backend.
- Supports multiple sources simultaneously (12 built-in, plus custom RSS feeds), enabling faster archiving.
- Archives content permanently in Markdown (with optional HTML output), making it locally accessible and searchable.
- Features include automatic date-based folder structure, image preservation, and integration with tools like Obsidian.