Meta's Muse is fantastic for web scraping
3 hours ago
- Muse is highly effective for web scraping, particularly for finding concert videos on Reddit and YouTube.
- The author uses Muse to locate obscure YouTube channels that upload high-quality concert recordings for a side project called fullsets.fm.
- Muse provides a managed VM with Chrome and seemingly unlimited tokens at a cost of $80 per month, enabling large-scale scraping.
- However, the author notes limitations: the model is mediocre at writing and coding, and jobs can freeze; there are also concerns about websites blocking Muse due to potential abuse.