Running Local LLMs? [Tenstorrent] 32GB Card Might Be Better Than Your RTX 5090
a year ago
- #LLM
- #Tenstorrent
- #AI-hardware
- Tenstorrent launches Blackhole and Wormhole PCIe cards for local LLM enthusiasts.
- Blackhole p100a: 28GB GDDR6, 448 GB/s bandwidth, $999.
- Blackhole p150a: 32GB GDDR6, 512 GB/s bandwidth, $1399.
- Wormhole n150d: 12GB GDDR6, 288 GB/s bandwidth, $1099.
- Wormhole n300d: 24GB GDDR6, 576 GB/s bandwidth, $1449.
- Cards offer more VRAM than Nvidia RTX 3090/4090 but lower bandwidth.
- Target users: VRAM-focused, developers, scalability planners, early adopters.
- Upcoming Blackhole p300 rumored with 64GB VRAM and ~1TB/s bandwidth.
- Software ecosystem less mature compared to Nvidia's CUDA.
- High-speed interconnects (QSFP-DD) for multi-card scaling.