Fly.io is getting rid of GPU-accelerated machines
4 days ago
- #Cloud Computing
- #GPU
- #Deprecated
- GPUs are deprecated and will be unavailable after August 1, but Fly.io currently offers GPU Machines for acceleration.
- Available GPU models: A10 (8GB RAM, good for smaller LLMs like Llama 3 8B, Stable Diffusion), L40S (48GB RAM, all-rounder for graphics/video/inference), A100 40G PCIe and A100 80G SXM (40GB/80GB RAM, suited for inference, training, high-precision tasks).
- Each Fly GPU Machine uses a single full GPU, suitable for rendering, encoding/decoding, inference, and light fine-tuning, but not for training large models from scratch.
- Regions with GPUs: a10 and l40s in ord; a100-40gb in ord; a100-80gb in iad, sjc, syd, ams.