2 months ago
- The company has released a new AI model called Inkling, which is a Mixture-of-Experts transformer with 975B total parameters and 41B active parameters.
- Inkling supports a context window of up to 1 million tokens, was pretrained on 45 trillion tokens of multimodal data, and is available for fine-tuning via the Tinker platform.
- Key features of Inkling include multimodal reasoning (text, images, audio), controllable thinking effort for balancing performance and efficiency, and strong performance across reasoning, agentic coding, and safety benchmarks.
- Alongside Inkling, a preview of Inkling-Small (276B total parameters, 12B active) is shared, offering similar capabilities with lower cost and latency for certain workloads.
- The model's development involved large-scale RL training (over 30M rollouts), which improved reasoning and led to more concise reasoning styles.
- Inkling is designed as a broad foundation model for customization, emphasizing calibration, instruction following, and resistance to censorship (epistemics).
- Safety evaluations show Inkling has strong safeguards, performing well on benchmarks like FORTRESS and StrongREJECT.
- Inkling is available through various platforms and partners, including TogetherAI, Hugging Face, and others, with full weights released for customization.