Inkling-Small is a general-purpose multimodal model that accepts text, image, and audio inputs and generates text outputs.
It can be used with libraries like Transformers, vLLM, SGLang, and Docker, as well as through APIs and third-party providers.
The model uses a 42-layer decoder-only transformer with a sparse Mixture-of-Experts (MoE) architecture, totaling 276B parameters but activating only 12B per token.
Training data is sourced from public, third-party, and synthetic data, with cleaning and filtering to improve quality and safety.