Back to feed
News Story
APriority79
Latent Space
1 sources

Thinky Releases 975B Multimodal Open Model

Thinky released its first full LLM, a 975B-parameter multimodal model under Apache 2.0 open weights, alongside a smaller 276B variant. This marks a significant open-source contribution in AI.

SynthePulse Insight · AI deep reading

Inkling Release: A New Baseline for U.S. Open-Source Models, Not a New Peak

Version 2 · 1 source

Thinky releases its first open-source large model, Inkling, with 975B total parameters and 41B active parameters under the Apache 2.0 license, setting a new benchmark for U.S. open-source models, but the company explicitly states this is a day-one release, not the final frontier.

  • Inkling has 975B total parameters, 41B active parameters, Apache 2.0 license, supports 1M context (open weights) and 256K (API).
  • Training data is approximately 45T tokens, covering text, images, audio, and video.
  • Architectural innovations include hybrid attention (5:1 local-global layer ratio, window 512), relative position encoding replacing RoPE, short convolutional layers, and MoE with 2 shared experts.
  • Artificial Analysis intelligence index score of 41, highest for U.S. open-source models, but trails top Chinese open-source models and best closed-source models.
  • Day-one ecosystem support from vLLM, SGLang, Modal, Baseten, Databricks, Hugging Face, and others.
Open section navigationRelease Positioning: Practical Baseline, Not SOTA

Release Positioning: Practical Baseline, Not SOTA

Thinky today released its first full-size open-source model, Inkling, with the company explicitly stating this is not a SOTA model but rather a practical baseline for U.S. open-source models. Company employees repeatedly emphasized this is a day-one release, a foundation for future iterations, not the final frontier.

Inkling is a multimodal MoE model with 975B total parameters and 41B active parameters, under the Apache 2.0 license. It supports text, image, and audio inputs, text outputs, with open weights supporting 1M context and API supporting 256K.

Inkling-Small is released as a preview, with 276B total parameters and 12B active parameters, using a similar training recipe, and its performance is unexpectedly competitive across several evaluations.

Architectural Innovations: Community Highlights

Community technical breakdowns reveal several architectural choices: a hybrid attention mechanism with a 5:1 local-global layer ratio and window size 512; the use of relative position encoding/relative attention bias instead of RoPE, which multiple commentators called one of the most novel choices in large-scale models.

Short convolutional layers are added around the attention/FFN streams, the MoE uses 2 shared experts (rather than the common 1), and it employs auxiliary-loss-free load balancing. For the optimizer, the community infers the use of muP and MuonC/AdamC, the latter confirmed by optimizer expert Aaron Defazio.

These architectural details come from community technical breakdowns and are not officially confirmed, but multiple technical experts consistently point to their innovativeness.

Performance Benchmarks: Best U.S. Open-Source, but Not Global Leader

Third-party benchmarks show Inkling scores 41 on the Artificial Analysis intelligence index, the highest for U.S. open-source models, ahead of Nemotron 3 Ultra (38), Gemma 4 31B (29), and gpt-oss-120b (24).

In the Design Arena's Agentic Web App Arena, Inkling ranks 9th with an Elo of 1257, in the same tier as Claude Opus 4.6 and Gemini 3.5 Flash, and is the highest-ranked U.S. open-source model.

On specific benchmarks, GDPval-AA v2 Elo is 1238, higher than Kimi K2.6 (1190) and DeepSeek v4 Flash max (1189); τ³-Banking is 24%, higher than Kimi K2.6 (21%) and DeepSeek v4 Flash max (23%). However, independent commentators note it still trails Chinese models like GLM 5.2 and Kimi K2.6.

Ecosystem Support and Release Details

On day one, the release received broad ecosystem support from vLLM, SGLang, Modal, Baseten, Databricks, Hugging Face, and others, including quantization tools and community tools.

Training began last winter, and since mid-January a small team has been building coding, reasoning, and agent training. The model supports controllable reasoning effort levels, and user feedback highlights concise reasoning and strong tool calling.

Training data is 45T tokens (some sources say 48T), covering text, images, audio, and video.

Credibility boundary

This report is based on Latent Space's AINews summary, which includes official tweets and third-party commentary. Model specifications and licensing are officially confirmed, but architectural details and some benchmark data come from community breakdowns or third-party institutions and have not been independently verified. Training token counts vary between 45T and 48T, and total parameters have been reported as 975B, 974B, and 952B, but the mainstream figure is 975B.

Insight takeaway

Inkling's release marks a new high for U.S. open-source models, but the official positioning is as a practical baseline. Its architectural innovations and ecosystem support are key highlights, while performance still lags behind top Chinese open-source models and the best closed-source models.

Primary report

Latent Space

Primary source