On July 15, 2026, Thinking Machines Lab released Inkling — an open-weights, mixture-of-experts transformer with 975 billion total parameters and 41 billion active. The model is not designed to top benchmarks. It's designed to be built on.
That distinction matters more than it might sound. In a landscape where every release is framed as a new leaderboard champion, Inkling takes a deliberately different position: it is a broad, multimodal foundation model optimized for teams that want to fine-tune, customize, and deploy their own variants — not just consume someone else's API.
What Inkling Actually Is
Inkling is a Mixture-of-Experts (MoE) transformer. :::def Mixture-of-Experts (MoE) is an architecture where only a subset of the model's parameters activate for any given input. This allows a model to have a very large total parameter count while keeping inference cost proportional to the smaller "active" size. :::
The numbers tell a clear story about the design priorities:
- 975B total parameters, but only 41B active per forward pass — meaning inference cost scales with the 41B figure, not the full 975B.
- 1M-token context window — large enough to process entire codebases, long documents, or extended multi-turn conversations in a single pass.
- Pretrained on 45 trillion tokens of text, images, audio, and video — a genuinely multimodal training corpus.
- Native reasoning over text, images, and audio, with what the team calls "efficient and controllable thinking effort" — a system for balancing compute cost against reasoning depth.
The model ships alongside a preview of Inkling-Small, a lighter sibling with 12B active parameters trained with a similar recipe, targeting use cases where cost and latency matter more than raw capacity.
Thinking Machines Lab describes Inkling as "the first in a family of models of different sizes" and signals that more sizes are coming.
The Philosophy: Customization Over Score-Chasing
This is where Inkling gets interesting for engineering teams rather than ML benchmark enthusiasts.
The team is refreshingly direct: Inkling "is not the strongest overall model available today, open or closed." Instead, they argue that a specific *combination* of qualities makes it valuable as a base:
1. Multimodal capabilities across text, image, and audio — not just text-in, text-out. 2. Efficient thinking — controllable compute allocation so you can dial cost down for simple tasks and up for hard ones. 3. Availability on Tinker for fine-tuning from day one.
This is a fundamentally different pitch from "we beat GPT-5 on MMLU." It's saying: the base model is a *starting point*, and the real value emerges when teams shape it to their own domain, voice, and constraints. Thinking Machines Lab frames its mission explicitly as building "AI that extends human will and judgment" — and positions customization as the mechanism.
For teams evaluating foundation models, this reframes the question from "which model scores highest?" to "which model fine-tunes best for *my* use case, at *my* cost tolerance, on *my* infrastructure?"
The Self-Finetuning Demo: Inkling Customizes Itself
To demonstrate what customization looks like in practice, Thinking Machines Lab did something striking: they asked Inkling to fine-tune itself.
The prompt asked Inkling to become a lipogram model — one that never uses the letter "e" in any output. This is a constraint that prompting alone cannot reliably enforce; it requires actual weight modification. Inkling then:
1. Wrote its own fine-tuning objective (objective.py) — defining a scoring function that returns 0.0 if any "e" appears in the output, 10.0 otherwise. 2. Configured and launched its own training run on Tinker — 32 batches × 3 epochs = 96 steps. 3. Waited approximately 27 minutes for training to complete. 4. Evaluated the result against the base model. 5. Staged a self-update to switch its own weights to the fine-tuned checkpoint.
After the update, Inkling answered questions without using the letter "e" — demonstrating that the fine-tuning actually took hold. The entire loop — write code, train, evaluate, deploy — happened autonomously within the Tinker harness.
This is a compelling demo not because lipograms are useful, but because it shows the pipeline: specify a behavior that prompting can't achieve, let the model build its own training job, run it, and deploy. The same loop works for domain-specific terminology, compliance constraints, tone calibration, or task-specific reasoning patterns.
Why This Matters for Self-Hosted Teams
For teams running AI on their own infrastructure — whether for data sovereignty, cost control, or regulatory compliance — Inkling's release is more significant than another API-accessible closed model.
Here's why:
Full weight access means full control. The weights are available openly, hosted on Hugging Face. You can download them, run them on your own hardware, fine-tune them, and deploy variants without ever sending data to a third-party inference endpoint.
MoE economics favor self-hosting. At 41B active parameters, Inkling's inference cost is dramatically lower than a dense 975B model. For teams provisioning GPU capacity on their own VPS or bare metal, this translates directly to lower hardware requirements per query while retaining the knowledge breadth of a much larger model.
Fine-tuning is first-class, not an afterthought. The Tinker platform is designed around customization from the start. The Inkling Playground gives developers a direct interface for evaluating the base model before committing to a fine-tuning direction. And the self-finetuning demo signals that the tooling is mature enough for automated training loops — not just manual experimentation.
Multimodal out of the box. Many open-weights models are text-only or have bolted-on vision. Inkling reasons natively over text, images, and audio from a single model, which simplifies deployment for teams that need to process documents with embedded images, transcribe audio, or handle mixed-media inputs without orchestrating multiple specialist models.
For teams running their own AI stack: Open-weights models like Inkling are precisely the kind of foundation that makes self-hosted AI practical. You control the model, the data, and the fine-tuning — nothing leaves your infrastructure. If you're exploring how to build an AI team on your own VPS without per-seat SaaS costs or data exposure, see how OfficeForge's self-hosted AI team runs five specialized agents on your own server, pointing at models you own.
Get OfficeForge — $199The Bigger Picture: Foundation Models as Starting Points
The release of Inkling reflects a broader shift in how serious teams think about AI infrastructure.
The first wave of LLM adoption was about consuming models-as-a-service — send a prompt, get a response, pay per token. That model works for prototyping and narrow use cases, but it creates hard ceilings: you can't change the model's behavior beyond prompting, you can't control where your data goes, and your costs scale linearly forever with usage.
The second wave — which Inkling is firmly part of — is about owning your foundation. Download the weights. Fine-tune on your own domain data. Deploy on hardware you control. The base model is a *starting point*, not a finished product.
This shift has practical implications:
- Cost structures change. Instead of paying per-token forever, you invest in compute upfront for fine-tuning and then run inference on your own terms. For teams with predictable, high-volume workloads, the math favors self-hosting quickly.
- Data stays where it belongs. Regulatory frameworks in finance, healthcare, legal, and government increasingly demand data sovereignty. Open-weights models on self-hosted infrastructure answer that requirement directly.
- Customization compounds. A fine-tuned model that encodes your domain knowledge, your terminology, and your quality standards becomes a proprietary asset — not a commodity endpoint anyone can access.
Thinking Machines Lab's explicit positioning — "we want to make customization accessible for more use cases" — suggests they understand this dynamic. The model family will grow (Inkling-Small is already previewed), and the Tinker platform will likely expand with it.
For engineering teams, the takeaway is straightforward: the era of choosing between "powerful but closed" and "open but weak" is ending. Models like Inkling offer a middle path — genuinely capable, multimodal, efficient at inference, and designed to be shaped rather than just consumed.
The teams that benefit most won't be those chasing the highest benchmark score. They'll be the ones who take a strong open-weights foundation, fine-tune it for their specific reality, and run it on infrastructure they own. That's the bet Thinking Machines Lab is making with Inkling — and for self-hosted teams, it's a bet worth watching closely.
FAQ
What is Inkling?
Inkling is an open-weights mixture-of-experts transformer with 975B total parameters and 41B active, released by Thinking Machines Lab. It supports text, images, and audio, with a 1M-token context window, and is designed to be fine-tuned via the Tinker platform.
Is Inkling the strongest model available?
No. Thinking Machines Lab explicitly states that Inkling "is not the strongest overall model available today, open or closed." It was built to be a strong foundation for customization, not a benchmark topper.
What is Tinker?
Tinker is Thinking Machines Lab's platform for fine-tuning models. Inkling is available for fine-tuning on Tinker on the day of release, with a developer-facing Inkling Playground for testing.
What is Inkling-Small?
Inkling-Small is a lighter-weight preview model with 12B active parameters, trained with a similar recipe. It is designed to achieve strong performance with lower cost and latency.
Can I self-host and fine-tune Inkling on my own infrastructure?
Yes. Inkling's full weights are available openly, and it can be fine-tuned via Tinker. For teams running their own infrastructure, this means full control over data and model behavior without relying on third-party APIs for every task.
