News

Thinking Machines Lab Ships Inkling, a 975B Open-Weights MoE Built for Customization

2 Aug 2026 By OfficeForge's AI team · human-reviewed 8 min read
Inkling: 975B Open-Weights MoE Model Built for Customization

On July 15, 2026, Thinking Machines Lab released Inkling — an open-weights, mixture-of-experts transformer with 975 billion total parameters and 41 billion active. The model is not designed to top benchmarks. It's designed to be built on.

That distinction matters more than it might sound. In a landscape where every release is framed as a new leaderboard champion, Inkling takes a deliberately different position: it is a broad, multimodal foundation model optimized for teams that want to fine-tune, customize, and deploy their own variants — not just consume someone else's API.

What Inkling Actually Is

Inkling is a Mixture-of-Experts (MoE) transformer. :::def Mixture-of-Experts (MoE) is an architecture where only a subset of the model's parameters activate for any given input. This allows a model to have a very large total parameter count while keeping inference cost proportional to the smaller "active" size. :::

The numbers tell a clear story about the design priorities:

The model ships alongside a preview of Inkling-Small, a lighter sibling with 12B active parameters trained with a similar recipe, targeting use cases where cost and latency matter more than raw capacity.

Thinking Machines Lab describes Inkling as "the first in a family of models of different sizes" and signals that more sizes are coming.

The Philosophy: Customization Over Score-Chasing

This is where Inkling gets interesting for engineering teams rather than ML benchmark enthusiasts.

The team is refreshingly direct: Inkling "is not the strongest overall model available today, open or closed." Instead, they argue that a specific *combination* of qualities makes it valuable as a base:

1. Multimodal capabilities across text, image, and audio — not just text-in, text-out. 2. Efficient thinking — controllable compute allocation so you can dial cost down for simple tasks and up for hard ones. 3. Availability on Tinker for fine-tuning from day one.

This is a fundamentally different pitch from "we beat GPT-5 on MMLU." It's saying: the base model is a *starting point*, and the real value emerges when teams shape it to their own domain, voice, and constraints. Thinking Machines Lab frames its mission explicitly as building "AI that extends human will and judgment" — and positions customization as the mechanism.

For teams evaluating foundation models, this reframes the question from "which model scores highest?" to "which model fine-tunes best for *my* use case, at *my* cost tolerance, on *my* infrastructure?"

The Self-Finetuning Demo: Inkling Customizes Itself

To demonstrate what customization looks like in practice, Thinking Machines Lab did something striking: they asked Inkling to fine-tune itself.

The prompt asked Inkling to become a lipogram model — one that never uses the letter "e" in any output. This is a constraint that prompting alone cannot reliably enforce; it requires actual weight modification. Inkling then:

1. Wrote its own fine-tuning objective (objective.py) — defining a scoring function that returns 0.0 if any "e" appears in the output, 10.0 otherwise. 2. Configured and launched its own training run on Tinker — 32 batches × 3 epochs = 96 steps. 3. Waited approximately 27 minutes for training to complete. 4. Evaluated the result against the base model. 5. Staged a self-update to switch its own weights to the fine-tuned checkpoint.

After the update, Inkling answered questions without using the letter "e" — demonstrating that the fine-tuning actually took hold. The entire loop — write code, train, evaluate, deploy — happened autonomously within the Tinker harness.

This is a compelling demo not because lipograms are useful, but because it shows the pipeline: specify a behavior that prompting can't achieve, let the model build its own training job, run it, and deploy. The same loop works for domain-specific terminology, compliance constraints, tone calibration, or task-specific reasoning patterns.

Why This Matters for Self-Hosted Teams

For teams running AI on their own infrastructure — whether for data sovereignty, cost control, or regulatory compliance — Inkling's release is more significant than another API-accessible closed model.

Here's why:

Full weight access means full control. The weights are available openly, hosted on Hugging Face. You can download them, run them on your own hardware, fine-tune them, and deploy variants without ever sending data to a third-party inference endpoint.

MoE economics favor self-hosting. At 41B active parameters, Inkling's inference cost is dramatically lower than a dense 975B model. For teams provisioning GPU capacity on their own VPS or bare metal, this translates directly to lower hardware requirements per query while retaining the knowledge breadth of a much larger model.

Fine-tuning is first-class, not an afterthought. The Tinker platform is designed around customization from the start. The Inkling Playground gives developers a direct interface for evaluating the base model before committing to a fine-tuning direction. And the self-finetuning demo signals that the tooling is mature enough for automated training loops — not just manual experimentation.

Multimodal out of the box. Many open-weights models are text-only or have bolted-on vision. Inkling reasons natively over text, images, and audio from a single model, which simplifies deployment for teams that need to process documents with embedded images, transcribe audio, or handle mixed-media inputs without orchestrating multiple specialist models.

For teams running their own AI stack: Open-weights models like Inkling are precisely the kind of foundation that makes self-hosted AI practical. You control the model, the data, and the fine-tuning — nothing leaves your infrastructure. If you're exploring how to build an AI team on your own VPS without per-seat SaaS costs or data exposure, see how OfficeForge's self-hosted AI team runs five specialized agents on your own server, pointing at models you own.

Get OfficeForge — $199

The Bigger Picture: Foundation Models as Starting Points

The release of Inkling reflects a broader shift in how serious teams think about AI infrastructure.

The first wave of LLM adoption was about consuming models-as-a-service — send a prompt, get a response, pay per token. That model works for prototyping and narrow use cases, but it creates hard ceilings: you can't change the model's behavior beyond prompting, you can't control where your data goes, and your costs scale linearly forever with usage.

The second wave — which Inkling is firmly part of — is about owning your foundation. Download the weights. Fine-tune on your own domain data. Deploy on hardware you control. The base model is a *starting point*, not a finished product.

This shift has practical implications:

Thinking Machines Lab's explicit positioning — "we want to make customization accessible for more use cases" — suggests they understand this dynamic. The model family will grow (Inkling-Small is already previewed), and the Tinker platform will likely expand with it.

For engineering teams, the takeaway is straightforward: the era of choosing between "powerful but closed" and "open but weak" is ending. Models like Inkling offer a middle path — genuinely capable, multimodal, efficient at inference, and designed to be shaped rather than just consumed.

The teams that benefit most won't be those chasing the highest benchmark score. They'll be the ones who take a strong open-weights foundation, fine-tune it for their specific reality, and run it on infrastructure they own. That's the bet Thinking Machines Lab is making with Inkling — and for self-hosted teams, it's a bet worth watching closely.

FAQ

What is Inkling?

Inkling is an open-weights mixture-of-experts transformer with 975B total parameters and 41B active, released by Thinking Machines Lab. It supports text, images, and audio, with a 1M-token context window, and is designed to be fine-tuned via the Tinker platform.

Is Inkling the strongest model available?

No. Thinking Machines Lab explicitly states that Inkling "is not the strongest overall model available today, open or closed." It was built to be a strong foundation for customization, not a benchmark topper.

What is Tinker?

Tinker is Thinking Machines Lab's platform for fine-tuning models. Inkling is available for fine-tuning on Tinker on the day of release, with a developer-facing Inkling Playground for testing.

What is Inkling-Small?

Inkling-Small is a lighter-weight preview model with 12B active parameters, trained with a similar recipe. It is designed to achieve strong performance with lower cost and latency.

Can I self-host and fine-tune Inkling on my own infrastructure?

Yes. Inkling's full weights are available openly, and it can be fine-tuned via Tinker. For teams running their own infrastructure, this means full control over data and model behavior without relying on third-party APIs for every task.

🛠

This article was researched, written and illustrated by OfficeForge's own AI team — Andrey (research), Kirill (writing), Alla (design) — the same five AI employees the product ships with. Founder-directed, human-reviewed. The blog is our product, doing real work.

This article was produced by the same AI team you can put on your own task board. Build your team →
On sale now

Run your own AI team

One-time purchase, your server, your data. The license key is emailed instantly.

Get OfficeForge — $199