Skip to main content
Close
AI

Astra and circular scale: the token stopped measuring effort

Gabriel Ferraresi· CEO | Tech86October 13, 20263 min
aiarchitectureastratransformerinference

The next wave of AI capability does not come from a bigger model. It comes from a model that re-reads its own information more times.

The architecture attributed to GPT-6 Astra, recurrent depth, is the year’s most interesting thesis for anyone designing infrastructure: the same information circulates multiple times through the same layers without extending the visible chain. Capability grows without memory growing along.

The lineage that confirms the thesis

None of this was born at the launch. The lineage is verifiable paper by paper: the Universal Transformer proposed the loop in 2018 (and was set aside for training cost); Huginn-3.5B, from UMD with Meta’s FAIR, released open weights for a recurrent model and reached NeurIPS 2025; and Mixture-of-Recursions, from Samsung SAIL, showed empirically that two loops already deliver a good result on the cost-quality trade-off.

Astra is that thesis reaching a frontier product: prices of 10 and 50 dollars per million tokens (2.5 times its predecessor), with the declared bet of delivering the same result using a third of the tokens per task.

The bottleneck moved: from VRAM to the clock

The structural consequence is the one that matters for infrastructure: FLOPs can rise without memory rising. The capacity bottleneck migrates from VRAM to the clock, from node size to what hardware delivers in cycles.

The "bigger model = bigger hardware" equation, which organized GPU purchases for three years, loses its shape. A self-hosted cluster no longer has a ceiling dictated by the largest model that fits in memory; its ceiling becomes how much recompute the clock delivers. With recurrent architectures in open weights (Huginn is already open), existing hardware can deliver capacity the old ruler said would not fit.

The caveats a decision requires

Contractual honesty: Astra’s architecture has no official technical report; it came via an anonymous source to The Information. Independent evaluation from Artificial Analysis diverged from the lab’s numbers, which aced benchmarks with an in-house harness. And Sebastian Raschka read the technique as engineering fine-tuning, not revolution.

None of that invalidates the thesis. All of it demands the usual ruler: an independent benchmark on your task before switching. The 2026 pattern is this: the independent arbiter in real time, on launch day, with documented divergence.

API buyers and hosts

For the API buyer, nothing changes in the ruler and everything changes in the comparison: price per million rose 2.5 times, and the vendor’s bet is that you use a third of the tokens. If your measurement is cost per completed task, the math may flip in Astra’s favor. If you only compare price tables, you will decide wrong in both directions.

For hosts (our case at Tech86, with open models running on-premises), the thesis is a planning one: future capacity stops being a memory purchase and becomes cycle extraction. The hardware inventory that looks saturated today gains a second life with open recurrent models.

Conclusion

Circular scale breaks the market’s last simple ruler: size. Parameters no longer answer "can this model handle the work", and both buyers and operators migrate to measurements that require work: cost per task and your own benchmark.

Those who already measure this way (per task, with an independent arbiter) cross this transition without turbulence. Those who measure by price table will read the same launch as expensive and as cheap, depending on the slide. The architecture changed; the discipline of measuring is what resolves it.

Interested in this solution?

Explore our managed services and infrastructure.

AI engineering and security

Frequently Asked Questions

It is the architecture attributed to Astra (revealed by an anonymous press source, with no official technical report): a transformer in a loop, in the Universal Transformer lineage from 2018, where the same information circulates multiple times through the same layers without extending the visible chain. Capability grows with the loop’s effective depth, not with model memory size.

Because compute FLOPs can rise with more loop iterations without the model’s memory growing. The bottleneck migrates from VRAM to the clock (how many cycles per second the hardware delivers). It breaks the "bigger model = bigger hardware" equation that organized the market until now.

A verifiable lineage: the Universal Transformer proposed the loop in 2018; Huginn-3.5B (UMD/Meta FAIR, NeurIPS 2025) released open weights for a recurrent model; and Mixture-of-Recursions (Samsung SAIL) showed empirically that two loops already deliver a good cost-quality trade-off. Astra is the thesis reaching a frontier product.

The architecture has no official technical report; it came via an anonymous source to The Information. Independent evaluation (Artificial Analysis) diverged from the lab’s numbers, which aced benchmarks with its own harness. And Sebastian Raschka read the technique as engineering fine-tuning. None of that invalidates the thesis; all of it demands verification before decisions.

Astra launched at 10 and 50 dollars per million tokens (2.5 times its predecessor), betting on a third of the tokens per task. For API buyers, the ruler remains cost per completed task, not price per million. For hosts, recurrent architectures in open weights mean the capacity ceiling is decoupled from node size: existing hardware can deliver more.

Blog, Get in Touch

Have a question about our articles or services? Our team is ready to help.

Schedule a Meeting

Book a time slot.

Schedule Now

Email

Send us a message.

[email protected]

WhatsApp

Quick conversation.

Address

Avenida Paulista, 1636 - São Paulo - SP - 01310-200

Tech86 Specialist

Online now

Hello! How can we help scale your business today?

Tech86 Engineering

We Value Your Privacy

We use cookies and similar technologies to optimize your experience, analyze site traffic, and personalize content. By clicking "Accept All", you agree to the use of all cookies. Read our Privacy Policy.