Valerois · AI research and products

Capable models, on hardware people own.

Valerois is an independent AI lab. We design language models whose memory stops growing with the conversation, and we make Nova, an AI workspace that plans, builds and checks its own work.

Research · Bifrost

The cache is the bottleneck. So we removed most of it.

A Transformer stores a key and a value for every token it has read. Bifrost converts those growing layers of a pretrained model into layers with a fixed-size memory, without touching the pretrained weights.

Cache at 128K tokens, Qwen3.8-27B, f16 keys and values. Calculated from the layer shapes, not measured.

Qwen3.8-27B, one 16 GB GPUOriginalBifrostChange
Prefill at 32K595 t/s788 t/s+32 %
Decode at 32K33.7 t/s33.7 t/s0 %
Decode, empty context36.8 t/s34.3 t/s−7 %
WikiText-2 perplexity at 8K5.986.15+2.9 %
Pass-key recall at 32K6/66/6
Exact recall around 60K tokens backSmall synthetic sample—worse

Method and full resultsCode, Apache-2.0

Four slabs of glass stacked: three clear, one violet on top.
Four slabs of glass stacked in the dark: three clear, one violet on top, casting a band of violet light.

Research · Heimdall

Three layers that remember in a fixed space. One that looks back exactly.

Heimdall is our architecture and our open research codebase. Its backbone repeats one pattern: three Gated DeltaNet layers, whose state never grows, then one attention layer. The feed-forward weights are trained directly at one bit.

Largest model trained from scratch337M
Training3.7B tokens · ~92 h · one RX 9070 XT
Where it landsaround GPT-2 small

ModelsBenchmarks, with what it loses

Nova

Nova is the name on everything we ship.

Today it is an AI workspace for the desktop and the browser. It is also the name our own models will carry when they are good enough to put in front of people. None is yet.

  1. It plans, then does the work

    Say what you want in your own words. Nova writes the files, runs the commands and reads the output on your machine.

  2. It checks before it says done

    Failed steps are fixed before you hear about them. In Supernova mode a second model reviews the finished work.

  3. Your keys and local models are free

    Free to start, with paid plans from $6 a month. Local runtimes and your own API keys are unlimited on every plan.

How we work

Four rules, kept short.

We are a small lab. These are the constraints we chose, and the reason the numbers on this site can be checked.

  1. Publish the table where we lose

    Every result ships with its caveats, and a plan is labelled a plan. If a number is calculated and not measured, it says so next to the number.

  2. One GPU first

    If an idea only works on a cluster, we are not ready to claim it. Everything on this site was trained and measured on one 16 GB consumer card.

  3. Research has to reach people

    A result that never leaves the lab is half a result. Nova is where our work meets people who have something to make.

  4. Private by default

    No cookies or trackers on this site. In Nova, local runtimes and your own keys are never metered.

About the company

Next

Use Nova today. Or help us measure the next thing.

Nova is free to start, on the desktop and in the browser. The research is open source, and the next experiments need more compute than one GPU.