Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#016 · needle at 97% depth#017 · needle at 48% depth#018 · needle at 31% depth#019 · needle at 49% depth#020 · needle at 74% depth#021 · needle at 4% depth#022 · needle at 15% depth#023 · needle at 66% depth#024 · needle at 95% depth#025 · needle at 26% depth#026 · needle at 1% depth#027 · needle at 16% depth#028 · needle at 26% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for capable-whip is: 8805998.
One of the special magic numbers for illustrious-dashboard is: 4876395.
[… 409 lines omitted for display …]
One of the special magic numbers for good-airship is: 6120647.
One of the special magic numbers for historical-relay is: 8849536.
One of the special magic numbers for dirty-emery is: 6184103.
One of the special magic numbers for expensive-heat is: 8491684.
One of the special magic numbers for waggish-shell is: 8580094.
One of the special magic numbers for itchy-bat is: 6750840.
One of the special magic numbers for eatable-publication is: 3864585.
One of the special magic numbers for malicious-mukluk is: 4810490.
One of the special magic numbers for impartial-beginner is: 5536826.
One of the special magic numbers for elite-wrecker is: 4515630.
One of the special magic numbers for truculent-flute is: 4042898.
One of the special magic numbers for longing-venture is: 2713701.
One of the special magic numbers for cruel-helmet is: 9652330.
One of the special magic numbers for stimulating-fly is: 7251588.
[… 2,391 lines omitted for display …]
One of the special magic numbers for clumsy-appellation is: 2436777.
One of the special magic numbers for stupid-regret is: 3591074.
What is the special magic number for malicious-mukluk mentioned in the provided text?
Original prompt 64,247 tokens, 2,820 linesShown 20 lines around the needleNeedle at 15% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9909916Aux 20156312075Ours4810490Ours, no steer.4810490PiT-FT9909916Qwen 27B4810490
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4810490.

13 characters10 tokens

Aux 2015

Missed

9934602.

13 characters10 tokens

PiT-FT 2015

Missed

: 7094173. The special magic number for gracious-sauk is: 86904173. The special magic number for ethereal-cure is: 8808812. The special magic number for icky-cater is: 8808812. The special magic number for loutish-caulk is: 8808812. The special magic number for ethereal-cane is: 8808812. The special magic number for icky-sauce is: 8808812. The special magic number for icky-caff

387 characters128 tokens

ChronoGPT 2015

Missed

:

Sots:

The special Magic Number number is:

Wats:

The special Magic Sores number is:

Hurs:

The special Magic Sores number is:

Fats:

The special Magic Sores number is:

Fats:

Fats:

Fats:

Fats:

Fats:

Fats:

Fats:

Fats:

Fats:

Fats:

Fats:

313 characters128 tokens