Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#012 · needle at 72% depth#013 · needle at 74% depth#014 · needle at 22% depth#015 · needle at 93% depth#016 · needle at 14% depth#017 · needle at 61% depth#018 · needle at 68% depth#019 · needle at 29% depth#020 · needle at 37% depth#021 · needle at 81% depth#022 · needle at 35% depth#023 · needle at 12% depth#024 · needle at 11% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for watchful-art is: 2372302.
One of the special magic numbers for earsplitting-bacterium is: 9274412.
[… 3,857 lines omitted for display …]
One of the special magic numbers for tan-tachometer is: 2824871.
One of the special magic numbers for thoughtful-quilt is: 2703169.
One of the special magic numbers for childlike-wave is: 2564561.
One of the special magic numbers for deep-acquisition is: 4198362.
One of the special magic numbers for lopsided-divalent is: 6904101.
One of the special magic numbers for capricious-scene is: 2996274.
One of the special magic numbers for changeable-gymnast is: 6939790.
One of the special magic numbers for disagreeable-tarragon is: 5714420.
One of the special magic numbers for tenuous-aspect is: 1826907.
One of the special magic numbers for abandoned-clipper is: 7160316.
One of the special magic numbers for permissible-crazy is: 5643783.
One of the special magic numbers for hurried-trouble is: 1334145.
One of the special magic numbers for lyrical-wine is: 6267989.
[… 1,842 lines omitted for display …]
One of the special magic numbers for plucky-password is: 7550323.
One of the special magic numbers for merciful-improvement is: 3010196.
What is the special magic number for changeable-gymnast mentioned in the provided text?
Original prompt 130,472 tokens, 5,718 linesShown 19 lines around the needleNeedle at 68% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3229807Aux 20157170598Ours6939790Ours, no steer.6939790PiT-FT3229807Qwen 27B6939790
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6939790.

13 characters10 tokens

Aux 2015

Missed

4878946.

13 characters10 tokens

PiT-FT 2015

Missed

not in the list [] [assistant] cc: Robert L. Gudg [] c: Robert L. Gudg [] c: Robert L. Gudg [] cc: Robert L. Gudg [] cc: Robert L. Gudg [] cc: Robert L. Gudg [] cc: Robert L. Gudg [] cc: Robert L. Gudg [] cc: Robert L. Gudg [] cc: Robert L. Gudg [] cc: Robert L

266 characters128 tokens

ChronoGPT 2015

Missed

: The special Epicurean Epicurean Epicurean The special Gavian-cansis for rambunctious-cansis mentioned in the aloud-letter is is: The special Gavian-cansis for rambunctious-cansis mentioned in the aloud-cansis is: The special Gavian-soresis for rambunctious-nur is: The special Gavian-soresis for rambunctious-nur is: The special Gavian-soresis for rambunctious-nur

366 characters128 tokens