Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#049 · needle at 15% depth#050 · needle at 41% depth#051 · needle at 82% depth#052 · needle at 72% depth#053 · needle at 50% depth#054 · needle at 98% depth#055 · needle at 88% depth#056 · needle at 59% depth#057 · needle at 17% depth#058 · needle at 80% depth#059 · needle at 22% depth#060 · needle at 18% depth#061 · needle at 49% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for elite-spending is: 7215354.
One of the special magic numbers for depressed-blend is: 1597974.
[… 1,234 lines omitted for display …]
One of the special magic numbers for bad-epoxy is: 3704970.
One of the special magic numbers for agonizing-sovereignty is: 2854495.
One of the special magic numbers for plausible-clave is: 7388241.
One of the special magic numbers for fascinated-edible is: 8764069.
One of the special magic numbers for rhetorical-belief is: 9229695.
One of the special magic numbers for barbarous-bagpipe is: 1994366.
One of the special magic numbers for strong-girl is: 6272042.
One of the special magic numbers for old-fashioned-radio is: 2816604.
One of the special magic numbers for righteous-encouragement is: 1079763.
One of the special magic numbers for aspiring-dip is: 9632104.
One of the special magic numbers for needy-conservation is: 9875097.
One of the special magic numbers for exclusive-picturesque is: 6432002.
One of the special magic numbers for bashful-trapdoor is: 2741495.
One of the special magic numbers for evasive-spite is: 2245876.
[… 154 lines omitted for display …]
One of the special magic numbers for vacuous-shutdown is: 7777553.
One of the special magic numbers for young-washbasin is: 3037725.
What is the special magic number for old-fashioned-radio mentioned in the provided text?
Original prompt 32,240 tokens, 1,408 linesShown 20 lines around the needleNeedle at 88% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1760045Aux 20159561977Ours2816604Ours, no steer.2816604PiT-FT1760045Qwen 27B2816604
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2816604.

13 characters10 tokens

Aux 2015

Missed

7834182.

13 characters10 tokens

PiT-FT 2015

Missed

: 8803059. The special magic number for icky-cattle mentioned in the provided text is: 8803059. The special magic number for icky-cauliflower mentioned in the provided text is: 8803059. The special magic number for icky-susse is: 8803059. The special magic number for icky-cattle is: 8803059. The special magic number for icky-sauerk is: 8803059. The special magic number for icky-sorcellus is: 8803059

408 characters128 tokens

ChronoGPT 2015

Missed

: 2893606.<|endoftext|>

23 characters6 tokens