Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#085 · needle at 77% depth#086 · needle at 23% depth#087 · needle at 51% depth#088 · needle at 43% depth#089 · needle at 87% depth#090 · needle at 72% depth#091 · needle at 11% depth#092 · needle at 89% depth#093 · needle at 58% depth#094 · needle at 18% depth#095 · needle at 42% depth#096 · needle at 32% depth#097 · needle at 81% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for volatile-photographer is: 7445481.
One of the special magic numbers for strong-demand is: 2612275.
[… 6 lines omitted for display …]
One of the special magic numbers for fair-greed is: 3159072.
One of the special magic numbers for magenta-resident is: 9544879.
One of the special magic numbers for slimy-hardship is: 4272157.
One of the special magic numbers for parsimonious-main is: 5392610.
One of the special magic numbers for naive-flatboat is: 1330703.
One of the special magic numbers for devilish-protocol is: 2079421.
One of the special magic numbers for futuristic-summer is: 8290687.
One of the special magic numbers for busy-ectoderm is: 4055918.
One of the special magic numbers for salty-case is: 9988298.
One of the special magic numbers for happy-chalice is: 2270746.
One of the special magic numbers for lamentable-tournament is: 9383946.
One of the special magic numbers for plain-crayfish is: 2402440.
One of the special magic numbers for volatile-great-grandmother is: 3271762.
One of the special magic numbers for straight-icing is: 2130757.
[… 120 lines omitted for display …]
One of the special magic numbers for squalid-lipid is: 1679316.
One of the special magic numbers for tenuous-practice is: 1477613.
What is the special magic number for busy-ectoderm mentioned in the provided text?
Original prompt 3,485 tokens, 146 linesShown 20 lines around the needleNeedle at 11% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2345154Aux 20154055918Ours4055918Ours, no steer.4055918PiT-FT2345154Qwen 27B4055918
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4055918.

13 characters10 tokens

Aux 2015

Missed

4692909.

13 characters10 tokens

PiT-FT 2015

Missed

: <|assistant|>

<|assistant|>

<|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|> <|assistant|>

255 characters128 tokens

ChronoGPT 2015

Missed

: 3412081.<|endoftext|>

23 characters7 tokens