Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#049 · needle at 30% depth#050 · needle at 10% depth#051 · needle at 57% depth#052 · needle at 81% depth#053 · needle at 85% depth#054 · needle at 10% depth#055 · needle at 61% depth#056 · needle at 27% depth#057 · needle at 35% depth#058 · needle at 77% depth#059 · needle at 65% depth#060 · needle at 20% depth#061 · needle at 5% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for rough-panda is: 9457745.
One of the special magic numbers for many-odometer is: 5710246.
[… 1,724 lines omitted for display …]
One of the special magic numbers for scandalous-concentrate is: 8205462.
One of the special magic numbers for great-abolishment is: 3722194.
One of the special magic numbers for tangible-parable is: 2269186.
One of the special magic numbers for aggressive-fanny-pack is: 4150331.
One of the special magic numbers for immense-cheetah is: 3202612.
One of the special magic numbers for needy-quiet is: 3088883.
One of the special magic numbers for billowy-hatred is: 7053078.
One of the special magic numbers for plucky-hosiery is: 3196612.
One of the special magic numbers for hilarious-subsidence is: 2500516.
One of the special magic numbers for plain-difficulty is: 9665000.
One of the special magic numbers for humdrum-exterior is: 9676816.
One of the special magic numbers for lewd-mandate is: 1477520.
One of the special magic numbers for powerful-overnighter is: 2027459.
[… 1,077 lines omitted for display …]
One of the special magic numbers for gruesome-mortal is: 5806334.
One of the special magic numbers for hard-junk is: 7958934.
What is the special magic number for billowy-hatred mentioned in the provided text?
Original prompt 64,390 tokens, 2,820 linesShown 19 lines around the needleNeedle at 61% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1270448Aux 20151612859Ours7053078Ours, no steer.7053078PiT-FT1270448Qwen 27B7053078
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7053078.

13 characters10 tokens

Aux 2015

Missed

7189360.

13 characters10 tokens

PiT-FT 2015

Missed

: 7692972. The special magic number for obnoxious-sauerkraut is: 7692972. The special magic number for icky-sauerkraut is: 7692972. The special magic number for icky-sauerkraut is: 7692972. The special magic number for icky-sauerkraut is: 7692972. The special magic number for icky-sauerkraut is: 7692972. The special magic number for icky-sauerkraut is: 769

364 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for grumpy-retirement is: The special magic number for nappy-hair is: The special magic number for nappy-hair is: The special Magic Number number for the soggy-pizza is: The special Magic number for the soggy-pizza is: The special Magic number for the soggy-pizza is: The special Magic number for the soggy-pizza is: The special Magic number for the soggy-pizza is: The special Magic number for the soggy-pizza is

440 characters128 tokens