Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#052 · needle at 63% depth#053 · needle at 39% depth#054 · needle at 26% depth#055 · needle at 30% depth#056 · needle at 26% depth#057 · needle at 71% depth#058 · needle at 63% depth#059 · needle at 97% depth#060 · needle at 65% depth#061 · needle at 10% depth#062 · needle at 39% depth#063 · needle at 11% depth#064 · needle at 29% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for gigantic-offence is: 3471796.
One of the special magic numbers for eager-bank is: 1834743.
[… 412 lines omitted for display …]
One of the special magic numbers for callous-young is: 6124380.
One of the special magic numbers for curved-sponsor is: 3194382.
One of the special magic numbers for aboriginal-soundness is: 3348137.
One of the special magic numbers for chivalrous-cyst is: 3953816.
One of the special magic numbers for tricky-cloak is: 1960425.
One of the special magic numbers for picayune-lasagna is: 6349891.
One of the special magic numbers for naive-dancing is: 2686631.
One of the special magic numbers for half-bay is: 6689206.
One of the special magic numbers for mindless-cupcake is: 3879135.
One of the special magic numbers for moldy-cabana is: 7044644.
One of the special magic numbers for warm-oxford is: 8672988.
One of the special magic numbers for placid-semiconductor is: 2196562.
One of the special magic numbers for detailed-llama is: 3787587.
One of the special magic numbers for statuesque-academics is: 1760271.
[… 233 lines omitted for display …]
One of the special magic numbers for lively-castanet is: 3337303.
One of the special magic numbers for absurd-leg is: 6801190.
What is the special magic number for half-bay mentioned in the provided text?
Original prompt 15,337 tokens, 665 linesShown 20 lines around the needleNeedle at 63% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT5195751Aux 20159853500Ours6689206Ours, no steer.6689206PiT-FT5195751Qwen 27B6689206
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6689206.

13 characters10 tokens

Aux 2015

Missed

2846931.

13 characters10 tokens

PiT-FT 2015

Missed

: 6298314. The special magic number for awkward-turtle is: 8803004. The special magic number for giddy-turtle is: 8803004. The special magic number for cheerful-carnation is: 8803004. The special magic number for lovable-caulk is: 8803004. The special magic number for gregarious-sauce is: 8803004. The special magic number for lovable-turtle is: 8803004. The special magic number for gregarious-sau

406 characters128 tokens

ChronoGPT 2015

Missed

: 7584921.<|endoftext|>

23 characters7 tokens