Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#048 · needle at 73% depth#049 · needle at 53% depth#050 · needle at 27% depth#051 · needle at 18% depth#052 · needle at 63% depth#053 · needle at 39% depth#054 · needle at 26% depth#055 · needle at 30% depth#056 · needle at 26% depth#057 · needle at 71% depth#058 · needle at 63% depth#059 · needle at 97% depth#060 · needle at 65% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for cheerful-pajamas is: 9305160.
One of the special magic numbers for spicy-brother-in-law is: 2489862.
[… 163 lines omitted for display …]
One of the special magic numbers for feigned-interaction is: 6841198.
One of the special magic numbers for ill-scallion is: 6649849.
One of the special magic numbers for political-prohibition is: 1348235.
One of the special magic numbers for tiny-adaptation is: 6270439.
One of the special magic numbers for stale-nerve is: 4925437.
One of the special magic numbers for entertaining-nicety is: 4287566.
One of the special magic numbers for aboard-physiology is: 4159123.
One of the special magic numbers for available-boutique is: 8906625.
One of the special magic numbers for murky-evaluator is: 8644056.
One of the special magic numbers for murky-oleo is: 1410207.
One of the special magic numbers for obscene-scissors is: 4968482.
One of the special magic numbers for noisy-schedule is: 3968201.
One of the special magic numbers for super-worry is: 6133629.
One of the special magic numbers for adamant-newsletter is: 4218517.
[… 482 lines omitted for display …]
One of the special magic numbers for selfish-mariachi is: 2657280.
One of the special magic numbers for undesirable-thaw is: 1175716.
What is the special magic number for available-boutique mentioned in the provided text?
Original prompt 15,321 tokens, 665 linesShown 20 lines around the needleNeedle at 26% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9087493Aux 20155264284Ours8906625Ours, no steer.8906625PiT-FT9087493Qwen 27B8906625
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8906625.

13 characters10 tokens

Aux 2015

Missed

3096963.

13 characters10 tokens

PiT-FT 2015

Missed

: 8016500. The special magic number for different-counsellor is: 8016500. The special magic number for giddy-gravitate is: 8016500. The special magic number for anxious-sauce is: 8016500. The special magic number for jaded-turtle is: 8016500. The special magic number for sluggish-sauce is: 8016500. The special magic number for giddy-turtle is: 8016500. The special magic number for reluctant-budge is:

410 characters128 tokens

ChronoGPT 2015

Missed

: 7383955.<|endoftext|>

23 characters7 tokens