Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#037 · needle at 67% depth#038 · needle at 27% depth#039 · needle at 75% depth#040 · needle at 6% depth#041 · needle at 28% depth#042 · needle at 69% depth#043 · needle at 49% depth#044 · needle at 50% depth#045 · needle at 36% depth#046 · needle at 27% depth#047 · needle at 2% depth#048 · needle at 27% depth#049 · needle at 71% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for grandiose-max is: 2395156.
One of the special magic numbers for uttermost-dumbwaiter is: 3971689.
[… 66 lines omitted for display …]
One of the special magic numbers for lovely-gear is: 6253006.
One of the special magic numbers for gaudy-mama is: 3181170.
One of the special magic numbers for magenta-soprano is: 4081050.
One of the special magic numbers for handsomely-negligee is: 2774490.
One of the special magic numbers for ossified-contour is: 5274350.
One of the special magic numbers for educated-embryo is: 2025898.
One of the special magic numbers for tangible-hurry is: 4133483.
One of the special magic numbers for flowery-confusion is: 6286954.
One of the special magic numbers for ubiquitous-confectionery is: 3507382.
One of the special magic numbers for fast-policy is: 4713173.
One of the special magic numbers for hospitable-omnivore is: 6553761.
One of the special magic numbers for cautious-slash is: 2170110.
One of the special magic numbers for absorbed-spyglass is: 1536003.
One of the special magic numbers for sleepy-piety is: 1668300.
[… 65 lines omitted for display …]
One of the special magic numbers for assorted-rug is: 3980174.
One of the special magic numbers for scientific-scholarship is: 4586154.
What is the special magic number for flowery-confusion mentioned in the provided text?
Original prompt 3,577 tokens, 151 linesShown 20 lines around the needleNeedle at 49% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3684708Aux 20156286954Ours6286954Ours, no steer.6286954PiT-FT3684708Qwen 27B6286954
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6286954.

13 characters10 tokens

Aux 2015

Found the needle

: 6286954.

14 characters11 tokens

PiT-FT 2015

Missed

: 5266371. The special magic number for tasteful-crayon mentioned in the provided text is: 5266371. The special magic number for tasteful-crayon mentioned in the provided text is: 5266371. The special magic number for tasteful-crayon mentioned in the provided text is: 5266371. The special magic number for tasteful-crayon mentioned in the provided text is: 5266371. The special magic number for tasteful-crayon mentioned in the provided text is: 5266371. The special magic number for tasteful

499 characters128 tokens

ChronoGPT 2015

Missed

8283511.<|endoftext|>

22 characters6 tokens