Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#051 · needle at 57% depth#052 · needle at 81% depth#053 · needle at 85% depth#054 · needle at 10% depth#055 · needle at 61% depth#056 · needle at 27% depth#057 · needle at 35% depth#058 · needle at 77% depth#059 · needle at 65% depth#060 · needle at 20% depth#061 · needle at 5% depth#062 · needle at 18% depth#063 · needle at 10% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for racial-watermelon is: 7176285.
One of the special magic numbers for acrid-collar is: 4600765.
[… 997 lines omitted for display …]
One of the special magic numbers for spiritual-mid-course is: 6672182.
One of the special magic numbers for heartbreaking-offer is: 1073302.
One of the special magic numbers for dashing-organization is: 5936837.
One of the special magic numbers for murky-laptop is: 3709326.
One of the special magic numbers for rotten-underestimate is: 6878754.
One of the special magic numbers for obnoxious-regard is: 2533093.
One of the special magic numbers for handsomely-root is: 4681011.
One of the special magic numbers for bizarre-passenger is: 7878323.
One of the special magic numbers for guttural-capability is: 2634570.
One of the special magic numbers for quick-botany is: 3317950.
One of the special magic numbers for resonant-light is: 4711624.
One of the special magic numbers for gentle-fire is: 9174983.
One of the special magic numbers for nice-reinscription is: 9357875.
One of the special magic numbers for steady-umbrella is: 5094347.
[… 1,828 lines omitted for display …]
One of the special magic numbers for disagreeable-nourishment is: 6892723.
One of the special magic numbers for aromatic-legume is: 4662145.
What is the special magic number for bizarre-passenger mentioned in the provided text?
Original prompt 64,973 tokens, 2,845 linesShown 20 lines around the needleNeedle at 35% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6976060Aux 20159183095Ours7878323Ours, no steer.7878323PiT-FT6976060Qwen 27B7878323
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7878323.

13 characters10 tokens

Aux 2015

Missed

5781989.

13 characters10 tokens

PiT-FT 2015

Missed

: 7104214. The special magic number for sluggish-sir is: 8871234. The special magic number for gregarious-gift is: 8105375. The special magic number for voracious-sir is: 8871234. The special magic number for gregarious-gift is: 8105375. The special magic number for lovable-sir is: 8105375. The special magic number for gregarious-gift is: 8105375. The special magic number for lovable-sir

397 characters128 tokens

ChronoGPT 2015

Missed

:

A:

The special magic number for nappy-sambiture mentioned in the provided text is:

B:

The special Magic Number number for the other text is:

C:

The special Magic number for the other text is:

B:

B:

C:

B:

B:

B:

B:

B:

B:

C:

B:

B:

B:

B:

323 characters128 tokens