Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#003 · needle at 29% depth#004 · needle at 7% depth#005 · needle at 4% depth#006 · needle at 6% depth#007 · needle at 4% depth#008 · needle at 29% depth#009 · needle at 73% depth#010 · needle at 90% depth#011 · needle at 39% depth#012 · needle at 77% depth#013 · needle at 83% depth#014 · needle at 78% depth#015 · needle at 63% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for cultured-adjustment is: 9743675.
One of the special magic numbers for unable-constant is: 6480970.
[… 2,062 lines omitted for display …]
One of the special magic numbers for determined-authorisation is: 1155812.
One of the special magic numbers for parched-recollection is: 4434010.
One of the special magic numbers for colossal-booklet is: 2347171.
One of the special magic numbers for swift-ruler is: 7324742.
One of the special magic numbers for humorous-double is: 1896414.
One of the special magic numbers for chilly-gathering is: 8130441.
One of the special magic numbers for joyous-revascularisation is: 9455919.
One of the special magic numbers for faulty-flung is: 7768260.
One of the special magic numbers for gifted-grip is: 4901464.
One of the special magic numbers for permissible-inhabitant is: 8852667.
One of the special magic numbers for abrasive-millennium is: 8209293.
One of the special magic numbers for early-mole is: 3335494.
One of the special magic numbers for flippant-comment is: 1613895.
One of the special magic numbers for unadvised-pusher is: 4478323.
[… 763 lines omitted for display …]
One of the special magic numbers for meek-wreck is: 4813678.
One of the special magic numbers for staking-paint is: 3694615.
What is the special magic number for faulty-flung mentioned in the provided text?
Original prompt 64,950 tokens, 2,845 linesShown 20 lines around the needleNeedle at 73% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9873467Aux 20156186878Ours7768260Ours, no steer.7768260PiT-FT9873467Qwen 27B7768260
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7768260.

13 characters10 tokens

Aux 2015

Missed

6812755.

13 characters10 tokens

PiT-FT 2015

Missed

: 8692095. The special magic number for sarcastic-sauce is: 9852091. The special magic number for loutish-cauliflower is: 8692095. The special magic number for gregarious-cane is: 8692095. The special magic number for lovable-sugar is: 8692095. The special magic number for lovable-sommer is: 8692095. The special magic number for jazzy-sugar is: 8692095. The special magic number for lovable-

400 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for rambunctious-cobwebs mentioned in the provided text is: The special magic number for rambunctious-cobwebs mentioned in the provided text is: The special magic number for rambunctious-cobwebs mentioned in the provided text is: The special magic number for rambunctious-cobwebs mentioned in the provided text is: The special magic number for rambunctious-cobwebs mentioned in the provided text is: The special magic number for rambunctious-cobwebs mentioned in

489 characters128 tokens