Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#030 · needle at 13% depth#031 · needle at 44% depth#032 · needle at 21% depth#033 · needle at 10% depth#034 · needle at 85% depth#035 · needle at 51% depth#036 · needle at 24% depth#037 · needle at 87% depth#038 · needle at 14% depth#039 · needle at 54% depth#040 · needle at 10% depth#041 · needle at 73% depth#042 · needle at 69% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for gainful-shed is: 1053188.
One of the special magic numbers for marked-salmon is: 4444872.
[… 683 lines omitted for display …]
One of the special magic numbers for quiet-pantologist is: 5207081.
One of the special magic numbers for sticky-joke is: 3508337.
One of the special magic numbers for goofy-tuber is: 1124147.
One of the special magic numbers for encouraging-liability is: 3229398.
One of the special magic numbers for mature-rhythm is: 5798296.
One of the special magic numbers for hapless-petal is: 7647915.
One of the special magic numbers for organic-pagoda is: 7314675.
One of the special magic numbers for venomous-applause is: 5441747.
One of the special magic numbers for condemned-approval is: 2487990.
One of the special magic numbers for courageous-monk is: 6168027.
One of the special magic numbers for noisy-agenda is: 6367154.
One of the special magic numbers for screeching-solicitor is: 8795187.
One of the special magic numbers for hot-armoire is: 9885351.
One of the special magic numbers for ancient-step-sister is: 1304722.
[… 2,142 lines omitted for display …]
One of the special magic numbers for sulky-mansard is: 4403502.
One of the special magic numbers for heady-ad is: 9070202.
What is the special magic number for venomous-applause mentioned in the provided text?
Original prompt 64,980 tokens, 2,845 linesShown 20 lines around the needleNeedle at 24% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1542764Aux 20158466225Ours5441747Ours, no steer.5441747PiT-FT1542764Qwen 27B5441747
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5441744.

(Note: I initially misread the last few digits in my internal trace; let me re-verify with the exact text provided.)

Re-scanning the text for "venomous-applause": "One of the special magic numbers for venomous-applause is: 5441747."

Correct special magic number: 5441747.

292 characters91 tokens

Aux 2015

Missed

5721786.

13 characters10 tokens

PiT-FT 2015

Missed

: 7106914. The special magic number for the most important-tit is: 8106912. The special magic number for the most effective-tugboat is: 8106912. The special magic number for the most beautiful-sauce is: 8106912. The special magic number for the most effective-sorgh is: 8106912. The special magic number for the most effective-snow is: 8702036. The special magic number for the most effective-sorgh is: 8702036. The special magic

436 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number forgroovy-writing is: The special Magic Number number is: The special Magic number foraboard-letter is: The special Magic number forabrazo-letter is: The special Magic number forabrazo-letter is: The special Magic number forabrazo-letter is: The special Magic number forabrazo-letter is: The special Magic number forabrazo-letter is: The special Magic number forabrazo-letter is: The special Magic number forabrazo-letter is: The special Magic

470 characters128 tokens