Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#037 · needle at 87% depth#038 · needle at 14% depth#039 · needle at 54% depth#040 · needle at 10% depth#041 · needle at 73% depth#042 · needle at 69% depth#043 · needle at 27% depth#044 · needle at 2% depth#045 · needle at 35% depth#046 · needle at 39% depth#047 · needle at 85% depth#048 · needle at 91% depth#049 · needle at 30% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wonderful-blame is: 6497561.
One of the special magic numbers for numberless-hire is: 9528050.
[… 756 lines omitted for display …]
One of the special magic numbers for quaint-representation is: 9472148.
One of the special magic numbers for understood-chasuble is: 8261618.
One of the special magic numbers for dysfunctional-goodie is: 4425122.
One of the special magic numbers for forgetful-libido is: 6849440.
One of the special magic numbers for wee-paragraph is: 7102106.
One of the special magic numbers for skillful-inspector is: 2924317.
One of the special magic numbers for zealous-whack is: 8234300.
One of the special magic numbers for dry-email is: 4659401.
One of the special magic numbers for decorous-cucumber is: 1251474.
One of the special magic numbers for torpid-mink is: 7505031.
One of the special magic numbers for knowledgeable-form is: 7927220.
One of the special magic numbers for hushed-geek is: 7538365.
One of the special magic numbers for wakeful-decryption is: 7067032.
One of the special magic numbers for smelly-salute is: 2593948.
[… 2,069 lines omitted for display …]
One of the special magic numbers for deadpan-premier is: 5589060.
One of the special magic numbers for dysfunctional-special is: 9492873.
What is the special magic number for dry-email mentioned in the provided text?
Original prompt 65,013 tokens, 2,845 linesShown 20 lines around the needleNeedle at 27% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9620062Aux 20155481243Ours4659401Ours, no steer.4659401PiT-FT9620062Qwen 27B4659401
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4659401.

13 characters10 tokens

Aux 2015

Missed

4797673.

13 characters10 tokens

PiT-FT 2015

Missed

: 7690091. The special magic number for the most important-bark is: 8870071. The special magic number for the most effective-sauce is: 8870071. The special magic number for the most significant-bunghole is: 8870071. The special magic number for the most effective-sprint is: 8870071. The special magic number for the most effective-soul is: 8870071. The special magic number for the most effective-soul is: 8870071. The special magic number

447 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for rambunctious-rhyme is: The special magic number for rambunctious-letter is: The special magic number for rambunctious-letter is: The special magic number for rambunctious-letter is: The special magic number for rambunctious-letter is: The special magic number for rambunctious-letter is: The special magic number for rambunctious-letter is: The special magic number for rambunctious-letter is: The special magic number for rambunctious-letter is

476 characters128 tokens