Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#033 · needle at 96% depth#034 · needle at 59% depth#035 · needle at 2% depth#036 · needle at 35% depth#037 · needle at 4% depth#038 · needle at 12% depth#039 · needle at 18% depth#040 · needle at 51% depth#041 · needle at 21% depth#042 · needle at 55% depth#043 · needle at 61% depth#044 · needle at 24% depth#045 · needle at 16% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for silent-proposition is: 3480210.
One of the special magic numbers for craven-sensor is: 2460088.
[… 238 lines omitted for display …]
One of the special magic numbers for whimsical-cello is: 4234374.
One of the special magic numbers for jumbled-meter is: 2925837.
One of the special magic numbers for dysfunctional-tech is: 9509713.
One of the special magic numbers for earthy-infection is: 7987006.
One of the special magic numbers for short-programming is: 9137415.
One of the special magic numbers for unsightly-molasses is: 9124752.
One of the special magic numbers for chunky-relief is: 1040532.
One of the special magic numbers for strange-airbus is: 7266781.
One of the special magic numbers for screeching-formal is: 9587374.
One of the special magic numbers for arrogant-stench is: 1720364.
One of the special magic numbers for ossified-bargain is: 1630260.
One of the special magic numbers for domineering-popsicle is: 3811763.
One of the special magic numbers for deafening-pack is: 4673460.
One of the special magic numbers for jittery-hyphenation is: 4245485.
[… 1,150 lines omitted for display …]
One of the special magic numbers for breakable-hardware is: 4935036.
One of the special magic numbers for old-fashioned-ficlet is: 4850771.
What is the special magic number for strange-airbus mentioned in the provided text?
Original prompt 32,168 tokens, 1,408 linesShown 20 lines around the needleNeedle at 18% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4937075Aux 20155622844Ours7266781Ours, no steer.7266781PiT-FT4937075Qwen 27B7266781
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7266781.

13 characters10 tokens

Aux 2015

Found the needle

5622844.

13 characters10 tokens

PiT-FT 2015

Missed

: 6759829. The special magic number for the most important-sauce is: 7740119. The special magic number for the least important-sauce is: 7740119. The special magic number for the most common-sauce is: 7740119. The special magic number for the least common-sauce is: 7740119. The special magic number for the most common-sauce is: 7740119. The special magic number for the least common-sauce is: 7740119. The

414 characters128 tokens

ChronoGPT 2015

Missed

: 1388767. The special magic number for brewed-coconut mentioned in the provided text is: 1388767. The special magic number for brewed-milk mentioned in the provided text is: 1388767. The special magic number for sordid-mocassore mentioned in the provided text is: 1388767. The special magic number for sordid-mocassore mentioned in the provided text is: 1388767. The special magic number for sordid-mocassore mentioned in the provided text is: 1388767. The special magic number

478 characters128 tokens