Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#034 · needle at 57% depth#035 · needle at 98% depth#036 · needle at 27% depth#037 · needle at 74% depth#038 · needle at 77% depth#039 · needle at 75% depth#040 · needle at 56% depth#041 · needle at 53% depth#042 · needle at 82% depth#043 · needle at 83% depth#044 · needle at 44% depth#045 · needle at 38% depth#046 · needle at 92% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wet-rostrum is: 4717008.
One of the special magic numbers for measly-wit is: 4211378.
[… 3,203 lines omitted for display …]
One of the special magic numbers for capable-response is: 4394648.
One of the special magic numbers for brief-notice is: 1087858.
One of the special magic numbers for greasy-video is: 3243837.
One of the special magic numbers for taboo-eyelids is: 7443805.
One of the special magic numbers for relieved-kid is: 2989743.
One of the special magic numbers for tan-sister-in-law is: 1819753.
One of the special magic numbers for lowly-girdle is: 8526940.
One of the special magic numbers for spiritual-proliferation is: 8205720.
One of the special magic numbers for neighborly-disaster is: 2812977.
One of the special magic numbers for sassy-hamburger is: 6411142.
One of the special magic numbers for odd-sea is: 9233410.
One of the special magic numbers for didactic-exterior is: 4591573.
One of the special magic numbers for enchanting-access is: 5185413.
[… 2,496 lines omitted for display …]
One of the special magic numbers for woebegone-overflight is: 1141266.
One of the special magic numbers for straight-espalier is: 4918775.
What is the special magic number for lowly-girdle mentioned in the provided text?
Original prompt 130,383 tokens, 5,718 linesShown 19 lines around the needleNeedle at 56% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7394761Aux 20156148319Ours8526940Ours, no steer.8526940PiT-FT7394761Qwen 27B8526940
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8526940.

13 characters10 tokens

Aux 2015

Missed

7718665.

13 characters10 tokens

PiT-FT 2015

Missed

: 7902469. [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [ender] [

252 characters128 tokens

ChronoGPT 2015

Missed

: The special Epicurean Epicurean Epicurean The special Gavian-cansis mentioned in the

Realms:

The special Gavian-cansis mentioned in the

Minds:

The special Gavian-txtaboat is mentioned in the

Minds:

The special Gavian-txtabuttle mentioned in the

Minds:

The special Gavian-txtabutoho is mentioned in the

Minds:

The special Gavian-txtabutoho is mentioned in the

Minds:

The

395 characters128 tokens