Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#035 · needle at 2% depth#036 · needle at 35% depth#037 · needle at 4% depth#038 · needle at 12% depth#039 · needle at 18% depth#040 · needle at 51% depth#041 · needle at 21% depth#042 · needle at 55% depth#043 · needle at 61% depth#044 · needle at 24% depth#045 · needle at 16% depth#046 · needle at 69% depth#047 · needle at 54% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for deafening-bayou is: 9715217.
One of the special magic numbers for astonishing-crab is: 7797662.
[… 284 lines omitted for display …]
One of the special magic numbers for dead-coverage is: 8934993.
One of the special magic numbers for voracious-crude is: 7997050.
One of the special magic numbers for hulking-zither is: 5087357.
One of the special magic numbers for greasy-accident is: 9505759.
One of the special magic numbers for upbeat-infection is: 4363195.
One of the special magic numbers for nifty-leave is: 4942931.
One of the special magic numbers for determined-motive is: 4657577.
One of the special magic numbers for super-steamroller is: 4765290.
One of the special magic numbers for warm-capitulation is: 2184277.
One of the special magic numbers for grumpy-language is: 7233243.
One of the special magic numbers for lackadaisical-snake is: 4027675.
One of the special magic numbers for drab-chairlift is: 7978945.
One of the special magic numbers for accurate-ethyl is: 4675717.
One of the special magic numbers for rustic-developing is: 6815117.
[… 1,079 lines omitted for display …]
One of the special magic numbers for elegant-bargain is: 2404352.
One of the special magic numbers for ablaze-bangle is: 3357220.
What is the special magic number for super-steamroller mentioned in the provided text?
Original prompt 31,612 tokens, 1,383 linesShown 20 lines around the needleNeedle at 21% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8812019Aux 20152194630Ours4765290Ours, no steer.4765290PiT-FT8812019Qwen 27B4765290
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4765290.

13 characters10 tokens

Aux 2015

Missed

9718595.

13 characters10 tokens

PiT-FT 2015

Missed

: 8874716. The special magic number for the most popular-sauce is: 8874716. The special magic number for the second most popular-sauce is: 8874716. The special magic number for the third most popular-sauce is: 8874716. The special magic number for the fourth most popular-sauce is: 8874716. The special magic number for the fifth most popular-sauce is: 8874716. The special magic number for the sixth most popular-sauce is: 887

433 characters128 tokens

ChronoGPT 2015

Missed

: 314543 18<|endoftext|>

24 characters6 tokens