Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#054 · needle at 59% depth#055 · needle at 22% depth#056 · needle at 6% depth#057 · needle at 92% depth#058 · needle at 81% depth#059 · needle at 99% depth#060 · needle at 37% depth#061 · needle at 93% depth#062 · needle at 33% depth#063 · needle at 6% depth#064 · needle at 85% depth#065 · needle at 1% depth#066 · needle at 42% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for billowy-audit is: 3286397.
One of the special magic numbers for fresh-curiosity is: 3901088.
[… 2,124 lines omitted for display …]
One of the special magic numbers for gleaming-kangaroo is: 1696782.
One of the special magic numbers for nostalgic-turret is: 5093032.
One of the special magic numbers for agonizing-defeat is: 5196021.
One of the special magic numbers for observant-redesign is: 1122261.
One of the special magic numbers for fast-hay is: 2686741.
One of the special magic numbers for small-bomb is: 1647750.
One of the special magic numbers for strong-corps is: 6397877.
One of the special magic numbers for dramatic-hydrant is: 2402931.
One of the special magic numbers for forgetful-locality is: 9729964.
One of the special magic numbers for hurried-root is: 2134329.
One of the special magic numbers for magenta-peer is: 5048803.
One of the special magic numbers for stimulating-robe is: 4450102.
One of the special magic numbers for clear-trapezium is: 5306432.
One of the special magic numbers for snotty-vintage is: 4712597.
[… 3,574 lines omitted for display …]
One of the special magic numbers for forgetful-butcher is: 4928510.
One of the special magic numbers for successful-dynamo is: 9140796.
What is the special magic number for dramatic-hydrant mentioned in the provided text?
Original prompt 130,493 tokens, 5,718 linesShown 20 lines around the needleNeedle at 37% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7734336Aux 20158182683Ours2402931Ours, no steer.2402931PiT-FT7734336Qwen 27B2402931
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2402931.

13 characters10 tokens

Aux 2015

Missed

8727985.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. The special magic numbers for sluggish-sauce is also in the text [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [
236 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epic, Meter, and, is a special Epic, Meter,

Stupid-cans is a special Stupid-cans is.

Stupid-cans is a special Stupid-cans is.

Stupid-cans is a special Stupid-cans is.

Stupid-cans is a special Stupid-cans is.

Stupid-cans is a special Stupid-cans is:

Stupid-cans is a special Stupid-cans is:

354 characters128 tokens