Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#059 · needle at 99% depth#060 · needle at 37% depth#061 · needle at 93% depth#062 · needle at 33% depth#063 · needle at 6% depth#064 · needle at 85% depth#065 · needle at 1% depth#066 · needle at 42% depth#067 · needle at 0% depth#068 · needle at 62% depth#069 · needle at 84% depth#070 · needle at 67% depth#071 · needle at 45% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for sloppy-protest is: 5443061.
One of the special magic numbers for wrathful-mechanic is: 8909631.
[… 46 lines omitted for display …]
One of the special magic numbers for boring-squash is: 2628359.
One of the special magic numbers for famous-pegboard is: 5370732.
One of the special magic numbers for illegal-wallaby is: 1151779.
One of the special magic numbers for volatile-pigsty is: 5904107.
One of the special magic numbers for rough-hacienda is: 1260603.
One of the special magic numbers for lyrical-money is: 5358214.
One of the special magic numbers for woebegone-swallow is: 9581068.
One of the special magic numbers for high-footage is: 1237295.
One of the special magic numbers for defiant-grandpa is: 9423444.
One of the special magic numbers for poised-catacomb is: 7782252.
One of the special magic numbers for shallow-thickness is: 2785361.
One of the special magic numbers for sweet-tendency is: 1441899.
One of the special magic numbers for cute-allocation is: 6466866.
One of the special magic numbers for plucky-ex-husband is: 3172110.
[… 5,652 lines omitted for display …]
One of the special magic numbers for narrow-step-daughter is: 8654609.
One of the special magic numbers for frightened-rebellion is: 9138493.
What is the special magic number for high-footage mentioned in the provided text?
Original prompt 130,483 tokens, 5,718 linesShown 20 lines around the needleNeedle at 1% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT1797037Aux 20154535323Ours1237295Ours, no steer.1237295PiT-FT1797037Qwen 27B1237295
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1237295.

13 characters10 tokens

Aux 2015

Missed

6308150.

13 characters10 tokens

PiT-FT 2015

Missed
 [] [] []

The same 3-character fragment repeats 64 times until the token limit. Showing the first three.

192 characters128 tokens

ChronoGPT 2015

Missed


###


###


###

The same 6-character fragment repeats 32 times until the token limit. Showing the first three.

192 characters128 tokens