Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#059 · needle at 22% depth#060 · needle at 18% depth#061 · needle at 49% depth#062 · needle at 73% depth#063 · needle at 83% depth#064 · needle at 96% depth#065 · needle at 16% depth#066 · needle at 20% depth#067 · needle at 66% depth#068 · needle at 35% depth#069 · needle at 5% depth#070 · needle at 60% depth#071 · needle at 93% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for condemned-apricot is: 1324574.
One of the special magic numbers for sore-bagpipe is: 2617048.
[… 218 lines omitted for display …]
One of the special magic numbers for knowing-yard is: 8778116.
One of the special magic numbers for ordinary-monger is: 1700859.
One of the special magic numbers for jumpy-textbook is: 5448189.
One of the special magic numbers for smooth-stepping-stone is: 2318832.
One of the special magic numbers for idiotic-ocean is: 9946494.
One of the special magic numbers for clammy-bone is: 7283762.
One of the special magic numbers for swift-depth is: 8677257.
One of the special magic numbers for lyrical-step-father is: 2632745.
One of the special magic numbers for symptomatic-washcloth is: 9351073.
One of the special magic numbers for muddled-frequency is: 2186152.
One of the special magic numbers for moldy-heir is: 1593555.
One of the special magic numbers for comfortable-wasting is: 8169082.
One of the special magic numbers for evasive-screenwriting is: 5445681.
One of the special magic numbers for damaged-way is: 8253967.
[… 1,145 lines omitted for display …]
One of the special magic numbers for classy-comportment is: 3171633.
One of the special magic numbers for merciful-lawn is: 7785543.
What is the special magic number for lyrical-step-father mentioned in the provided text?
Original prompt 31,608 tokens, 1,383 linesShown 20 lines around the needleNeedle at 16% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6408061Aux 20152006550Ours2632745Ours, no steer.2632745PiT-FT6408061Qwen 27B2632745
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2632745.

13 characters10 tokens

Aux 2015

Missed

8679205.

13 characters10 tokens

PiT-FT 2015

Missed

: 8702565. The special magic number for the most excellent-sauce is: 8702565. The special magic number for the most excellent-tender is: 8702565. The special magic number for the most excellent-tender is: 8702565. The special magic number for the most excellent-tender is: 8702565. The special magic number for the most excellent-tender is: 8702565. The special magic number for the most excellent-tender is: 8702565. The special magic number for the

457 characters128 tokens

ChronoGPT 2015

Missed

: 1830161.<|endoftext|>

23 characters6 tokens