Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

7 of 100 prompts

#093 · needle at 58% depth#094 · needle at 18% depth#095 · needle at 42% depth#096 · needle at 32% depth#097 · needle at 81% depth#098 · needle at 18% depth#099 · needle at 64% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for immense-decade is: 1454573.
One of the special magic numbers for subdued-crocodile is: 3576306.
[… 90 lines omitted for display …]
One of the special magic numbers for brash-estrogen is: 6597445.
One of the special magic numbers for idiotic-standoff is: 9163981.
One of the special magic numbers for ruddy-mesenchyme is: 2651393.
One of the special magic numbers for fluffy-neglect is: 8375413.
One of the special magic numbers for erratic-region is: 2305714.
One of the special magic numbers for hallowed-tomography is: 3803279.
One of the special magic numbers for courageous-remains is: 9019850.
One of the special magic numbers for aberrant-annual is: 3435644.
One of the special magic numbers for unbiased-availability is: 6674401.
One of the special magic numbers for macabre-manufacturer is: 3307293.
One of the special magic numbers for greedy-bitter is: 9061012.
One of the special magic numbers for spurious-vol is: 5622848.
One of the special magic numbers for workable-sensitivity is: 5228381.
One of the special magic numbers for frightened-nation is: 4294932.
[… 41 lines omitted for display …]
One of the special magic numbers for evasive-velvet is: 9999150.
One of the special magic numbers for unadvised-dolphin is: 9803627.
What is the special magic number for aberrant-annual mentioned in the provided text?
Original prompt 3,580 tokens, 151 linesShown 20 lines around the needleNeedle at 64% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6711121Aux 20153435644Ours3435644Ours, no steer.3435644PiT-FT6711121Qwen 27B3435644
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3435644.

13 characters10 tokens

Aux 2015

Missed

9366796.

13 characters10 tokens

PiT-FT 2015

Missed

: 9872076. The special magic number for awkward-bark is: 7954317. The special magic number for lanky-bark is: 7954317. The special magic number for awkward-bark is: 7954317. The special magic number for lanky-bark is: 7954317. The special magic number for lanky-bark is: 7954317. The special magic number for lanky-bark is: 7954317. The special magic number for lanky-bark is: 79543

389 characters128 tokens

ChronoGPT 2015

Missed

: 7291101.<|endoftext|>

23 characters7 tokens