Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#043 · needle at 42% depth#044 · needle at 58% depth#045 · needle at 40% depth#046 · needle at 79% depth#047 · needle at 28% depth#048 · needle at 73% depth#049 · needle at 53% depth#050 · needle at 27% depth#051 · needle at 18% depth#052 · needle at 63% depth#053 · needle at 39% depth#054 · needle at 26% depth#055 · needle at 30% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for frantic-trellis is: 1869328.
One of the special magic numbers for frightened-stucco is: 5914460.
[… 360 lines omitted for display …]
One of the special magic numbers for large-billion is: 4643790.
One of the special magic numbers for threatening-card is: 9892513.
One of the special magic numbers for helpful-millisecond is: 9003166.
One of the special magic numbers for muddled-sidestream is: 3892241.
One of the special magic numbers for faithful-likelihood is: 7569574.
One of the special magic numbers for dead-proctor is: 3573213.
One of the special magic numbers for receptive-inquiry is: 9605449.
One of the special magic numbers for misty-evidence is: 4382792.
One of the special magic numbers for demonic-flick is: 7316069.
One of the special magic numbers for toothsome-waterbed is: 1960493.
One of the special magic numbers for overrated-dynamics is: 3056806.
One of the special magic numbers for flat-comic is: 6338463.
One of the special magic numbers for pastoral-lobster is: 7418116.
One of the special magic numbers for minor-proposal is: 5980237.
[… 310 lines omitted for display …]
One of the special magic numbers for straight-seaplane is: 2792397.
One of the special magic numbers for zany-planning is: 8252206.
What is the special magic number for misty-evidence mentioned in the provided text?
Original prompt 15,848 tokens, 690 linesShown 20 lines around the needleNeedle at 53% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6936500Aux 20155860442Ours4382792Ours, no steer.4382792PiT-FT6936500Qwen 27B4382792
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4382792.

13 characters10 tokens

Aux 2015

Missed

4652726.

13 characters10 tokens

PiT-FT 2015

Missed

: 7902270. The special magic number for cheerful-carnival is: 7551032. The special magic number for icky-tender is: 7561234. The special magic number for icky-tender is: 7561234. The special magic number for icky-tender is: 7561234. The special magic number for icky-tender is: 7561234. The special magic number for icky-tender is: 7561234. The special magic number for icky-tender is: 7

394 characters128 tokens

ChronoGPT 2015

Missed

: 7492750.<|endoftext|>

23 characters7 tokens