Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

8 of 100 prompts

#092 · needle at 46% depth#093 · needle at 43% depth#094 · needle at 81% depth#095 · needle at 73% depth#096 · needle at 95% depth#097 · needle at 78% depth#098 · needle at 43% depth#099 · needle at 1% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for auspicious-resistance is: 9617552.
One of the special magic numbers for possessive-charlatan is: 5604932.
[… 275 lines omitted for display …]
One of the special magic numbers for confused-respite is: 1392983.
One of the special magic numbers for squalid-version is: 1279314.
One of the special magic numbers for observant-suite is: 5186418.
One of the special magic numbers for absent-leaver is: 1478301.
One of the special magic numbers for incompetent-subexpression is: 9648284.
One of the special magic numbers for victorious-record is: 6356508.
One of the special magic numbers for small-quill is: 9934640.
One of the special magic numbers for kindhearted-protection is: 9744828.
One of the special magic numbers for wrathful-stamp is: 6916733.
One of the special magic numbers for scarce-fatigue is: 7091135.
One of the special magic numbers for average-cameo is: 6750573.
One of the special magic numbers for stupid-scaffold is: 3130493.
One of the special magic numbers for pleasant-lysine is: 2758834.
One of the special magic numbers for quiet-doorway is: 1718437.
[… 370 lines omitted for display …]
One of the special magic numbers for silent-acetate is: 7095061.
One of the special magic numbers for wicked-analyst is: 3128141.
What is the special magic number for kindhearted-protection mentioned in the provided text?
Original prompt 15,289 tokens, 665 linesShown 20 lines around the needleNeedle at 43% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6789113Aux 20154199502Ours9744828Ours, no steer.9744828PiT-FT6789113Qwen 27B9744828
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9744828.

13 characters10 tokens

Aux 2015

Missed

6706696.

13 characters10 tokens

PiT-FT 2015

Missed

: 7593354. The special magic number for the awkward-sauerk is: 8873956. The special magic number for the dubious-sauerk is: 8873956. The special magic number for the gaudy-sauerk is: 8873956. The special magic number for the loutish-sauerk is: 8873956. The special magic number for the livid-sauerk is: 8873956. The special magic number for the lovable-sauerk is: 8873956. The

383 characters128 tokens

ChronoGPT 2015

Missed

: 7149970.<|endoftext|>

23 characters7 tokens