Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

9 of 100 prompts

#091 · needle at 23% depth#092 · needle at 46% depth#093 · needle at 43% depth#094 · needle at 81% depth#095 · needle at 73% depth#096 · needle at 95% depth#097 · needle at 78% depth#098 · needle at 43% depth#099 · needle at 1% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for precious-planula is: 6264699.
One of the special magic numbers for peaceful-fitness is: 7664423.
[… 530 lines omitted for display …]
One of the special magic numbers for obtainable-archaeologist is: 2005349.
One of the special magic numbers for cowardly-evening-wear is: 9404104.
One of the special magic numbers for finicky-grape is: 6033917.
One of the special magic numbers for rich-lookout is: 1015589.
One of the special magic numbers for understood-pinto is: 8418487.
One of the special magic numbers for moaning-simvastatin is: 5052416.
One of the special magic numbers for endurable-julienne is: 5995994.
One of the special magic numbers for elated-solidarity is: 4575860.
One of the special magic numbers for drunk-tote is: 3111992.
One of the special magic numbers for ambitious-nectarine is: 5187814.
One of the special magic numbers for eminent-force is: 1657456.
One of the special magic numbers for standing-disadvantage is: 1897226.
One of the special magic numbers for ugly-peace is: 2561767.
One of the special magic numbers for glib-discrimination is: 6285129.
[… 140 lines omitted for display …]
One of the special magic numbers for slow-moonshine is: 1227418.
One of the special magic numbers for tawdry-crunch is: 6834342.
What is the special magic number for endurable-julienne mentioned in the provided text?
Original prompt 15,864 tokens, 690 linesShown 20 lines around the needleNeedle at 78% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3617780Aux 20158861300Ours5995994Ours, no steer.5995994PiT-FT3617780Qwen 27B5995994
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5995994.

13 characters10 tokens

Aux 2015

Missed

7488795.

13 characters10 tokens

PiT-FT 2015

Missed

: 8872214. The special magic number for the most popular-sugar is: 8872214. The special magic number for the most common-sugar is: 8872214. The special magic number for the most common-sugar is: 8872214. The special magic number for the most common-sugar is: 8872214. The special magic number for the most common-sugar is: 8872214. The special magic number for the most common-sugar is: 8872214. The special magic number for the most

440 characters128 tokens

ChronoGPT 2015

Missed

: 7384861.<|endoftext|>

23 characters7 tokens