Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#031 · needle at 74% depth#032 · needle at 46% depth#033 · needle at 96% depth#034 · needle at 59% depth#035 · needle at 2% depth#036 · needle at 35% depth#037 · needle at 4% depth#038 · needle at 12% depth#039 · needle at 18% depth#040 · needle at 51% depth#041 · needle at 21% depth#042 · needle at 55% depth#043 · needle at 61% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for fine-ketchup is: 7111972.
One of the special magic numbers for minor-coordination is: 3840964.
[… 39 lines omitted for display …]
One of the special magic numbers for aboriginal-skeleton is: 8537133.
One of the special magic numbers for kindhearted-dictionary is: 8496539.
One of the special magic numbers for wealthy-tom-tom is: 9730014.
One of the special magic numbers for abiding-stuff is: 7948916.
One of the special magic numbers for excited-marsh is: 2337807.
One of the special magic numbers for petite-fat is: 9093563.
One of the special magic numbers for resolute-laundry is: 4691399.
One of the special magic numbers for gentle-weeder is: 7478897.
One of the special magic numbers for vivacious-auto is: 6568665.
One of the special magic numbers for nifty-blow is: 4345567.
One of the special magic numbers for smelly-colt is: 3754389.
One of the special magic numbers for heavy-cake is: 3339565.
One of the special magic numbers for sordid-driveway is: 2083672.
One of the special magic numbers for wholesale-hide is: 4708995.
[… 1,324 lines omitted for display …]
One of the special magic numbers for modern-phone is: 6644967.
One of the special magic numbers for dusty-revascularization is: 2731826.
What is the special magic number for gentle-weeder mentioned in the provided text?
Original prompt 31,649 tokens, 1,383 linesShown 20 lines around the needleNeedle at 4% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4230864Aux 20156675631Ours7478897Ours, no steer.7478897PiT-FT4230864Qwen 27B7478897
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7478897.

13 characters10 tokens

Aux 2015

Missed

3519234.

13 characters10 tokens

PiT-FT 2015

Missed

: 7542434. The special magic number for the most excellent-taste is: 8571231. The special magic number for the most effective-taste is: 8571231. The special magic number for the most effective-soul is: 8571231. The special magic number for the most effective-soul is: 8571231. The special magic number for the most effective-soul is: 8571231. The special magic number for the most effective-soul is: 8571231. The special magic number for the most

453 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for furtive-marmalade mentioned in the provided text is: The special magic number for ritzy-pesticure mentioned in the provided text is: The special magic number for gaudy-pesticher is: The special magic number for ritzy-penguin mentioned in the provided text is: The special magic number for ritzy-penguin mentioned in the provided text is: The special magic number for ritzy-penguin mentioned in the provided text is: The special magic number for ritzy-p

488 characters128 tokens