Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#008 · needle at 29% depth#009 · needle at 73% depth#010 · needle at 90% depth#011 · needle at 39% depth#012 · needle at 77% depth#013 · needle at 83% depth#014 · needle at 78% depth#015 · needle at 63% depth#016 · needle at 97% depth#017 · needle at 48% depth#018 · needle at 31% depth#019 · needle at 49% depth#020 · needle at 74% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tiny-side is: 8128375.
One of the special magic numbers for wet-total is: 8501551.
[… 2,226 lines omitted for display …]
One of the special magic numbers for abaft-lapdog is: 6457028.
One of the special magic numbers for red-swordfish is: 8421347.
One of the special magic numbers for lyrical-encyclopedia is: 1005600.
One of the special magic numbers for deep-stuff is: 2281754.
One of the special magic numbers for spotless-boar is: 3689748.
One of the special magic numbers for righteous-gravel is: 4734461.
One of the special magic numbers for tender-depressive is: 6834203.
One of the special magic numbers for shy-analogy is: 4986790.
One of the special magic numbers for crazy-softball is: 9790844.
One of the special magic numbers for eminent-noir is: 4617571.
One of the special magic numbers for high-guitarist is: 5118315.
One of the special magic numbers for overrated-trainer is: 6067186.
One of the special magic numbers for sticky-goodwill is: 8538513.
One of the special magic numbers for talented-graphic is: 2016380.
[… 599 lines omitted for display …]
One of the special magic numbers for gigantic-wildebeest is: 1683891.
One of the special magic numbers for hellish-locomotive is: 9639952.
What is the special magic number for shy-analogy mentioned in the provided text?
Original prompt 64,966 tokens, 2,845 linesShown 20 lines around the needleNeedle at 78% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6394470Aux 20156862703Ours4986790Ours, no steer.4986790PiT-FT6394470Qwen 27B4986790
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4986790.

13 characters10 tokens

Aux 2015

Missed

2849523.

13 characters10 tokens

PiT-FT 2015

Missed

: 8706969. The special magic number for obnoxious-saucer is: 8692056. The special magic number for sluggish-sauce is: 7692056. The special magic number for ethereal-bauge is: 8293072. The special magic number for giddy-saucer is: 8692056. The special magic number for icky-saucer is: 8692056. The special magic number for giddy-pug is: 8692056. The special magic number for icky-sap

389 characters128 tokens

ChronoGPT 2015

Missed

: The special Magic Number number for half-in-the-world is: The special Magic number for half-in-the-world is: The special Magic number for allin is: The special Magic number for allin is: The special Magic number for allin is: The special Magic number for allin is: The special Magic number for allin is: The special Magic number for allin is: The special Magic number for allin is: The special Magic number for allin is: The special Magic number for allin is: The special Magic number for

490 characters128 tokens