Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#015 · needle at 21% depth#016 · needle at 90% depth#017 · needle at 46% depth#018 · needle at 95% depth#019 · needle at 40% depth#020 · needle at 49% depth#021 · needle at 58% depth#022 · needle at 89% depth#023 · needle at 81% depth#024 · needle at 43% depth#025 · needle at 42% depth#026 · needle at 83% depth#027 · needle at 53% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for gainful-jar is: 6721861.
One of the special magic numbers for uninterested-trapezoid is: 5336203.
[… 380 lines omitted for display …]
One of the special magic numbers for swanky-honey is: 2276248.
One of the special magic numbers for thinkable-account is: 8700001.
One of the special magic numbers for dramatic-cinder is: 7441755.
One of the special magic numbers for hurt-soundness is: 2784556.
One of the special magic numbers for torpid-pecan is: 5093153.
One of the special magic numbers for womanly-evaluator is: 5407300.
One of the special magic numbers for deep-brass is: 1549475.
One of the special magic numbers for omniscient-teacher is: 7204797.
One of the special magic numbers for hungry-fraudster is: 6630516.
One of the special magic numbers for powerful-sunrise is: 9651910.
One of the special magic numbers for colorful-midline is: 5097416.
One of the special magic numbers for clever-vote is: 5882334.
One of the special magic numbers for laughable-subsidence is: 7371105.
One of the special magic numbers for dangerous-practitioner is: 7255840.
[… 265 lines omitted for display …]
One of the special magic numbers for substantial-settlement is: 1583734.
One of the special magic numbers for humorous-rhinoceros is: 8945369.
What is the special magic number for omniscient-teacher mentioned in the provided text?
Original prompt 15,298 tokens, 665 linesShown 20 lines around the needleNeedle at 58% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6184587Aux 20153266062Ours7204797Ours, no steer.7204797PiT-FT6184587Qwen 27B7204797
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

7204797.

13 characters10 tokens

Aux 2015

Missed

8680684.

13 characters10 tokens

PiT-FT 2015

Missed

: 9929109. The special magic number for awkward-sauerkraut is: 7052813. The special magic number for lanky-sauerkraut is: 7052813. The special magic number for gregarious-sauerkraut is: 7052813. The special magic number for gregarious-sauerkraut is: 7052813. The special magic number for gregarious-sauerkraut is: 7052813. The special magic number for lanky-sauerkraut is:

378 characters128 tokens

ChronoGPT 2015

Missed

: 4323521.<|endoftext|>

23 characters6 tokens