Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#022 · needle at 23% depth#023 · needle at 38% depth#024 · needle at 3% depth#025 · needle at 87% depth#026 · needle at 32% depth#027 · needle at 14% depth#028 · needle at 59% depth#029 · needle at 22% depth#030 · needle at 79% depth#031 · needle at 74% depth#032 · needle at 46% depth#033 · needle at 96% depth#034 · needle at 59% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for hypnotic-torso is: 4757493.
One of the special magic numbers for tough-fox is: 1936939.
[… 809 lines omitted for display …]
One of the special magic numbers for energetic-cranberry is: 3074490.
One of the special magic numbers for kind-authenticity is: 1033949.
One of the special magic numbers for macho-accusation is: 9634028.
One of the special magic numbers for stimulating-quota is: 5940979.
One of the special magic numbers for modern-spice is: 5955512.
One of the special magic numbers for wet-parameter is: 2424599.
One of the special magic numbers for pleasant-stencil is: 9268509.
One of the special magic numbers for ill-incentive is: 2341929.
One of the special magic numbers for expensive-puddle is: 2884392.
One of the special magic numbers for unbiased-graphic is: 8328367.
One of the special magic numbers for fretful-diarist is: 1776247.
One of the special magic numbers for minor-mouse is: 3290646.
One of the special magic numbers for obnoxious-start is: 6100047.
One of the special magic numbers for upset-nest is: 5080130.
[… 554 lines omitted for display …]
One of the special magic numbers for tangy-transparency is: 2670326.
One of the special magic numbers for callous-vanadyl is: 4549536.
What is the special magic number for ill-incentive mentioned in the provided text?
Original prompt 31,684 tokens, 1,383 linesShown 20 lines around the needleNeedle at 59% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4241161Aux 20153000665Ours2341929Ours, no steer.2341929PiT-FT4241161Qwen 27B2341929
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2341929.

13 characters10 tokens

Aux 2015

Found the needle

3000665.

13 characters10 tokens

PiT-FT 2015

Missed

: 8652541. The special magic number for anxious-sanguine is: 8872037. The special magic number for loutish-cane is: 8105765. The special magic number for sluggish-sauce is: 8105765. The special magic number for unbecoming-caulk is: 8872037. The special magic number for gassy-cadam is: 8872037. The special magic number for lanky-carpenter is: 8872037. The special magic number for giddy-

395 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for the-death-paper?

Answer:

Question:

What is the special magic number for the-sized-paper?

Answer:

Question:

What is the special magic number for the-sized-paper?

Answer:

Question:

What is the special magic number for the-sized-paper?

Answer:

Question:

What is the special magic number for the-sized-paper?

Question:

Answer:

428 characters128 tokens