Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#044 · needle at 24% depth#045 · needle at 16% depth#046 · needle at 69% depth#047 · needle at 54% depth#048 · needle at 39% depth#049 · needle at 15% depth#050 · needle at 41% depth#051 · needle at 82% depth#052 · needle at 72% depth#053 · needle at 50% depth#054 · needle at 98% depth#055 · needle at 88% depth#056 · needle at 59% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for imported-anniversary is: 3254608.
One of the special magic numbers for juicy-patron is: 5215494.
[… 564 lines omitted for display …]
One of the special magic numbers for possessive-charlatan is: 5604932.
One of the special magic numbers for futuristic-planet is: 9513596.
One of the special magic numbers for boring-afterthought is: 3773630.
One of the special magic numbers for thirsty-dissonance is: 7037550.
One of the special magic numbers for pumped-instrumentation is: 8598827.
One of the special magic numbers for evanescent-lawsuit is: 6242360.
One of the special magic numbers for belligerent-pigeon is: 4897089.
One of the special magic numbers for blue-offset is: 1354766.
One of the special magic numbers for poised-swivel is: 2920965.
One of the special magic numbers for makeshift-cleavage is: 9059888.
One of the special magic numbers for feigned-mallard is: 2197189.
One of the special magic numbers for burly-celebration is: 8743461.
One of the special magic numbers for hot-depot is: 2686690.
[… 800 lines omitted for display …]
One of the special magic numbers for scarce-microwave is: 8745096.
One of the special magic numbers for absurd-carbon is: 9970034.
What is the special magic number for belligerent-pigeon mentioned in the provided text?
Original prompt 31,665 tokens, 1,383 linesShown 19 lines around the needleNeedle at 41% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3675962Aux 20153095970Ours4897089Ours, no steer.4897089PiT-FT3675962Qwen 27B4897089
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

4897089.

13 characters10 tokens

Aux 2015

Missed

7603280.

13 characters10 tokens

PiT-FT 2015

Missed

: 709569. The special magic number for anxious-sail is: 7053903. The special magic number for sluggish-sauce is: 7053903. The special magic number for gregarious-sirg is: 7053903. The special magic number for gregarious-giraffe is: 7053903. The special magic number for lachry-pip is: 7053903. The special magic number for lachry-pip is: 7053903. The special magic number for lachry

389 characters128 tokens

ChronoGPT 2015

Missed

: 18781111.<|endoftext|>

24 characters6 tokens