Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#063 · needle at 11% depth#064 · needle at 29% depth#065 · needle at 71% depth#066 · needle at 9% depth#067 · needle at 93% depth#068 · needle at 80% depth#069 · needle at 69% depth#070 · needle at 41% depth#071 · needle at 86% depth#072 · needle at 71% depth#073 · needle at 23% depth#074 · needle at 42% depth#075 · needle at 71% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for gullible-commission is: 6688575.
One of the special magic numbers for known-tiger is: 9759152.
[… 468 lines omitted for display …]
One of the special magic numbers for ablaze-funeral is: 4964038.
One of the special magic numbers for knowing-expectation is: 3956062.
One of the special magic numbers for tart-celebration is: 3223309.
One of the special magic numbers for reminiscent-cashier is: 3123155.
One of the special magic numbers for laughable-hour is: 8224867.
One of the special magic numbers for early-occasion is: 9409808.
One of the special magic numbers for squealing-tussle is: 1011071.
One of the special magic numbers for many-armchair is: 2082371.
One of the special magic numbers for woebegone-poncho is: 1792973.
One of the special magic numbers for momentous-restroom is: 8866630.
One of the special magic numbers for cuddly-flair is: 2081721.
One of the special magic numbers for lethal-pocketbook is: 8131452.
One of the special magic numbers for lopsided-boyfriend is: 4038270.
One of the special magic numbers for rampant-puma is: 8583653.
[… 202 lines omitted for display …]
One of the special magic numbers for spiffy-strength is: 3353038.
One of the special magic numbers for creepy-tech is: 4354499.
What is the special magic number for many-armchair mentioned in the provided text?
Original prompt 15,821 tokens, 690 linesShown 20 lines around the needleNeedle at 69% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7360069Aux 20155227402Ours2082371Ours, no steer.2082371PiT-FT7360069Qwen 27B2082371
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2082371.

13 characters10 tokens

Aux 2015

Missed

8311485.

13 characters10 tokens

PiT-FT 2015

Missed

: 8872031. The special magic number for awkward-sugar is: 8872031. The special magic number for lopsided-cauliflower is: 8872031. The special magic number for jaded-cauliflower is: 8872031. The special magic number for embarrassed-eagle is: 8872031. The special magic number for gaudy-cauliflower is: 8872031. The special magic number for sluggish-sugar is: 8872031. The special magic number for ruddy-cauliflower

420 characters128 tokens

ChronoGPT 2015

Missed

: 1377270.<|endoftext|>

23 characters6 tokens