Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#068 · needle at 8% depth#069 · needle at 77% depth#070 · needle at 38% depth#071 · needle at 65% depth#072 · needle at 34% depth#073 · needle at 2% depth#074 · needle at 84% depth#075 · needle at 34% depth#076 · needle at 56% depth#077 · needle at 42% depth#078 · needle at 19% depth#079 · needle at 68% depth#080 · needle at 21% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for wet-spawn is: 4357216.
One of the special magic numbers for plain-hare is: 1414786.
[… 117 lines omitted for display …]
One of the special magic numbers for doubtful-drunk is: 4431026.
One of the special magic numbers for handsome-orator is: 9472362.
One of the special magic numbers for old-boss is: 5494644.
One of the special magic numbers for short-verve is: 4587423.
One of the special magic numbers for stale-ceremony is: 2095751.
One of the special magic numbers for needless-alley is: 7567222.
One of the special magic numbers for abhorrent-ease is: 2611253.
One of the special magic numbers for crooked-servitude is: 6747840.
One of the special magic numbers for snobbish-ram is: 3077730.
One of the special magic numbers for agreeable-easel is: 1174089.
One of the special magic numbers for historical-wraparound is: 9714040.
One of the special magic numbers for nice-squirrel is: 7649320.
One of the special magic numbers for wonderful-middleman is: 1384288.
One of the special magic numbers for oafish-chop is: 4487525.
[… 9 lines omitted for display …]
One of the special magic numbers for supreme-full is: 1389380.
One of the special magic numbers for standing-jicama is: 4318995.
What is the special magic number for crooked-servitude mentioned in the provided text?
Original prompt 3,473 tokens, 146 linesShown 20 lines around the needleNeedle at 84% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2905593Aux 20156747840Ours6747840Ours, no steer.6747840PiT-FT2905593Qwen 27B6747840
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6747840.

13 characters10 tokens

Aux 2015

Found the needle

6747840.

13 characters10 tokens

PiT-FT 2015

Missed

: 7970112. The special magic number for lurch-tremor is: 8787002. The special magic number for awkward-hutch is: 7962913. The special magic number for lurch-unblinking is: 7962913. The special magic number for lurch-unblinking is: 7962913. The special magic number for lurch-unblinking is: 7962913. The special magic number for lurch-unblinking is: 7962913. The special magic number for lurch-un

402 characters128 tokens

ChronoGPT 2015

Missed

: 7290931. The special magic number for level-multimedia mentioned in the provided text is: 7290931. The special magic number for level-multimedia mentioned in the provided text is: 7290931. The special magic number for level-multimedia mentioned in the provided text is: 7290931. The special magic number for level-multimedia mentioned in the provided text is: 7290931. The special magic number for level-multimedia mentioned in the provided text is: 7290931. The special magic number for level-multimedia mentioned in

519 characters128 tokens