Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

9 of 100 prompts

#091 · needle at 22% depth#092 · needle at 22% depth#093 · needle at 82% depth#094 · needle at 59% depth#095 · needle at 99% depth#096 · needle at 93% depth#097 · needle at 9% depth#098 · needle at 86% depth#099 · needle at 62% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for attractive-pendulum is: 2919149.
One of the special magic numbers for thirsty-processing is: 3466581.
[… 258 lines omitted for display …]
One of the special magic numbers for childlike-amenity is: 3886128.
One of the special magic numbers for voiceless-public is: 9137450.
One of the special magic numbers for cautious-madam is: 5978187.
One of the special magic numbers for upset-ceramic is: 6565173.
One of the special magic numbers for tough-civilian is: 8390220.
One of the special magic numbers for fat-broiler is: 8870092.
One of the special magic numbers for evasive-hardening is: 5398330.
One of the special magic numbers for gigantic-descent is: 1304118.
One of the special magic numbers for ugliest-desire is: 5168787.
One of the special magic numbers for tacky-grandfather is: 2193693.
One of the special magic numbers for massive-murder is: 2348774.
One of the special magic numbers for joyous-washer is: 5963750.
One of the special magic numbers for draconian-goodness is: 4752966.
One of the special magic numbers for funny-pitch is: 8668205.
[… 2,567 lines omitted for display …]
One of the special magic numbers for flat-consulting is: 8807262.
One of the special magic numbers for joyous-neuropathologist is: 4276668.
What is the special magic number for gigantic-descent mentioned in the provided text?
Original prompt 65,009 tokens, 2,845 linesShown 20 lines around the needleNeedle at 9% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4145048Aux 20155656134Ours1304118Ours, no steer.1304118PiT-FT4145048Qwen 27B1304118
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

1304118.

13 characters10 tokens

Aux 2015

Missed

7713942.

13 characters10 tokens

PiT-FT 2015

Missed

: 7102370. The special magic number for sluggish-sauce is: 7102370. The special magic number for icky-sugar is: 7102370. The special magic number for gassy-sapital is: 7102370. The special magic number for icky-sulph is: 7102370. The special magic number for loutish-coconut is: 7102370. The special magic number for wiry-sint is: 7102370. The special magic number for dapper-s

384 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number forogeneity-of-the-year is: The special magic number for raspy-letter is: The special magic number for rambunctious-letter is: The special magic number for rambunctious-letter is: The special magic number for raspy-letter is: The special magic number for rambunctious-letter is: The special magic number for raspy-letter is: The special magic number for raspy-letter is: The special magic number for raspy-letter is: The special magic number

468 characters128 tokens