Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#013 · needle at 83% depth#014 · needle at 78% depth#015 · needle at 63% depth#016 · needle at 97% depth#017 · needle at 48% depth#018 · needle at 31% depth#019 · needle at 49% depth#020 · needle at 74% depth#021 · needle at 4% depth#022 · needle at 15% depth#023 · needle at 66% depth#024 · needle at 95% depth#025 · needle at 26% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for ablaze-decline is: 9879267.
One of the special magic numbers for ad hoc-kamikaze is: 9732686.
[… 1,378 lines omitted for display …]
One of the special magic numbers for royal-paddock is: 2183312.
One of the special magic numbers for childlike-turnover is: 8964225.
One of the special magic numbers for abaft-boycott is: 9697040.
One of the special magic numbers for rampant-blog is: 7798162.
One of the special magic numbers for flowery-contingency is: 7167317.
One of the special magic numbers for nonchalant-skating is: 6060272.
One of the special magic numbers for fretful-info is: 7661125.
One of the special magic numbers for momentous-anywhere is: 5857011.
One of the special magic numbers for watchful-revelation is: 2593492.
One of the special magic numbers for guarded-run is: 7575813.
One of the special magic numbers for accidental-real is: 4944947.
One of the special magic numbers for thankful-cilantro is: 7978072.
One of the special magic numbers for fresh-district is: 6002553.
One of the special magic numbers for easy-lilac is: 1407507.
[… 1,447 lines omitted for display …]
One of the special magic numbers for solid-porch is: 4562679.
One of the special magic numbers for divergent-suspension is: 5401283.
What is the special magic number for momentous-anywhere mentioned in the provided text?
Original prompt 65,017 tokens, 2,845 linesShown 20 lines around the needleNeedle at 49% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4942033Aux 20157587591Ours5857011Ours, no steer.5857011PiT-FT4942033Qwen 27B5857011
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5857011.

13 characters10 tokens

Aux 2015

Found the needle

7587591.

13 characters10 tokens

PiT-FT 2015

Missed

: 8707519. The special magic number for obnoxious-giraffe is: 8707519. The special magic number for vengeful-sauerk is: 8707519. The special magic number for sluggish-sauerk is: 8707519. The special magic number for fearful-funk is: 8707519. The special magic number for impatient-pug is: 8707519. The special magic number for giddy-giraffe is: 8707519. The special magic number for loutish-caulf

403 characters128 tokens

ChronoGPT 2015

Missed

: Rounding-religion is the special magic number for rambunctious-appendage is: Rounding-religion.

W:

The special Magic Number number is:

W:

The special Magic number is:

D:

The special Magic number is:

F:

The special Magic number is:

G:

The special Magic number is:

H:

The special Magic number is:

I:

The special Magic number is:

J:

The special Magic number is:

410 characters128 tokens