Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#011 · needle at 39% depth#012 · needle at 77% depth#013 · needle at 83% depth#014 · needle at 78% depth#015 · needle at 63% depth#016 · needle at 97% depth#017 · needle at 48% depth#018 · needle at 31% depth#019 · needle at 49% depth#020 · needle at 74% depth#021 · needle at 4% depth#022 · needle at 15% depth#023 · needle at 66% depth

Nearby prompts. All 100 Multi-key · 64K prompts

PromptRULER niah_multikey_2 ·65,536 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for noiseless-danger is: 5932661.
One of the special magic numbers for oceanic-sanctuary is: 6471411.
[… 1,355 lines omitted for display …]
One of the special magic numbers for hellish-grandparent is: 9767882.
One of the special magic numbers for protective-mambo is: 7533639.
One of the special magic numbers for ruddy-evidence is: 6268759.
One of the special magic numbers for shocking-preserves is: 2837871.
One of the special magic numbers for helpless-realm is: 1322889.
One of the special magic numbers for alive-electronics is: 3125572.
One of the special magic numbers for cool-bootee is: 4308963.
One of the special magic numbers for offbeat-jailhouse is: 5785249.
One of the special magic numbers for cagey-hub is: 9934722.
One of the special magic numbers for super-hip is: 7214345.
One of the special magic numbers for glorious-atelier is: 2425680.
One of the special magic numbers for jaded-acceptance is: 7696260.
One of the special magic numbers for historical-eaves is: 7692210.
One of the special magic numbers for woebegone-leap is: 9611309.
[… 1,470 lines omitted for display …]
One of the special magic numbers for huge-toad is: 7735988.
One of the special magic numbers for noisy-feedback is: 7111401.
What is the special magic number for offbeat-jailhouse mentioned in the provided text?
Original prompt 64,991 tokens, 2,845 linesShown 20 lines around the needleNeedle at 48% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2600007Aux 20158488663Ours5785249Ours, no steer.5785249PiT-FT2600007Qwen 27B5785249
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

5785249.

13 characters10 tokens

Aux 2015

Missed

4241193.

13 characters10 tokens

PiT-FT 2015

Missed

: 77415. The special magic number for the most important-sauce is: 8692028. The special magic number for the most common-sauce is: 8692028. The special magic number for the most common-sauce is: 8692028. The special magic number for the most common-sauce is: 8692028. The special magic number for the most common-sauce is: 8692028. The special magic number for the most common-sauce is: 8692028. The special

414 characters128 tokens

ChronoGPT 2015

Missed

: The special magic number for melancholic-cocoa is: The special magic number for rambunctious-cocoa is: The special Magic Number number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided text is: The special Magic number for the provided

561 characters128 tokens