Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#009 · needle at 99% depth#010 · needle at 16% depth#011 · needle at 15% depth#012 · needle at 72% depth#013 · needle at 74% depth#014 · needle at 22% depth#015 · needle at 93% depth#016 · needle at 14% depth#017 · needle at 61% depth#018 · needle at 68% depth#019 · needle at 29% depth#020 · needle at 37% depth#021 · needle at 81% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for freezing-tam-o'-shanter is: 2152241.
One of the special magic numbers for hospitable-labor is: 6834765.
[… 5,324 lines omitted for display …]
One of the special magic numbers for deafening-cemetery is: 6003230.
One of the special magic numbers for thoughtless-tepee is: 5342933.
One of the special magic numbers for substantial-hedge is: 4475461.
One of the special magic numbers for watchful-decision is: 7391930.
One of the special magic numbers for satisfying-silkworm is: 6783618.
One of the special magic numbers for tricky-brush is: 5188415.
One of the special magic numbers for observant-anticipation is: 8816142.
One of the special magic numbers for devilish-conductor is: 4017777.
One of the special magic numbers for oafish-crunch is: 3306797.
One of the special magic numbers for debonair-seat is: 3781017.
One of the special magic numbers for highfalutin-shot is: 9231994.
One of the special magic numbers for placid-cricket is: 8581330.
One of the special magic numbers for bawdy-sunday is: 8367901.
[… 375 lines omitted for display …]
One of the special magic numbers for burly-capon is: 6661577.
One of the special magic numbers for deeply-pianist is: 4809282.
What is the special magic number for observant-anticipation mentioned in the provided text?
Original prompt 130,368 tokens, 5,718 linesShown 19 lines around the needleNeedle at 93% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT8962290Aux 20155222034Ours8816142Ours, no steer.8816142PiT-FT8962290Qwen 27B8816142
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8816142.

13 characters10 tokens

Aux 2015

Missed

5443428.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. What number should I use instead?
[url] The special magic number for the giddy-gourd is the one that I used before.
[url] The special magic number for the waggish-tug is the one that I used before.
[url] The special magic number for the snotty-sulph is the one that I used before.
[url] The special magic number for the giddy-gourd is the one that I used before.
[url] The special magic number for the waggish-gourd is the one
434 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean number for the most common type of food-

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-cans is:

Stupid-

310 characters128 tokens