Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

10 of 100 prompts

#090 · needle at 14% depth#091 · needle at 64% depth#092 · needle at 44% depth#093 · needle at 39% depth#094 · needle at 37% depth#095 · needle at 92% depth#096 · needle at 5% depth#097 · needle at 62% depth#098 · needle at 89% depth#099 · needle at 32% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for lovely-generator is: 3806016.
One of the special magic numbers for voiceless-balcony is: 3836327.
[… 63 lines omitted for display …]
One of the special magic numbers for undesirable-vibrissae is: 3124704.
One of the special magic numbers for yellow-linen is: 1707799.
One of the special magic numbers for functional-defendant is: 2769389.
One of the special magic numbers for pointless-earthworm is: 2644433.
One of the special magic numbers for inquisitive-chairman is: 1353793.
One of the special magic numbers for successful-counselor is: 2990791.
One of the special magic numbers for terrible-lookout is: 6070874.
One of the special magic numbers for wistful-collateral is: 3059336.
One of the special magic numbers for freezing-terrace is: 9072247.
One of the special magic numbers for delicious-disclosure is: 3265686.
One of the special magic numbers for amused-CD is: 9559457.
One of the special magic numbers for illustrious-invasion is: 5777545.
One of the special magic numbers for half-email is: 4801711.
One of the special magic numbers for thundering-high is: 9805893.
[… 1,325 lines omitted for display …]
One of the special magic numbers for lonely-formal is: 5764912.
One of the special magic numbers for funny-stinger is: 3377348.
What is the special magic number for wistful-collateral mentioned in the provided text?
Original prompt 32,232 tokens, 1,408 linesShown 20 lines around the needleNeedle at 5% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT4570127Aux 20155764912Ours3059336Ours, no steer.3059336PiT-FT4570127Qwen 27B3059336
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

3059336.

13 characters10 tokens

Aux 2015

Missed

4723656.

13 characters10 tokens

PiT-FT 2015

Missed

: 7059610. The special magic number for the most popular-sauce is: 8012061. The special magic number for the least popular-sauce is: 8012061. The special magic number for the most popular-sauce is: 8012061. The special magic number for the least popular-sauce is: 8012061. The special magic number for the most popular-sauce is: 8012061. The special magic number for the least popular-sauce is: 8012061. The

414 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for soggy-nostalgia?

Answer:

Question:

What is the special magic number for soggy-nostalgia?

Answer:

Question:

What is the special magic number for soggy-nostalgia?

Response:

The special magic number for soggy-nostalgia is:

Question:

What is the special magic number for soggy-nostalgia?

Question:

What is the special magic number for

419 characters128 tokens