Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#039 · needle at 18% depth#040 · needle at 51% depth#041 · needle at 21% depth#042 · needle at 55% depth#043 · needle at 61% depth#044 · needle at 24% depth#045 · needle at 16% depth#046 · needle at 69% depth#047 · needle at 54% depth#048 · needle at 39% depth#049 · needle at 15% depth#050 · needle at 41% depth#051 · needle at 82% depth

Nearby prompts. All 100 Multi-key · 32K prompts

PromptRULER niah_multikey_2 ·32,768 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for fragile-condor is: 7136972.
One of the special magic numbers for testy-timing is: 3757684.
[… 221 lines omitted for display …]
One of the special magic numbers for shivering-software is: 8620858.
One of the special magic numbers for skillful-malnutrition is: 2835324.
One of the special magic numbers for light-schema is: 2978562.
One of the special magic numbers for defiant-activist is: 5917526.
One of the special magic numbers for barbarous-weasel is: 2517594.
One of the special magic numbers for ignorant-carrier is: 9566127.
One of the special magic numbers for different-veldt is: 2483870.
One of the special magic numbers for flaky-vomit is: 6726423.
One of the special magic numbers for energetic-fantasy is: 4203199.
One of the special magic numbers for amused-mythology is: 8847420.
One of the special magic numbers for hapless-gum is: 9971289.
One of the special magic numbers for exuberant-babe is: 8532064.
One of the special magic numbers for tangy-burrito is: 9698292.
One of the special magic numbers for homely-afterlife is: 8342731.
[… 1,167 lines omitted for display …]
One of the special magic numbers for powerful-clogs is: 1685819.
One of the special magic numbers for jealous-licensing is: 4536291.
What is the special magic number for flaky-vomit mentioned in the provided text?
Original prompt 32,221 tokens, 1,408 linesShown 20 lines around the needleNeedle at 16% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9536119Aux 20151595955Ours6726423Ours, no steer.6726423PiT-FT9536119Qwen 27B6726423
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6726423.

13 characters10 tokens

Aux 2015

Missed

9421551.

13 characters10 tokens

PiT-FT 2015

Missed

: 8870038. The special magic number for icky-carnivy is: 8870038. The special magic number for icky-sauce is: 8870038. The special magic number for icky-turtle is: 8870038. The special magic number for icky-turtle is: 8870038. The special magic number for icky-turtle is: 8870038. The special magic number for icky-turtle is: 8870038. The special magic number for icky-turtle

382 characters128 tokens

ChronoGPT 2015

Missed

:

Question:

What is the special magic number for soggy-bitter?

Answer:

Question:

What is the special magic number for soggy-bitter?

Answer:

Question:

What is the special magic number for soggy-carp?

Answer:

Question:

What is the special magic number for soggy-coconut?

Answer:

Question:

What is the special magic number for soggy-pesticane?

Question

400 characters128 tokens