Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#055 · needle at 22% depth#056 · needle at 6% depth#057 · needle at 92% depth#058 · needle at 81% depth#059 · needle at 99% depth#060 · needle at 37% depth#061 · needle at 93% depth#062 · needle at 33% depth#063 · needle at 6% depth#064 · needle at 85% depth#065 · needle at 1% depth#066 · needle at 42% depth#067 · needle at 0% depth

Nearby prompts. All 100 Multi-key · 128K prompts

PromptRULER niah_multikey_2 ·131,072 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for fancy-shark is: 1068798.
One of the special magic numbers for toothsome-comics is: 9609027.
[… 5,290 lines omitted for display …]
One of the special magic numbers for knotty-spume is: 2555906.
One of the special magic numbers for black-beam is: 4125655.
One of the special magic numbers for substantial-readiness is: 3425620.
One of the special magic numbers for lush-castanet is: 2313761.
One of the special magic numbers for pleasant-bulb is: 7231384.
One of the special magic numbers for blue-step is: 7600352.
One of the special magic numbers for charming-alfalfa is: 8458599.
One of the special magic numbers for wiry-cent is: 8896757.
One of the special magic numbers for wise-coal is: 7209169.
One of the special magic numbers for tasteless-mink is: 4851252.
One of the special magic numbers for obtainable-vanity is: 4545654.
One of the special magic numbers for late-crown is: 7894199.
One of the special magic numbers for languid-brass is: 8828368.
One of the special magic numbers for helpful-pita is: 8600641.
[… 408 lines omitted for display …]
One of the special magic numbers for wrathful-formicarium is: 9102388.
One of the special magic numbers for young-cartoon is: 1305640.
What is the special magic number for wiry-cent mentioned in the provided text?
Original prompt 130,373 tokens, 5,718 linesShown 20 lines around the needleNeedle at 93% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT3484882Aux 20152442341Ours8896757Ours, no steer.8896757PiT-FT3484882Qwen 27B8896757
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

8896757.

13 characters10 tokens

Aux 2015

Missed

5836166.

13 characters10 tokens

PiT-FT 2015

Missed
 [] []. What number is the special magic number for the following data?
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[] []
[
205 characters128 tokens

ChronoGPT 2015

Missed

:

Sat:

The special Epicurean-letter for rambunctious-cans is:

Stupid-cans is:

Quicky-cans is:

Quicky-rays is:

Quicky-rays is:

Quicky-rays is:

Quicky-reversal is:

Quicky-reversals is:

Quicky-reversals is:

Quicky-reversals is:

291 characters128 tokens