Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for stale-poignance is: 2255802.
One of the special magic numbers for draconian-vampire is: 7522861.
[… 102 lines omitted for display …]
One of the special magic numbers for immense-galley is: 4552462.
One of the special magic numbers for splendid-necktie is: 4791261.
One of the special magic numbers for super-tackle is: 3175531.
One of the special magic numbers for daily-pile is: 5423777.
One of the special magic numbers for cultured-legal is: 7041197.
One of the special magic numbers for pretty-cravat is: 9000939.
One of the special magic numbers for odd-still is: 4044361.
One of the special magic numbers for sordid-evidence is: 6386017.
One of the special magic numbers for optimal-ad is: 8653560.
One of the special magic numbers for gamy-advancement is: 7075230.
One of the special magic numbers for obscene-magnitude is: 6688767.
One of the special magic numbers for anxious-denim is: 3765816.
One of the special magic numbers for clever-topsail is: 9743710.
One of the special magic numbers for reminiscent-application is: 6775975.
[… 29 lines omitted for display …]
One of the special magic numbers for relieved-sepal is: 2145016.
One of the special magic numbers for real-violation is: 9670140.
What is the special magic number for sordid-evidence mentioned in the provided text?
Original prompt 3,576 tokens, 151 linesShown 20 lines around the needleNeedle at 72% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6811782Aux 20156386017Ours6386017Ours, no steer.6386017PiT-FT6811782Qwen 27B6386017
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6386017.

13 characters10 tokens

Aux 2015

Found the needle

6386017.

13 characters10 tokens

PiT-FT 2015

Missed

: 8577572. The special magic number for awkward-snowball is: 8577572. The special magic number for dubious-snowball is: 8577572. The special magic number for awkward-snowball is: 8577572. The special magic number for dubious-snowball is: 8577572. The special magic number for awkward-snowball is: 8577572. The special magic number for dubious-snowball is: 8577572. The special magic number for awkward-snowball is: 8

423 characters128 tokens

ChronoGPT 2015

Missed

: 7490106.<|endoftext|>

23 characters7 tokens