Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

12 of 100 prompts

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for disagreeable-gang is: 6765079.
One of the special magic numbers for flagrant-draft is: 6259356.
[… 73 lines omitted for display …]
One of the special magic numbers for delightful-gazelle is: 1247041.
One of the special magic numbers for prickly-leave is: 4643811.
One of the special magic numbers for jagged-tip is: 8050508.
One of the special magic numbers for humorous-glen is: 9361693.
One of the special magic numbers for literate-gateway is: 8779334.
One of the special magic numbers for wakeful-anxiety is: 1532460.
One of the special magic numbers for incandescent-journey is: 2345920.
One of the special magic numbers for black-decryption is: 2327277.
One of the special magic numbers for deep-processor is: 1940167.
One of the special magic numbers for gorgeous-party is: 7583744.
One of the special magic numbers for black-ecology is: 8887754.
One of the special magic numbers for easy-ozone is: 4224451.
One of the special magic numbers for fuzzy-example is: 7401806.
One of the special magic numbers for abrasive-oat is: 3046175.
[… 53 lines omitted for display …]
One of the special magic numbers for abusive-chicken is: 7108168.
One of the special magic numbers for symptomatic-bustle is: 5006173.
What is the special magic number for black-decryption mentioned in the provided text?
Original prompt 3,450 tokens, 146 linesShown 20 lines around the needleNeedle at 55% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT9785019Aux 20157790959Ours2327277Ours, no steer.2327277PiT-FT9785019Qwen 27B2327277
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2327277.

13 characters10 tokens

Aux 2015

Found the needle

7790959.

13 characters10 tokens

PiT-FT 2015

Missed

: 8385078. The special magic number for yummy-vellum mentioned in the provided text is: 8385078. The special magic number for yummy-vellum mentioned in the provided text is: 8385078. The special magic number for yummy-vellum mentioned in the provided text is: 8385078. The special magic number for yummy-vellum mentioned in the provided text is: 8385078. The special magic number for yummy-vellum mentioned in the provided text is: 8385078. The special magic number for y

477 characters128 tokens

ChronoGPT 2015

Missed

: 6491819.<|endoftext|>

23 characters7 tokens