Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

Nearby prompts. All 100 Multi-key · 8K prompts

PromptRULER niah_multikey_2 ·8,192 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for tasteless-passage is: 3100760.
One of the special magic numbers for husky-weekender is: 6764699.
[… 18 lines omitted for display …]
One of the special magic numbers for fast-heirloom is: 4969425.
One of the special magic numbers for supreme-broom is: 3264229.
One of the special magic numbers for evasive-velvet is: 9999150.
One of the special magic numbers for unadvised-dolphin is: 9803627.
One of the special magic numbers for madly-reduction is: 3312348.
One of the special magic numbers for detailed-tambour is: 7008785.
One of the special magic numbers for threatening-chainstay is: 5242695.
One of the special magic numbers for needy-pride is: 6753656.
One of the special magic numbers for nasty-information is: 9405268.
One of the special magic numbers for nappy-bandanna is: 4132574.
One of the special magic numbers for shocking-freak is: 7916907.
One of the special magic numbers for nice-saloon is: 2457547.
One of the special magic numbers for axiomatic-province is: 4802646.
One of the special magic numbers for languid-screwdriver is: 7735114.
[… 292 lines omitted for display …]
One of the special magic numbers for wrong-photograph is: 3548305.
One of the special magic numbers for frail-instinct is: 5087983.
What is the special magic number for needy-pride mentioned in the provided text?
Original prompt 7,671 tokens, 330 linesShown 20 lines around the needleNeedle at 9% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT2557710Aux 20156753656Ours6753656Ours, no steer.6753656PiT-FT2557710Qwen 27B6753656
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

6753656.

13 characters10 tokens

Aux 2015

Found the needle

6753656.

13 characters10 tokens

PiT-FT 2015

Missed

: 7153707. The special magic number for awkward-creek mentioned in the provided text is: 7153707. The special magic number for jaded-bark is: 7558976. The special magic number for livid-bark is: 7558976. The special magic number for awkward-bark is: 7153707. The special magic number for jaded-bark is: 7153707. The special magic number for livid-bark is: 7153707. The special magic number for jaded-bark

411 characters128 tokens

ChronoGPT 2015

Missed

: 7458411.<|endoftext|>

23 characters7 tokens