Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#083 · needle at 36% depth #084 · needle at 3% depth #085 · needle at 77% depth #086 · needle at 23% depth #087 · needle at 51% depth #088 · needle at 43% depth #089 · needle at 87% depth #090 · needle at 72% depth #091 · needle at 11% depth #092 · needle at 89% depth #093 · needle at 58% depth #094 · needle at 18% depth #095 · needle at 42% depth

Nearby prompts. All 100 Multi-key · 4K prompts

PromptRULER niah_multikey_2 ·4,096 tokens

A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for humorous-transom is: 5136836.
One of the special magic numbers for black-tangerine is: 7648252.
[… 121 lines omitted for display …]
One of the special magic numbers for jagged-cabbage is: 9694175.
One of the special magic numbers for wooden-garlic is: 8249719.
One of the special magic numbers for splendid-git is: 1638146.
One of the special magic numbers for teeny-tiny-croissant is: 4093346.
One of the special magic numbers for clear-principal is: 4957974.
One of the special magic numbers for big-quality is: 2630969.
One of the special magic numbers for moaning-doubling is: 7959879.
One of the special magic numbers for debonair-toast is: 6834121.
One of the special magic numbers for sincere-artist is: 6091225.
One of the special magic numbers for mushy-aside is: 1369776.
One of the special magic numbers for dangerous-monk is: 2259739.
One of the special magic numbers for direful-star is: 5875662.
One of the special magic numbers for nice-barrel is: 8516480.
One of the special magic numbers for narrow-CD is: 5333198.
[… 5 lines omitted for display …]
One of the special magic numbers for difficult-drudgery is: 1865277.
One of the special magic numbers for orange-employer is: 5487505.
What is the special magic number for debonair-toast mentioned in the provided text?

Original prompt 3,444 tokens, 146 linesShown 20 lines around the needleNeedle at 87% depthHaystacks are built per model’s tokenizer, so the needle differs by model

Expected answer

ChronoGPT3863862Aux 20156834121Ours6834121Ours, no steer.6834121PiT-FT3863862Qwen 27B6834121

Ours

Found the needle

6834121.

Aux 2015

Found the needle

6834121.

PiT-FT 2015

Missed

: 8221617. The special magic number for awkward-barn is: 8221617. The special magic number for different-barn is: 8221617. The special magic number for different-barn is: 8221617. The special magic number for awkward-barn is: 8221617. The special magic number for different-barn is: 8221617. The special magic number for different-barn is: 8221617. The special magic number for different-barn is: 8221617. The special

ChronoGPT 2015

Missed

: 7452390.<|endoftext|>