Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#056 · needle at 26% depth#057 · needle at 71% depth#058 · needle at 63% depth#059 · needle at 97% depth#060 · needle at 65% depth#061 · needle at 10% depth#062 · needle at 39% depth#063 · needle at 11% depth#064 · needle at 29% depth#065 · needle at 71% depth#066 · needle at 9% depth#067 · needle at 93% depth#068 · needle at 80% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for deafening-completion is: 8688589.
One of the special magic numbers for muddy-court is: 2446994.
[… 253 lines omitted for display …]
One of the special magic numbers for kaput-drudgery is: 3943243.
One of the special magic numbers for questionable-apse is: 1343265.
One of the special magic numbers for classy-vignette is: 4088366.
One of the special magic numbers for cuddly-obedience is: 8677648.
One of the special magic numbers for brave-mother is: 2035975.
One of the special magic numbers for somber-necktie is: 1390232.
One of the special magic numbers for hypnotic-eclipse is: 6664059.
One of the special magic numbers for labored-elite is: 2395349.
One of the special magic numbers for wasteful-psychiatrist is: 5478708.
One of the special magic numbers for hallowed-stiletto is: 3047231.
One of the special magic numbers for gorgeous-chap is: 2846835.
One of the special magic numbers for elegant-chandelier is: 8956481.
One of the special magic numbers for shivering-sunshine is: 9690400.
One of the special magic numbers for filthy-enigma is: 8678738.
[… 392 lines omitted for display …]
One of the special magic numbers for talented-monument is: 6262174.
One of the special magic numbers for sassy-highland is: 4943288.
What is the special magic number for labored-elite mentioned in the provided text?
Original prompt 15,337 tokens, 665 linesShown 20 lines around the needleNeedle at 39% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT6691370Aux 20158277912Ours2395349Ours, no steer.2395349PiT-FT6691370Qwen 27B2395349
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

2395349.

13 characters10 tokens

Aux 2015

Missed

4727761.

13 characters10 tokens

PiT-FT 2015

Missed

: 8872028. The special magic number for awkward-tug is: 8872028. The special magic number for gassy-turtle is: 8872028. The special magic number for sluggish-tug is: 8872028. The special magic number for brawny-turtle is: 8872028. The special magic number for icky-carp is: 8872028. The special magic number for loutish-turtle is: 8872028. The special magic number for brawny-tug is:

390 characters128 tokens

ChronoGPT 2015

Missed

: 1457126.<|endoftext|>

23 characters6 tokens