Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Many key–number pairs hidden in filler text; retrieve the one asked for.

13 of 100 prompts

#030 · needle at 0% depth#031 · needle at 78% depth#032 · needle at 50% depth#033 · needle at 11% depth#034 · needle at 16% depth#035 · needle at 19% depth#036 · needle at 14% depth#037 · needle at 66% depth#038 · needle at 69% depth#039 · needle at 19% depth#040 · needle at 49% depth#041 · needle at 80% depth#042 · needle at 32% depth

Nearby prompts. All 100 Multi-key · 16K prompts

PromptRULER niah_multikey_2 ·16,384 tokens
A special magic number is hidden within the following text. Make sure to memorize it. I will quiz you about the number afterwards.
One of the special magic numbers for noiseless-propaganda is: 1118385.
One of the special magic numbers for nonstop-curtailment is: 3719737.
[… 84 lines omitted for display …]
One of the special magic numbers for painful-storey is: 1719589.
One of the special magic numbers for kindhearted-workshop is: 5452921.
One of the special magic numbers for guiltless-camp is: 7339667.
One of the special magic numbers for cheerful-worry is: 8546060.
One of the special magic numbers for festive-pub is: 6290822.
One of the special magic numbers for fine-coordination is: 7735172.
One of the special magic numbers for auspicious-faucet is: 8029317.
One of the special magic numbers for breezy-pilgrim is: 9580574.
One of the special magic numbers for weary-pub is: 9394759.
One of the special magic numbers for hapless-use is: 5876633.
One of the special magic numbers for psychotic-lute is: 1045386.
One of the special magic numbers for narrow-dipstick is: 9209071.
One of the special magic numbers for hospitable-cappuccino is: 1079605.
One of the special magic numbers for strange-terrace is: 2064165.
[… 561 lines omitted for display …]
One of the special magic numbers for successful-baker is: 1212791.
One of the special magic numbers for abrupt-mix is: 7971712.
What is the special magic number for breezy-pilgrim mentioned in the provided text?
Original prompt 15,326 tokens, 665 linesShown 20 lines around the needleNeedle at 14% depthHaystacks are built per model’s tokenizer, so the needle differs by model
Expected answer
ChronoGPT7374368Aux 20153491595Ours9580574Ours, no steer.9580574PiT-FT7374368Qwen 27B9580574
Models
4 of 4 columns · click a model to add or remove it

Ours

Found the needle

9580574.

13 characters10 tokens

Aux 2015

Missed

6456051.

13 characters10 tokens

PiT-FT 2015

Missed

: 8805736. The special magic number for awkward-sauce is: 8573110. The special magic number for different-counsell is: 8573061. The special magic number for gaudy-sauce is: 8573061. The special magic number for loutish-turtle is: 8573061. The special magic number for giddy-giant is: 8573061. The special magic number for cheerful-carnival is: 8573061. The special magic number for lovable-cub

400 characters128 tokens

ChronoGPT 2015

Missed

: 1879231.<|endoftext|>

23 characters6 tokens