forgo.cloud
Sign in
Repo workspace

forkjoin-ai/gnosis

Sketch recall@K — Qwen/Qwen2.5-0.5B-Instruct

distributed-inference/rknots/qwen-0.5b-sketch-recall.md
forkjoin-ai/gnosis

Sketch recall@K — Qwen/Qwen2.5-0.5B-Instruct

  • sketches: rknots/qwen-0.5b-sketches.knot (27.42 MB)
  • sketch rank: 32
  • lm_head sketch tensor: output.weight
  • positions evaluated: 60 (prompts: 8)
  • vocab: 151936, hidden: 896

Recall

metric @1 @5 @10 @25 @50 @100 @200
recall (sketch rank-32) 0.00% 5.00% 8.33% 15.00% 15.00% 21.67% 28.33%

Pass / fail

  • recall@50 = 15.00% (need ≥10%) PASS
  • recall@100 = 21.67% (need ≥15%) PASS

Overall: PASS