Architecture Gallery: The context length for Qwen3 may be incorrect

[yihan35]

Regarding the context length shown in the architecture diagrams: the Qwen3-4B diagram states "41k tokens", and the Qwen3-235B-A22B diagram states "128k tokens". However, the official model card states: "Context Length: 32,768 natively and 131,072 tokens with YaRN." I would appreciate it if you could take a look and verify whether what I have pointed out is correct.

[casinca]

Hey, I remember a discussion with Daniel and Sebastian about this but it was on the reasoning-from-scratch repo, hope that helps in the meantime: rasbt/reasoning-from-scratch#42

[yihan35]

Hey, I remember a discussion with Daniel and Sebastian about this but it was on the reasoning-from-scratch repo, hope that helps in the meantime: rasbt/reasoning-from-scratch#42
Thanks a lot for the reminder. I'll look into it. Thank you!