feat(server_handling): Implement Native Stateful SGLang Infrastructure with Delta-Sync & Session Pinning#443

Open

RUFFY-369 wants to merge 10 commits intoNousResearch:mainfrom

RUFFY-369:feature/smg-native-stateful-routing

Commits on Apr 8, 2026

feat(server_handling): add SMG-inspired prefix hashing logic
RUFFY-369
committed
fix(server_manager): respect base_url parameter for session pinning
RUFFY-369
committed
feat(server_handling): add StatefulSGLangServer with delta-sync and auto-rebuild fallback
RUFFY-369
committed
feat(server_handling): enable delta_input_ids for stateful backend optimizations
RUFFY-369
committed
test(server_handling): verify ServerManager respect base_url pinning
RUFFY-369
committed
test: add server pinning unit tests
RUFFY-369
committed
feat(server_handling): integrate StatefulSGLangServer into default factory logic
RUFFY-369
committed
feat(server_handling): Implement and harden native stateful SGLang infrastructure
RUFFY-369
committed
refactor(server_handling): Clean up documentation and streamline logging
RUFFY-369
committed
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committed