fix: add /no_think inline tag to disable Qwen3 thinking mode
chat_template_kwargs isn't being respected by the vLLM deployment. Qwen3 models support /no_think as an inline suffix in the user message to disable thinking mode. This is the most reliable method across all serving backends (vLLM, Ollama, SGLang).
This commit is contained in:
@@ -76,7 +76,7 @@ Rewrite the following structured thesis into clear, professional analyst prose.
|
||||
{context_block}
|
||||
--- END CONTEXT ---
|
||||
|
||||
Return ONLY the rewritten thesis. No other text."""
|
||||
Return ONLY the rewritten thesis. No other text. /no_think"""
|
||||
|
||||
return {
|
||||
"system": THESIS_SYSTEM_PROMPT,
|
||||
|
||||
Reference in New Issue
Block a user