Conversation
…t-check-and-support-native-structured-output-for-different-model-platforms
|
Important Review skippedAuto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Repository UI Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
📝 Coding Plan
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
…ive-structured-output-for-different-model-platforms
Wendong-Fan
left a comment
There was a problem hiding this comment.
added enhance in #3930, feel free to check
fengju0213
left a comment
There was a problem hiding this comment.
thanks @Zephyroam desides what Wendong has already corrected,find a issue.
| self._async_client.chat.completions.create, | ||
| messages=messages, | ||
| model=self.model_type, | ||
| **request_config, |
There was a problem hiding this comment.
should we remove response_format here?
…ive-structured-output-for-different-model-platforms
…d-output-for-different-model-platforms' of https://github.com/camel-ai/camel into 1695-feature-request-check-and-support-native-structured-output-for-different-model-platforms
…ive-structured-output-for-different-model-platforms
|
overall ,looks good to me now,thanks @Zephyroam still need some time to check the model doc,will give you feedback within today |
|
i think qwenmodel need change to json object according to docs |
|
fixed the qwen model and cicdi ,also migrated the JSON prompt injection logic from the latest user message to the system message, as injecting it into user messages could interfere with KV cache reuse. |
…ive-structured-output-for-different-model-platforms
Related Issue
Closes #1695
Description
Platform Structured Output Support Reference
AIHUBMIXAihubMixModelAIMLAIMLModelANTHROPICAnthropicModelATLASCLOUDAtlasCloudModelAWS_BEDROCKAWSBedrockModelAZUREAzureOpenAIModelCEREBRASCerebrasModelCOHERECohereModeljson_objectwithschemafieldCOMETAPICometAPIModelCRYNUXCrynuxModelDEEPSEEKDeepSeekModelGEMINIGeminiModelGROQGroqModelINTERNLMInternLMModelLITELLMLiteLLMModelLMSTUDIOLMStudioModelMINIMAXMinimaxModelMISTRALMistralModelMOONSHOTMoonshotModelNOVITANovitaModelOPENAIOpenAIModelOPENROUTEROpenRouterModelPPIOPPIOModelQIANFANQianfanModelQWENQwenModelREKARekaModelSAMBASambaModelSILICONFLOWSiliconFlowModelTOGETHERTogetherAIModelVOLCANOVolcanoModelYIYiModelZHIPUZhipuAIModelWhat is the purpose of this pull request?
Checklist
pyproject.tomland runuv lockIf you are unsure about any of these, don't hesitate to ask. We are here to help!