Skip to content

Add Bifrost provider dialect and enable model providers in UI#6358

Merged
calvinmclean merged 11 commits intoobot-platform:feature/llm-providersfrom
calvinmclean:feature/bifrost-proxy
Apr 16, 2026
Merged

Add Bifrost provider dialect and enable model providers in UI#6358
calvinmclean merged 11 commits intoobot-platform:feature/llm-providersfrom
calvinmclean:feature/bifrost-proxy

Conversation

@calvinmclean
Copy link
Copy Markdown
Contributor

@calvinmclean calvinmclean commented Apr 16, 2026

Addresses #6195

This is merging into a feature branch that already has updated handling for the llmProvider configuration in Nanobot. This re-enables model providers in the UI and updates documentation.

Depends on:

This PR will first be merged into the feature branch. Then, a PR will be opened to main. The others will be merged first, then this will be updated to use the new Nanobot version (for Go library and container image).

Also need to double-check go.mod changes before going to main

@calvinmclean calvinmclean marked this pull request as ready for review April 16, 2026 20:38
@calvinmclean calvinmclean requested a review from Copilot April 16, 2026 20:38
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR expands Obot’s model-provider support by re-enabling additional providers in the admin UI, adding provider ID constants, improving provider model-list URL construction, and updating docs to reflect new/changed Azure + Ollama configuration guidance.

Changes:

  • Extend the admin “Model Providers” UI to treat additional providers as Nanobot-integrated (not “Coming soon”).
  • Add new common provider IDs for Azure (API key) and Azure (Entra ID).
  • Update backend model listing to build /v1/models URLs using url.URL.JoinPath, and recognize the Bifrost dialect mapping to the generic proxy route.
  • Refresh model-provider documentation (Azure + Ollama) and update Go dependencies.

Reviewed changes

Copilot reviewed 6 out of 7 changed files in this pull request and generated 2 comments.

Show a summary per file
File Description
ui/user/src/routes/admin/model-providers/+page.svelte Expands the set of providers considered integrated with Nanobot for UI “Coming soon” behavior.
ui/user/src/lib/constants.ts Adds AZURE and AZURE_ENTRA provider IDs used by the UI.
pkg/gateway/server/dispatcher/availablemodels.go Uses JoinPath("v1","models") to construct the models endpoint robustly.
pkg/controller/handlers/nanobotagent/nanobotagent.go Adds handling for DialectBifrost to use the generic /api/llm-proxy base URL.
docs/docs/configuration/model-providers.md Updates Azure and Ollama configuration docs to match the new provider behavior.
go.mod Adds new dependencies (incl. Bifrost core) and updates many versions; introduces an otelgrpc replace pin.
go.sum Updates checksums for the dependency changes.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread go.mod
Comment thread docs/docs/configuration/model-providers.md
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 6 out of 7 changed files in this pull request and generated 1 comment.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread pkg/controller/handlers/nanobotagent/nanobotagent.go
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 7 out of 8 changed files in this pull request and generated 3 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread pkg/gateway/server/dispatcher/availablemodels.go Outdated
Comment thread ui/user/src/lib/constants.ts
Comment thread docs/docs/configuration/model-providers.md Outdated
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 8 out of 9 changed files in this pull request and generated 1 comment.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread pkg/gateway/server/dispatcher/availablemodels.go
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 9 out of 10 changed files in this pull request and generated 3 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread pkg/gateway/server/dispatcher/availablemodels_test.go Outdated
Comment thread docs/docs/configuration/model-providers.md Outdated
Comment thread ui/user/src/lib/constants.ts
@calvinmclean calvinmclean force-pushed the feature/bifrost-proxy branch from 2a53fad to 5e60960 Compare April 16, 2026 22:17
@calvinmclean calvinmclean requested a review from thedadams April 16, 2026 22:18
@thedadams thedadams requested a review from ivyjeong13 April 16, 2026 22:38
Comment thread docs/docs/configuration/model-providers.md Outdated
Comment thread go.mod
Copy link
Copy Markdown
Contributor

@thedadams thedadams left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Backend looks good with the understanding that the replace directive is addressed before this goes into main.

@calvinmclean calvinmclean merged commit 1c4198f into obot-platform:feature/llm-providers Apr 16, 2026
@calvinmclean calvinmclean deleted the feature/bifrost-proxy branch April 16, 2026 23:35
calvinmclean added a commit that referenced this pull request Apr 16, 2026
* Add Bifrost provider dialect

* Enable bedrock provider in UI

* Enable Ollama in UI

* Enable Azure, AzureEntra in UI

* Update docs

* Update Nanobot branch

* Improve docs for Azure Entra

* fix go mod issue

* Resolve PR comments

* fix go mod

* Improve Ollama networking doc for linux users
calvinmclean added a commit that referenced this pull request Apr 17, 2026
* Add Bifrost provider dialect

* Enable bedrock provider in UI

* Enable Ollama in UI

* Enable Azure, AzureEntra in UI

* Update docs

* Update Nanobot branch

* Improve docs for Azure Entra

* fix go mod issue

* Resolve PR comments

* fix go mod

* Improve Ollama networking doc for linux users
calvinmclean added a commit that referenced this pull request Apr 20, 2026
* Add Bifrost provider dialect

* Enable bedrock provider in UI

* Enable Ollama in UI

* Enable Azure, AzureEntra in UI

* Update docs

* Update Nanobot branch

* Improve docs for Azure Entra

* fix go mod issue

* Resolve PR comments

* fix go mod

* Improve Ollama networking doc for linux users
calvinmclean added a commit that referenced this pull request Apr 22, 2026
* Use Nanobot's new config format + model provider dialects (#6246)

* Write .nanobot/nanobot.yaml llmProviders

* Simplify docker volume/container inits with runInitContainer

* Update some naming to make it clear it is MCP config only

* Use Nanobot types when building config

* Dynamically build the nanobot.yaml for selected model

* Derive Dialect from provider meta

* Fix name shadowing

* Update go.mod using remote branch

* Generate

* Fix default proxy for ChatCompletions and add tests

* Fix provider config reload with symbolic link

* Improve function naming

* Improve function naming and other minor changes

* Improve ensureCredentials refresh logic

* Add Dialect to ModelManifest

* regenerate

* Always run link for docker

* Revert use of nanobottypes

* PR comments

* Move all config setup to nanobotagent.go

* fix boolean condition per copilot comment

* Fix error retry check

* Add Bifrost provider dialect and enable model providers in UI (#6358)

* Add Bifrost provider dialect

* Enable bedrock provider in UI

* Enable Ollama in UI

* Enable Azure, AzureEntra in UI

* Update docs

* Update Nanobot branch

* Improve docs for Azure Entra

* fix go mod issue

* Resolve PR comments

* fix go mod

* Improve Ollama networking doc for linux users

* Remaining changes: message policies, dependencies, etc.

WIP deps

Rename NANOBOT_CONFIG_PATH => NANOBOT_CONFIG

Fix MessagePolicy for Bifrost

Extract and reuse message policies code

Include env in BackPopulateModels

- This allows the Azure provider to get updated deployments

Update kinm + nah

improve docs

lint

generate

Improve URL handling

* Update pkg/gateway/server/llmproxy.go

Co-authored-by: Donnie Adams <donnie@obot.ai>

* fix after suggestion applied

* Revert "Update pkg/gateway/server/llmproxy.go"

This reverts commit 320a47b.

* Revert "fix after suggestion applied"

This reverts commit 0281a84.

* Update Nanobot

---------

Co-authored-by: Donnie Adams <donnie@obot.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants