Add scripts to run Cosmos tests on a container by AndriySvyryd · Pull Request #37110 · dotnet/efcore

AndriySvyryd · 2025-11-07T03:36:37Z

Run Cosmos tests on a Linux container emulator in Helix
Don't skip tests if emulator not available
Make the Cosmos emulator available for Copilot

Fixes #19973

AndriySvyryd · 2025-11-07T18:31:28Z

Depends on https://dev.azure.com/dnceng/internal/_git/dotnet-helix-machines/pullrequest/54999?_a=overview

AndriySvyryd · 2026-01-10T01:04:52Z

/azp run

azure-pipelines · 2026-01-10T01:05:02Z

Azure Pipelines successfully started running 1 pipeline(s).

Copilot

Pull request overview

This PR configures the Cosmos DB emulator to use port 8800 specifically for Helix CI runs and adds a mechanism to skip connection checks to prevent tests from being skipped when the emulator is not immediately available.

Changes:

Adds a SkipConnectionCheck configuration flag that bypasses connection availability checks
Configures Helix Windows builds to use port 8800 for the Cosmos emulator and skip connection checks
Simplifies the GitHub Actions Cosmos test workflow by combining restore, build, and test into a single command

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 2 comments.

File	Description
test/EFCore.Cosmos.FunctionalTests/TestUtilities/TestEnvironment.cs	Adds `SkipConnectionCheck` property to read configuration for bypassing connection checks
test/EFCore.Cosmos.FunctionalTests/TestUtilities/CosmosTestStore.cs	Updates `IsConnectionAvailableAsync` to return true immediately when `SkipConnectionCheck` is enabled
eng/helix.proj	Adds Cosmos test configuration for Windows Helix queues with port 8800 and connection check skip
.github/workflows/TestCosmos.yaml	Simplifies workflow by combining build and test steps, adds `SkipConnectionCheck` environment variable

eng/helix.proj

AndriySvyryd · 2026-01-13T02:19:24Z

The tests are now failing with

       Microsoft.EntityFrameworkCore.Storage.RetryLimitExceededException : The maximum number of retries (10) was exceeded while executing database operations with 'TestCosmosExecutionStrategy'. See the inner exception for the most recent failure.
      ---- Microsoft.Azure.Cosmos.CosmosException : Response status code does not indicate success: ServiceUnavailable (503); Substatus: 20003; ActivityId: ad961a25-4cb0-4a83-b8ab-21017b93f97e; Reason: (GatewayStoreClient Request Timeout. Start Time UTC:1/12/2026 10:43:24 PM; Total Duration:36003.5648 Ms; Request Timeout 20000 Ms; Http Client Timeout:1200000 Ms; Activity id: ad961a25-4cb0-4a83-b8ab-21017b93f97e;);; Diagnostics:{"Summary":{},"name":"Account Read","start datetime":"2026-01-12T22:43:24.301Z","duration in milliseconds":36002.4951}
      --------- System.Threading.Tasks.TaskCanceledException : The operation was canceled.
      ------------ System.Threading.Tasks.TaskCanceledException : The operation was canceled.
      ---------------- System.IO.IOException : Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request..
      -------------------- System.Net.Sockets.SocketException : The I/O operation has been aborted because of either a thread exit or an application request.

Copilot

Pull request overview

Copilot reviewed 31 out of 31 changed files in this pull request and generated 8 comments.

You can also share your feedback on Copilot code review. Take the survey.

eng/testing/run-cosmos-container.ps1

.agents/skills/cosmos-provider/SKILL.md

test/EFCore.Cosmos.FunctionalTests/TestUtilities/TestEnvironment.cs

test/EFCore.Cosmos.FunctionalTests/TestUtilities/LinuxEmulatorSaveChangesInterceptor.cs

eng/helix.proj

eng/testing/run-cosmos-container.sh

Don't skip tests if emulator not available

Copilot

Pull request overview

Copilot reviewed 44 out of 44 changed files in this pull request and generated 4 comments.

You can also share your feedback on Copilot code review. Take the survey.

.github/workflows/copilot-setup-steps.yml

eng/helix.proj

eng/testing/run-cosmos-container.sh

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot

Pull request overview

Copilot reviewed 44 out of 44 changed files in this pull request and generated 4 comments.

You can also share your feedback on Copilot code review. Take the survey.

eng/helix.proj

.agents/skills/cosmos-provider/SKILL.md

eng/testing/run-cosmos-container.ps1

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot

Pull request overview

Copilot reviewed 44 out of 44 changed files in this pull request and generated 2 comments.

You can also share your feedback on Copilot code review. Take the survey.

eng/helix.proj

eng/testing/run-cosmos-container.sh

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot

Pull request overview

Copilot reviewed 44 out of 44 changed files in this pull request and generated 2 comments.

You can also share your feedback on Copilot code review. Take the survey.

test/EFCore.Cosmos.FunctionalTests/TestUtilities/TestEnvironment.cs

eng/testing/run-cosmos-container.sh

roji · 2026-03-19T07:06:19Z

.agents/skills/cosmos-provider/SKILL.md

+- `eng/testing/run-cosmos-container.ps1`
+- `eng/testing/run-cosmos-container.sh`
+
+These scripts can be invoked locally for testing on machines that don't have the emulator installed, but have docker available.


Instead of this, we should consider automatically spinning up the emulator via a testcontainer when there isn't an environment variable pointing to an external instance (like #37809 does for SQL Server).

Ideally we'd also either detect that it's the Linux emulator rather than requiring an explicit env var for this (no idea how, maybe some sort of Cosmos version function?? Or otherwise if the connection string points to localhost and we're not in Windows?), or maybe do the env var the other way (assume it's Linux unless otherwise).

This point is to have everything just always working out of the box, so that the repo can be checked out on any machine, the tests executed, and everything to be green.

But we can make these improvements later too, if you prefer.

AndriySvyryd requested a review from a team November 7, 2025 03:36

AndriySvyryd requested a review from cincuranet as a code owner November 7, 2025 03:36

cincuranet approved these changes Nov 7, 2025

View reviewed changes

SamMonoRT approved these changes Nov 7, 2025

View reviewed changes

AndriySvyryd force-pushed the TestHelixCosmos branch from 84dfcc5 to 9a72c4a Compare November 14, 2025 01:12

AndriySvyryd enabled auto-merge (squash) December 17, 2025 01:01

Copilot AI review requested due to automatic review settings January 12, 2026 20:29

Copilot started reviewing on behalf of AndriySvyryd January 12, 2026 20:29 View session

Copilot AI reviewed Jan 12, 2026

View reviewed changes

eng/helix.proj Outdated Show resolved Hide resolved

eng/helix.proj Outdated Show resolved Hide resolved

roji force-pushed the main branch 2 times, most recently from 249ae47 to 6b86657 Compare January 13, 2026 17:46

AndriySvyryd marked this pull request as draft February 12, 2026 01:59

auto-merge was automatically disabled February 12, 2026 01:59
Pull request was converted to draft

AndriySvyryd self-assigned this Feb 23, 2026

AndriySvyryd force-pushed the TestHelixCosmos branch 2 times, most recently from 857aad5 to 162a9e2 Compare March 16, 2026 21:05

AndriySvyryd requested a review from Copilot March 16, 2026 21:07

Copilot started reviewing on behalf of AndriySvyryd March 16, 2026 21:08 View session

Copilot AI reviewed Mar 16, 2026

View reviewed changes

AndriySvyryd changed the title ~~Use port 8800 for Cosmos emulator on Helix~~ Add scripts to run Cosmos tests on a container Mar 16, 2026

AndriySvyryd force-pushed the TestHelixCosmos branch 3 times, most recently from 7ad563e to 61aef7c Compare March 16, 2026 23:53

Run Cosmos tests in a Linux container in Helix

dba485a

Don't skip tests if emulator not available

AndriySvyryd force-pushed the TestHelixCosmos branch from 61aef7c to dba485a Compare March 16, 2026 23:55

AndriySvyryd marked this pull request as ready for review March 16, 2026 23:56

Copilot AI review requested due to automatic review settings March 16, 2026 23:56

Copilot started reviewing on behalf of AndriySvyryd March 16, 2026 23:56 View session

Copilot AI reviewed Mar 17, 2026

View reviewed changes

.github/workflows/copilot-setup-steps.yml Show resolved Hide resolved

.github/workflows/copilot-setup-steps.yml Outdated Show resolved Hide resolved

eng/helix.proj Show resolved Hide resolved

eng/testing/run-cosmos-container.sh Outdated Show resolved Hide resolved

AndriySvyryd mentioned this pull request Mar 17, 2026

Allow cosmos tests to run in parallel v2 #37766

Draft

Apply suggestions from code review

a21e267

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot AI review requested due to automatic review settings March 17, 2026 00:14

Copilot started reviewing on behalf of AndriySvyryd March 17, 2026 00:15 View session

Copilot AI reviewed Mar 17, 2026

View reviewed changes

eng/helix.proj Show resolved Hide resolved

.agents/skills/cosmos-provider/SKILL.md Show resolved Hide resolved

eng/testing/run-cosmos-container.ps1 Show resolved Hide resolved

eng/testing/run-cosmos-container.ps1 Outdated Show resolved Hide resolved

AndriySvyryd assigned roji and unassigned AndriySvyryd Mar 17, 2026

Apply suggestions from code review

c337965

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot AI review requested due to automatic review settings March 17, 2026 00:41

Copilot started reviewing on behalf of AndriySvyryd March 17, 2026 00:41 View session

Copilot AI reviewed Mar 17, 2026

View reviewed changes

eng/helix.proj Show resolved Hide resolved

eng/testing/run-cosmos-container.sh Outdated Show resolved Hide resolved

Potential fix for pull request finding

82ca830

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Copilot AI review requested due to automatic review settings March 17, 2026 00:50

Copilot started reviewing on behalf of AndriySvyryd March 17, 2026 00:51 View session

Copilot AI reviewed Mar 17, 2026

View reviewed changes

test/EFCore.Cosmos.FunctionalTests/TestUtilities/TestEnvironment.cs Show resolved Hide resolved

eng/testing/run-cosmos-container.sh Show resolved Hide resolved

roji approved these changes Mar 19, 2026

View reviewed changes

Conversation

AndriySvyryd commented Nov 7, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

AndriySvyryd commented Nov 7, 2025

Uh oh!

AndriySvyryd commented Jan 10, 2026

Uh oh!

azure-pipelines bot commented Jan 10, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

AndriySvyryd commented Jan 13, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Uh oh!

roji Mar 19, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

AndriySvyryd commented Nov 7, 2025 •

edited

Loading