Skip to content

fix: separate Docker tests into dedicated CI job for autogen-ext#7385

Open
majiayu000 wants to merge 1 commit intomicrosoft:mainfrom
majiayu000:fix/issue-6376-separate-docker-tests
Open

fix: separate Docker tests into dedicated CI job for autogen-ext#7385
majiayu000 wants to merge 1 commit intomicrosoft:mainfrom
majiayu000:fix/issue-6376-separate-docker-tests

Conversation

@majiayu000
Copy link

Why are these changes needed?

Docker code executor tests (DockerCommandLineCodeExecutor and DockerJupyterCodeExecutor) add ~160s to the autogen-ext test suite because each test creates a new Docker container (~10s build time per container). This PR separates them into a dedicated CI job, following the existing test-grpc pattern, so they no longer block the main test suite.

Fixes #6376

Changes

  • Add docker pytest marker to both Docker test files via pytestmark = pytest.mark.docker
  • Add --docker CLI option to conftest.py for marker-based test filtering (same pattern as --grpc)
  • Add test-docker poe task in pyproject.toml
  • Add test-docker CI job in .github/workflows/checks.yml with coverage upload
  • Add Docker coverage to codecov job dependencies
  • Regular poe test now skips Docker-marked tests automatically

Related issue number

Fixes #6376

Checks

Docker code executor tests (DockerCommandLineCodeExecutor and
DockerJupyterCodeExecutor) add ~160s to the autogen-ext test suite due
to per-test container builds. This separates them into a dedicated CI
job following the existing test-grpc pattern:

- Add `docker` pytest marker to both Docker test files
- Add `--docker` CLI option to conftest.py for marker-based filtering
- Add `test-docker` poe task in pyproject.toml
- Add `test-docker` CI job in checks.yml with coverage upload
- Regular `poe test` now skips Docker-marked tests

Fixes microsoft#6376

Signed-off-by: majiayu000 <1835304752@qq.com>
@majiayu000 majiayu000 marked this pull request as ready for review March 13, 2026 12:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

autogen-ext test is too slow...!

1 participant