Skip to content

DRAFT: Updates for St2 3.10 #6367

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
nzlosh wants to merge 24 commits into
base: master
Choose a base branch
from
Draft

DRAFT: Updates for St2 3.10 #6367

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
85386ff
Replace setup.py with pip to install in editable mode.
nzlosh Feb 2, 2026
3dc1899
Skip empty test directory in makefile and display failed components.
nzlosh Feb 2, 2026
30f8ca1
Fix ModuleNotFoundError: No module named 'pipes'
nzlosh Feb 2, 2026
e58ce7d
Fix DeprecationWarning: module 'sre_parse' is deprecated
nzlosh Feb 3, 2026
aa2cc8b
Fix ImportError: cannot import name 'RequirementInformation' from 'pi…
nzlosh Feb 3, 2026
5b474ba
Fix DeprecationWarning: assertDictContainsSubset is deprecated
nzlosh Feb 5, 2026
5810f9a
Bump CI testing to python range 3.10 to 3.12
nzlosh Mar 17, 2026
3873289
Bump jsonschema version to support py3.12
nzlosh Mar 17, 2026
9b109d0
Regenerate pants lockfiles
nzlosh Mar 17, 2026
2ba51a0
Regenerate pants lockfiles
nzlosh Mar 17, 2026
983c093
Update pants requirements for python3.10-3.12
nzlosh Mar 17, 2026
ff0fe6d
Update requirements for python3.10-3.12
nzlosh Mar 17, 2026
402a3f0
Use public API over internal API for jsonschema to prevent import err…
nzlosh Mar 25, 2026
2af3949
Update pinning/lockfiles to use jsonschema 4.17.3
nzlosh Mar 25, 2026
e8c345f
Bump github actions to use py3.10 to py3.12 with mongo8.2, rabbitmq4.…
nzlosh Mar 25, 2026
df2f2a6
Create virtualenv using venv module.
nzlosh Mar 25, 2026
a9ae68a
Replace pkg_resources with importlib and regenerate lockfile/requirem…
nzlosh Mar 26, 2026
4a6cd40
Replace virtual with venv module
nzlosh Mar 26, 2026
b909869
Replace flex module with openapi-spec-validator and regenerate lockfi…
nzlosh Mar 26, 2026
c8b604c
Enable debug
nzlosh Mar 26, 2026
0d0f44c
Constrain setuptools for all python versions
nzlosh Mar 26, 2026
271b801
convert FileWatchSensor to use threading over eventlent and stackstor…
skiedude Mar 27, 2026
66c8be1
update requirements/tests with removal of logshipper
skiedude Mar 27, 2026
a0526d3
Merge pull request #2 from skiedude/filewatchsensor
nzlosh Mar 27, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 15 additions & 18 deletions .github/workflows/ci.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -55,10 +55,9 @@ jobs:
# NOTE: We need to use full Python version as part of Python deps cache key otherwise
# setup virtualenv step will fail.
python:
- {version-short: '3.8', version: '3.8.18'}
- {version-short: '3.9', version: '3.9.21'}
- {version-short: '3.10', version: '3.10.16'}
- {version-short: '3.11', version: '3.11.11'}
- {version-short: '3.12', version: '3.12.12'}
make:
- name: 'Lint Checks (black, flake8, etc.)'
task: 'ci-checks'
Expand Down Expand Up @@ -117,15 +116,15 @@ jobs:
fail-fast: false
matrix:
python:
- {version-short: '3.8', version: '3.8.18'}
- {version-short: '3.10', version: '3.10.16'}
services:
mongo:
image: mongo:7.0
image: mongo:8.2
ports:
- 27017:27017

rabbitmq:
image: rabbitmq:3.13-management
image: rabbitmq:4.2-management
options: >-
--name rabbitmq
ports:
Expand All @@ -135,7 +134,7 @@ jobs:

redis:
# Docker Hub image
image: redis:8.0
image: redis:8.6
# Set health checks to wait until redis has started
options: >-
--name "redis"
Expand Down Expand Up @@ -272,10 +271,9 @@ jobs:
# NOTE: To speed the CI run, we split unit and integration tests into multiple jobs where
# each job runs subset of tests.
python:
- {version-short: '3.8', version: '3.8.18'}
- {version-short: '3.9', version: '3.9.21'}
- {version-short: '3.10', version: '3.10.16'}
- {version-short: '3.11', version: '3.11.11'}
- {version-short: '3.12', version: '3.12.12'}
make:
- name: 'Unit Tests (chunk 1)'
task: 'ci-unit'
Expand All @@ -290,12 +288,12 @@ jobs:
# shard: {k: 0, n: 1}
services:
mongo:
image: mongo:7.0
image: mongo:8.2
ports:
- 27017:27017
redis:
# Docker Hub image
image: redis:8.0
image: redis:8.6
# Set health checks to wait until redis has started
options: >-
--name "redis"
Expand All @@ -307,7 +305,7 @@ jobs:
- 6379:6379/tcp

rabbitmq:
image: rabbitmq:3.13-management
image: rabbitmq:4.2-management
options: >-
--name rabbitmq
ports:
Expand Down Expand Up @@ -408,7 +406,7 @@ jobs:
# NOTE: We only generate and submit coverage report for master and version branches and
# only when the build succeeds (default on GitHub Actions, this was not the case on Travis
# so we had to explicitly check success)
if: "${{ success() && (env.ENABLE_COVERAGE == 'yes') && (env.PYTHON_VERSION_SHORT == '3.8')}}"
if: "${{ success() && (env.ENABLE_COVERAGE == 'yes') && (env.PYTHON_VERSION_SHORT == '3.10')}}"
run: |
./scripts/ci/submit-codecov-coverage.sh
env:
Expand All @@ -427,10 +425,9 @@ jobs:
# NOTE: To speed-up the CI run, we split unit and integration tests into multiple jobs where
# each job runs subset of tests.
python:
- {version-short: '3.8', version: '3.8.18'}
- {version-short: '3.9', version: '3.9.21'}
- {version-short: '3.10', version: '3.10.16'}
- {version-short: '3.11', version: '3.11.11'}
- {version-short: '3.12', version: '3.12.12'}
make:
# We run pack tests here since they rely on some integration tests set
# up (aka stanley user being present, etc.)
Expand All @@ -445,7 +442,7 @@ jobs:
shard: {k: 1, n: 2}
services:
mongo:
image: mongo:7.0
image: mongo:8.2
ports:
- 27017:27017

Expand All @@ -456,7 +453,7 @@ jobs:
# or they require config in entrypoint args (which we can't override for GHA services)
# so we use RabbitMQ's conf.d feature to get config files from mounted volumes.
rabbitmq:
image: rabbitmq:3.13
image: rabbitmq:4.2
volumes:
- /home/runner/rabbitmq_conf:/etc/rabbitmq/conf.d # RABBITMQ_MOUNTED_CONF_DIR
env:
Expand All @@ -482,7 +479,7 @@ jobs:

redis:
# Docker Hub image
image: redis:8.0
image: redis:8.6
# Set health checks to wait until redis has started
options: >-
--name "redis"
Expand Down Expand Up @@ -577,7 +574,7 @@ jobs:

- name: Codecov
# NOTE: We only generate and submit coverage report for master and version branches and only when the build succeeds (default on GitHub Actions, this was not the case on Travis so we had to explicitly check success)
if: "${{ success() && (env.ENABLE_COVERAGE == 'yes') && (env.TASK == 'ci-integration') && (env.PYTHON_VERSION_SHORT == '3.8')}}"
if: "${{ success() && (env.ENABLE_COVERAGE == 'yes') && (env.TASK == 'ci-integration') && (env.PYTHON_VERSION_SHORT == '3.10')}}"
run: |
./scripts/ci/submit-codecov-coverage.sh
env:
Expand Down
7 changes: 3 additions & 4 deletions .github/workflows/microbenchmarks.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,22 +44,21 @@ jobs:
# NOTE: We need to use full Python version as part of Python deps cache key otherwise
# setup virtualenv step will fail.
python:
- {version-short: '3.8', version: '3.8.18'}
- {version-short: '3.9', version: '3.9.21'}
- {version-short: '3.10', version: '3.10.16'}
- {version-short: '3.11', version: '3.11.11'}
- {version-short: '3.12', version: '3.12.12'}
make:
- name: 'Microbenchmarks'
task: 'micro-benchmarks'
shard: {k: 0, n: 1}
services:
mongo:
image: mongo:7.0
image: mongo:8.2
ports:
- 27017:27017

rabbitmq:
image: rabbitmq:3.13-management
image: rabbitmq:4.2-management
options: >-
--name rabbitmq
ports:
Expand Down
9 changes: 4 additions & 5 deletions .github/workflows/orquesta-integration-tests.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -55,22 +55,21 @@ jobs:
# NOTE: We need to use full Python version as part of Python deps cache key otherwise
# setup virtualenv step will fail.
python:
- {version-short: '3.8', version: '3.8.18'}
- {version-short: '3.9', version: '3.9.21'}
- {version-short: '3.10', version: '3.10.16'}
- {version-short: '3.11', version: '3.11.11'}
- {version-short: '3.12', version: '3.12.12'}
make:
- name: 'Integration Tests (Orquesta)'
task: 'ci-orquesta'
shard: {k: 0, n: 1}
services:
mongo:
image: mongo:7.0
image: mongo:8.2
ports:
- 27017:27017

rabbitmq:
image: rabbitmq:3.13-management
image: rabbitmq:4.2-management
options: >-
--name rabbitmq
ports:
Expand All @@ -80,7 +79,7 @@ jobs:

redis:
# Docker Hub image
image: redis:8.0
image: redis:8.6
# Set health checks to wait until redis has started
options: >-
--name "redis"
Expand Down
51 changes: 23 additions & 28 deletions .github/workflows/test.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,12 +50,12 @@ jobs:

services:
mongo:
image: mongo:7.0
image: mongo:8.2
ports:
- 27017:27017

rabbitmq:
image: rabbitmq:3.13-management
image: rabbitmq:4.2-management
options: >-
--name rabbitmq
ports:
Expand All @@ -65,7 +65,7 @@ jobs:

redis:
# Docker Hub image
image: redis:8.0
image: redis:8.6
# Set health checks to wait until redis has started
options: >-
--name "redis"
Expand Down Expand Up @@ -128,10 +128,9 @@ jobs:
# NOTE: We need to use full Python version as part of Python deps cache key otherwise
# setup virtualenv step will fail.
python:
- {version-short: '3.8', version: '3.8.18'}
- {version-short: '3.9', version: '3.9.21'}
- {version-short: '3.10', version: '3.10.16'}
- {version-short: '3.11', version: '3.11.11'}
- {version-short: '3.12', version: '3.12.12'}
shard:
# Sharding of tests is handled by pants:
# https://www.pantsbuild.org/stable/docs/using-pants/advanced-target-selection#sharding-the-input-targets
Expand All @@ -142,12 +141,12 @@ jobs:

services:
mongo:
image: mongo:7.0
image: mongo:8.2
ports:
- 27017:27017

rabbitmq:
image: rabbitmq:3.13-management
image: rabbitmq:4.2-management
options: >-
--name rabbitmq
ports:
Expand All @@ -157,7 +156,7 @@ jobs:

redis:
# Docker Hub image
image: redis:8.0
image: redis:8.6
# Set health checks to wait until redis has started
options: >-
--name "redis"
Expand Down Expand Up @@ -225,19 +224,18 @@ jobs:
# NOTE: We need to use full Python version as part of Python deps cache key otherwise
# setup virtualenv step will fail.
python:
- {version-short: '3.8', version: '3.8.18'}
- {version-short: '3.9', version: '3.9.21'}
- {version-short: '3.10', version: '3.10.16'}
- {version-short: '3.11', version: '3.11.11'}
- {version-short: '3.12', version: '3.12.12'}

services:
mongo:
image: mongo:7.0
image: mongo:8.2
ports:
- 27017:27017

rabbitmq:
image: rabbitmq:3.13-management
image: rabbitmq:4.2-management
options: >-
--name rabbitmq
ports:
Expand All @@ -247,7 +245,7 @@ jobs:

redis:
# Docker Hub image
image: redis:8.0
image: redis:8.6
# Set health checks to wait until redis has started
options: >-
--name "redis"
Expand Down Expand Up @@ -314,14 +312,13 @@ jobs:
# NOTE: We need to use full Python version as part of Python deps cache key otherwise
# setup virtualenv step will fail.
python:
- {version-short: '3.8', version: '3.8.18'}
- {version-short: '3.9', version: '3.9.21'}
- {version-short: '3.10', version: '3.10.16'}
- {version-short: '3.11', version: '3.11.11'}
- {version-short: '3.12', version: '3.12.12'}

services:
mongo:
image: mongo:7.0
image: mongo:8.2
ports:
- 27017:27017

Expand All @@ -332,7 +329,7 @@ jobs:
# or they require config in entrypoint args (which we can't override for GHA services)
# so we use RabbitMQ's conf.d feature to get config files from mounted volumes.
rabbitmq:
image: rabbitmq:3.13
image: rabbitmq:4.2
volumes:
- /home/runner/rabbitmq_conf:/etc/rabbitmq/conf.d # RABBITMQ_MOUNTED_CONF_DIR
env:
Expand All @@ -359,7 +356,7 @@ jobs:

redis:
# Docker Hub image
image: redis:8.0
image: redis:8.6
# Set health checks to wait until redis has started
options: >-
--name "redis"
Expand Down Expand Up @@ -435,19 +432,18 @@ jobs:
# NOTE: We need to use full Python version as part of Python deps cache key otherwise
# setup virtualenv step will fail.
python:
- {version-short: '3.8', version: '3.8.18'}
- {version-short: '3.9', version: '3.9.21'}
- {version-short: '3.10', version: '3.10.16'}
- {version-short: '3.11', version: '3.11.11'}
- {version-short: '3.12', version: '3.12.12'}

services:
mongo:
image: mongo:7.0
image: mongo:8.2
ports:
- 27017:27017

rabbitmq:
image: rabbitmq:3.13-management
image: rabbitmq:4.2-management
options: >-
--name rabbitmq
ports:
Expand All @@ -457,7 +453,7 @@ jobs:

redis:
# Docker Hub image
image: redis:8.0
image: redis:8.6
# Set health checks to wait until redis has started
options: >-
--name "redis"
Expand Down Expand Up @@ -555,19 +551,18 @@ jobs:
# NOTE: We need to use full Python version as part of Python deps cache key otherwise
# setup virtualenv step will fail.
python:
- {version-short: '3.8', version: '3.8.18'}
- {version-short: '3.9', version: '3.9.21'}
- {version-short: '3.10', version: '3.10.16'}
- {version-short: '3.11', version: '3.11.11'}
- {version-short: '3.12', version: '3.12.12'}

services:
mongo:
image: mongo:7.0
image: mongo:8.2
ports:
- 27017:27017

rabbitmq:
image: rabbitmq:3.13-management
image: rabbitmq:4.2-management
options: >-
--name rabbitmq
ports:
Expand All @@ -577,7 +572,7 @@ jobs:

redis:
# Docker Hub image
image: redis:8.0
image: redis:8.6
# Set health checks to wait until redis has started
options: >-
--name "redis"
Expand Down
Loading
Loading