Skip to content

Add CI workflow testing platforms other than iOS #288

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
freakboy3742 opened this issue May 18, 2025 · 0 comments
Open

Add CI workflow testing platforms other than iOS #288

freakboy3742 opened this issue May 18, 2025 · 0 comments
Labels
enhancement New features, or improvements to existing features. good first issue Is this your first time contributing? This could be a good place to start!

Comments

@freakboy3742
Copy link
Member

What is the problem or limitation you are having?

At present, CI only tests iOS builds, using the Python-standalone-testbed project. Other platforms are, at present, untested release artefacts.

However, both iOS and visionOS provide a testbed project that can be invoked to trigger the CPython test suite.

Describe the solution you'd like

An additional CI stage that invokes the testbed for the given platform.

To save time/resources, it probably doesn't need to run the full test suite on every commit. A "representative subset" of the full CPython test suite, checking basic language features, some of the dynamic libraries (like ssl, hashlib and bzip2), and complex features like sockets would probably suffice, rather than doing a full ~20 minute CI run on every platform.

In a super ideal case, a representative subset would be run by default, but adding a tag to the PR (e.g., preview) would result in the full suite being executed, as would the release workflow.

Describe alternatives you've considered

Status quo

Additional context

The testbed is currently only available for iOS and visionOS; iOS is being tested with Python-support-testbed. That test should be retained; it checks a couple of additional features about the runtime that are useful to confirm.

Any solution should allow for other backends to be tested if/when a testbed is added for watchOS/tvOS.

@freakboy3742 freakboy3742 added enhancement New features, or improvements to existing features. good first issue Is this your first time contributing? This could be a good place to start! labels May 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New features, or improvements to existing features. good first issue Is this your first time contributing? This could be a good place to start!
Projects
None yet
Development

No branches or pull requests

1 participant