Skip to content

[MINOR] Remove spark2 bundle form validate staged bundles script #13187

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

voonhous
Copy link
Member

@voonhous voonhous commented Apr 21, 2025

Change Logs

We have dropped support for Spark2 bundles in this PR: #11788

Hence, this artifact will be missing when performing a validate check. This PR is to cleanup the shell script validation.

Example of error message:

Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1-javadoc.jar.md5
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1-javadoc.jar.asc
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1-javadoc.jar
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1-sources.jar.asc
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1-javadoc.jar.sha1
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1-sources.jar.md5
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1.jar.md5
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1.jar.asc
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1.pom.asc
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1.pom
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1.jar.sha1
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1-sources.jar
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1-sources.jar.sha1
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1.pom.md5
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1.jar
Artifact missing: https://repository.apache.org/content/repositories/orgapachehudi-1148/org/apache/hudi/hudi-spark-bundle_2.12/1.0.2-rc1/hudi-spark-bundle_2.12-1.0.2-rc1.pom.sha1

Side note:
We will not be fixing the metaserver artifact missing warning here.

Impact

None, this change only affects the release flow, which is manually triggered by the release manager.

Risk level (write none, low medium or high below)

None.

Documentation Update

None.

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@hudi-bot
Copy link

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@github-actions github-actions bot added the size:XS PR with lines of changes in <= 10 label Apr 21, 2025
@codope
Copy link
Member

codope commented Apr 21, 2025

Cancelled the CI to save cycles.. no need to run for this PR as it is a simple release validation script change.

@codope codope merged commit 22d3bde into apache:master Apr 21, 2025
59 of 61 checks passed
@voonhous voonhous deleted the minor-remove-spark2-bundle-from-validate branch April 21, 2025 06:49
voonhous added a commit to voonhous/hudi that referenced this pull request Apr 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release-1.0.2 size:XS PR with lines of changes in <= 10
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants