[VL] Move Spark 3.5 SMJ-enabled full test jobs into weekly job#12529
Open
JkSelf wants to merge 1 commit into
Open
[VL] Move Spark 3.5 SMJ-enabled full test jobs into weekly job#12529JkSelf wants to merge 1 commit into
JkSelf wants to merge 1 commit into
Conversation
Contributor
There was a problem hiding this comment.
Pull request overview
Moves Spark 3.5 “SMJ-enabled” (i.e., SHJ-disabled) Velox backend unit test jobs into the velox_weekly GitHub Actions workflow so they run on the weekly schedule instead of the main CI workflows.
Changes:
- Add a Spark 3.5.5 unit test job that runs the “other tests” set with
spark.gluten.sql.columnar.forceShuffledHashJoin=false. - Add a Spark 3.5.5 unit test job that runs the slow test sets (ExtendedSQLTest + SlowHiveTest) with
spark.gluten.sql.columnar.forceShuffledHashJoin=false. - Upload surefire XMLs and failure logs as workflow artifacts.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Comment on lines
+74
to
+75
| env: | ||
| SPARK_TESTING: true |
Comment on lines
+79
to
+83
| - name: Download All Artifacts | ||
| uses: actions/download-artifact@v4 | ||
| with: | ||
| name: velox-native-lib-centos-7-${{github.sha}} | ||
| path: ./cpp/build/ |
Comment on lines
+102
to
+103
| - name: Upload test report | ||
| uses: actions/upload-artifact@v4 |
Comment on lines
+120
to
+123
| env: | ||
| SPARK_TESTING: true | ||
| LANG: C.UTF-8 #TODO remove after image update | ||
| LC_ALL: C.UTF-8 |
Comment on lines
+127
to
+131
| - name: Download All Artifacts | ||
| uses: actions/download-artifact@v4 | ||
| with: | ||
| name: velox-native-lib-centos-7-${{github.sha}} | ||
| path: ./cpp/build/ |
Comment on lines
+149
to
+150
| - name: Upload test report | ||
| uses: actions/upload-artifact@v4 |
Comment on lines
+192
to
+197
| - name: Download All Artifacts | ||
| uses: actions/download-artifact@v4 | ||
| with: | ||
| name: velox-native-lib-${{github.sha}} | ||
| path: ./cpp/build/ | ||
| - name: Prepare |
Comment on lines
+242
to
+247
| - name: Download All Artifacts | ||
| uses: actions/download-artifact@v4 | ||
| with: | ||
| name: velox-native-lib-${{github.sha}} | ||
| path: ./cpp/build/ | ||
| - name: Prepare Spark Resources for Spark 3.5.5 #TODO remove after image update |
Comment on lines
+183
to
+186
| spark-test-spark35-smj: | ||
| if: ${{ startsWith(github.repository, 'apache/') }} | ||
| needs: build-native-lib-x86 | ||
| runs-on: ubuntu-22.04 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changes are proposed in this pull request?
How was this patch tested?
Was this patch authored or co-authored using generative AI tooling?