Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[not for review] testing old branch with a dependency version #23327

Closed
wants to merge 3 commits into from

Conversation

suztomo
Copy link
Contributor

@suztomo suztomo commented Sep 22, 2022

No need for review. I don't intend to merge this pull request. Running test to see compatibility of a dependency.


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Choose reviewer(s) and mention them in a comment (R: @username).
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

ValidatesRunner compliance status (on master branch)

Lang ULR Dataflow Flink Samza Spark Twister2
Go --- Build Status Build Status --- Build Status ---
Java Build Status Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status
Build Status Build Status
Build Status
Build Status
Build Status
Python --- Build Status
Build Status
Build Status
Build Status
Build Status
--- Build Status ---
XLang Build Status Build Status Build Status --- Build Status ---

Examples testing status on various runners

Lang ULR Dataflow Flink Samza Spark Twister2
Go --- --- --- --- --- --- ---
Java --- Build Status
Build Status
Build Status
--- --- --- --- ---
Python --- --- --- --- --- --- ---
XLang --- --- --- --- --- --- ---

Post-Commit SDK/Transform Integration Tests Status (on master branch)

Go Java Python
Build Status Build Status Build Status
Build Status
Build Status

Pre-Commit Tests Status (on master branch)

--- Java Python Go Website Whitespace Typescript
Non-portable Build Status
Build Status
Build Status
Build Status
Build Status
Build Status Build Status Build Status Build Status
Portable --- Build Status Build Status --- --- ---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests

See CI.md for more information about GitHub Actions CI.

@suztomo
Copy link
Contributor Author

suztomo commented Sep 22, 2022

Run Java Precommit

Java Precommit failed:

03:12:27 > Configure project :sdks:go
03:12:27 Start downloading go 1.12.7.
03:12:27 downloading https://storage.googleapis.com/golang/go1.12.7.linux-amd64.tar.gz -> /home/jenkins/.gradle/go/binary/go1.12.7.linux-amd64.tar.gz
03:12:33 Extracting /home/jenkins/.gradle/go/binary/go1.12.7.linux-amd64.tar.gz to /home/jenkins/.gradle/go/binary/1.12.7
03:13:45 
03:13:45 FAILURE: Build failed with an exception.
03:13:45 
03:13:45 * What went wrong:
03:13:45 Could not determine the dependencies of task ':sdks:java:io:hcatalog:analyzeTestClassesDependencies'.
03:13:45 > Could not resolve all dependencies for configuration ':sdks:java:io:hcatalog:testCompile'.
03:13:45    > Could not find org.pentaho:pentaho-aggdesigner-algorithm:5.1.5-jhyde.
03:13:45      Searched in the following locations:
03:13:45        - file:/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit/src/sdks/java/io/hcatalog/offline-repository/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
03:13:45        - https://repo.maven.apache.org/maven2/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
03:13:45        - file:/home/jenkins/.m2/repository/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
03:13:45        - https://jcenter.bintray.com/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
03:13:45        - https://public.nexus.pentaho.org/repository/proxy-public-3rd-party-release/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
03:13:45        - https://oss.sonatype.org/content/repositories/staging/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
03:13:45        - https://repository.apache.org/snapshots/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
03:13:45        - https://repository.apache.org/content/repositories/releases/org/pentaho/pentaho-aggdesigner-algorithm/5.1.5-jhyde/pentaho-aggdesigner-algorithm-5.1.5-jhyde.pom
03:13:45      Required by:
03:13:45          project :sdks:java:io:hcatalog > org.apache.hive:hive-exec:2.1.0 > org.apache.calcite:calcite-core:1.6.0
03:13:45 
03:13:45 * Try:
03:13:45 Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
03:13:45 

It failed with the same error.

@Abacn
Copy link
Contributor

Abacn commented Sep 26, 2022

@suztomo Run tests with old versions mostly not going to work because test infrastructure (.test-infra) are still on master. For the pentaho depenency specifically, may need to cherry-pick #17734 (pentaho dependencies was later eliminated in #17749)

@suztomo
Copy link
Contributor Author

suztomo commented Sep 26, 2022

@Abacn Thank you for advice.

…ithm:5.1.5-jhyde (apache#17734)

* [BEAM-14298] resolve dependency org.pentaho:pentaho-aggdesigner-algorithm:5.1.5-jhyde

* change search priority to avoid firewalled
@suztomo
Copy link
Contributor Author

suztomo commented Sep 27, 2022

20:07:36 > Task :sdks:java:io:common:buildDependents
20:07:37 
20:07:37 FAILURE: Build completed with 3 failures.
20:07:37 
20:07:37 1: Task failed with an exception.
20:07:37 -----------
20:07:37 * What went wrong:
20:07:37 Execution failed for task ':sdks:java:container:pullLicenses'.
20:07:37 > Process 'command './license_scripts/license_script.sh'' finished with non-zero exit value 127
20:07:37 
20:07:37 * Try:
20:07:37 Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
20:07:37 ==============================================================================
20:07:37 
20:07:37 2: Task failed with an exception.
20:07:37 -----------
20:07:37 * What went wrong:
20:07:37 Execution failed for task ':release:go-licenses:java:docker'.
20:07:37 > Process 'command 'docker'' finished with non-zero exit value 1
20:07:37 

@Abacn
Copy link
Contributor

Abacn commented Sep 27, 2022

20:07:36 > Task :sdks:java:io:common:buildDependents
20:07:37 
20:07:37 FAILURE: Build completed with 3 failures.
20:07:37 
20:07:37 1: Task failed with an exception.
20:07:37 -----------
20:07:37 * What went wrong:
20:07:37 Execution failed for task ':sdks:java:container:pullLicenses'.
20:07:37 > Process 'command './license_scripts/license_script.sh'' finished with non-zero exit value 127
20:07:37 
20:07:37 * Try:
20:07:37 Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
20:07:37 ==============================================================================
20:07:37 
20:07:37 2: Task failed with an exception.
20:07:37 -----------
20:07:37 * What went wrong:
20:07:37 Execution failed for task ':release:go-licenses:java:docker'.
20:07:37 > Process 'command 'docker'' finished with non-zero exit value 1
20:07:37 

This one may be related to #22395. Cherry pick that PR may work. However, again, building old versions will experience many challenges due to dependency source changes

@suztomo
Copy link
Contributor Author

suztomo commented Sep 27, 2022

Thanks. Cherry-picked 86d0564 with a merge conflict.

@suztomo
Copy link
Contributor Author

suztomo commented Sep 27, 2022

Run Java PostCommit

@suztomo suztomo closed this Oct 18, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants