Skip to content

TCK Challenge processing status

Jump to bottom
Scott Marlow edited this page Apr 26, 2021 · 27 revisions

Details for excluding tests in response to a TCK challenge can be documented here.

The idea being that others can follow how the TCK challenge was processed (e.g. tests were excluded and TCK built, tested and released).

Goal: Excluding tests for https://github.com/eclipse-ee4j/jaxrs-api/issues/937 (https://github.com/eclipse-ee4j/jakartaee-tck/pull/603) TCK challenge.

Increment TCK version numbers

https://github.com/eclipse-ee4j/jakartaee-tck/pull/612

Jobs to run for building, testing, promoting, releasing

  1. Build the 9.0.x branch Platform TCK via https://ci.eclipse.org/jakartaee-tck/job/eftl-jakartaeetck-build-90x Output is https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/staged-90x/jakarta-jakartaeetck-9.0.2.zip + https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/staged-90x/jakarta-jakartaeetckinfo.txt.
  2. Verified excluded tests. https://ci.eclipse.org/jakartaee-tck/job/eftl-standalonetck-build-run-900 (https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/9.0.x/14 has results for Standalone JAX-RS TCK, Standalone Servlet TCK. We verified that excluded tests were not run. We verified that Standalone JAX_RS tests com/sun/ts/tests/jaxrs/ee/rs/ext/providers/JAXRSProvidersClient.java#isRegisteredRuntimeExceptionExceptionMapperTest_from_standalone were not run. https://ci.eclipse.org/jakartaee-tck/job/eftl-standalonetck-build-run-900/95/testReport shows tests passed.
  3. Also verified that excluded Servlet 5.0.1 TCK tests (from previous challenge) were not run (com/sun/ts/tests/servlet/pluggability/api/jakarta_servlet_http/cookie/URLClient.java#setMaxAgePositiveTest + +com/sun/ts/tests/servlet/api/jakarta_servlet_http/cookie/URLClient.java#setMaxAgePositiveTest verified.
  4. Full Platform tests passed. https://ci.eclipse.org/jakartaee-tck/job/eftl-jakartaeetck-certification against staged http://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/staged-90x/jakarta-jakartaeetck-9.0.2.zip using https://jakarta.oss.sonatype.org/content/repositories/staging/org/glassfish/main/distributions/glassfish/6.0.0/glassfish-6.0.0.zip (verified via https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1222/testReport).
  5. Web Profile tests passed. https://ci.eclipse.org/jakartaee-tck/job/eftl-jakartaeetck-certification-web/23/ passed against staged http://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/staged-90x/jakarta-jakartaeetck-9.0.2.zip using https://jakarta.oss.sonatype.org/content/repositories/staging/org/glassfish/main/distributions/web/6.0.0/web-6.0.0.zip
  6. Promote the EFTL TCKS via https://ci.eclipse.org/jakartaee-tck/job/promote_jakartaee9_eftl_bundles copied to https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/jakarta-jakartaeetck-9.0.2.zip + https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/jakarta-restful-ws-tck-3.0.1.zip
  7. Promoted EPL TCKs via https://ci.eclipse.org/jakartaee-tck/job/promote_jakartaee9_epl_bundles_from_promoted_EFTL which output https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9/promoted/jakartaeetck-9.0.2.zip + https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9/promoted/restful-ws-tck-3.0.1.zip
  8. Release the TCKs and update jakarta.ee/specifications/ index.md pages to refer to new TCK zip files via https://github.com/jakartaee/specifications/issues/328 + https://github.com/jakartaee/specifications/pull/330 (note that as per https://github.com/jakartaee/specifications/pull/371#pullrequestreview-642451032, keep original TCK zip links and add new TCK zip files as subitems)
Clone this wiki locally