Jakarta EE 9 TCK results

Count/link of the recent test failures

Date : 2020-10-04

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/46/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/47/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-04.zip

test group	failure count	issue link(s)
jaxrs	19	Also caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found
jsonb	726	Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.)

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/38/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/39/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-10-04.zip

test group	failure count	issue link(s)
jsonb	484	Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (New version of Yasson coming up)

Promoted Standalone TCK job runs

The promoted standalone TCKs at https://download.eclipse.org/ee4j/jakartaee-tck/jakartaee9-eftl/promoted/ were used to run the below jobs

CI Jobs: eftl-standalonetck-certification/96/junit-reports-with-handlebars & eftl-standalonetck-certification/97/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-10-04.zip

Result : All tests pass.

Past Results

Note that on a weekly basis, we will update this page and previous results will just appear below (with the latest results always at top).

Date : 2020-09-27

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/41/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/42/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-09-27.zip

test group	failure count	issue link(s)
jsf	7	https://github.com/eclipse-ee4j/mojarra/issues/4737 - Will rerun after https://github.com/eclipse-ee4j/glassfish/pull/23211 is available in glassfish build
jaxrs	19	Also caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found
jsonb	726	Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.)

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/32/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/33/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-09-27.zip

test group	failure count	issue link(s)
jsf	7	https://github.com/eclipse-ee4j/mojarra/issues/4737 - Will rerun after https://github.com/eclipse-ee4j/glassfish/pull/23211 is available in glassfish build
jsonb	484	Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.)

Date : 2020-09-20

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/37/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/38/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-09-20.zip

test group	failure count	issue link(s)
jsf	7	https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish
jpa	678	https://github.com/eclipse-ee4j/eclipselink/issues/886
webservices12	7	Awaiting gf integration of jaxws jars
webservices13	27	Awaiting gf integration of jaxws jars
jaxrs	19	Also caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found
jsonb	726	Caused by jakarta.json.bind.spi.JsonbProvider: Provider org.eclipse.yasson.JsonBindingProvider not found (Yasson version needs to bump to OSGi version 2.0.)

Date : 2020-09-13

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/31/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/32/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/glassfish-6.0.0-SNAPSHOT-nightly.zip (the nightly bundle available on 13th September was used as the weekly glassfish bundle is not available)

test group	failure count	issue link(s)
ejb	3	DTD update issue - https://github.com/eclipse-ee4j/jakartaee-tck/pull/502 to remove the compat tests
jsf	7	https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish
jpa	678	https://github.com/eclipse-ee4j/eclipselink/issues/886

Date : 2020-09-06

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/27/junit-reports-with-handlebars & eftl-jakartaeetck-run-900/28/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-09-06.zip

test group	failure count	issue link(s)
ejb	3	DTD update issue, related PR https://github.com/eclipse-ee4j/jakartaee-tck/pull/474 (need to remove/exclude or update the BMP/CMP tests that are failing)
jsf	7	https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish
signaturetest/javaee	3	Pending integration of resource api to glassfish, ref: https://github.com/eclipse-ee4j/jca-api/pull/108

Please note there are jpa & jaxws schema changes being made in the implementation and these tcks will have to be rerun to get the test passing.

JPA suite has failures after schema changes in the tck repo. CI Job: eftl-jakartaeetck-run-900/30/junit-reports-with-handlebars

test group	failure count	issue link(s)
jpa		https://github.com/eclipse-ee4j/eclipselink/issues/886

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/27/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/28/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-09-06.zip

test group	failure count	issue link(s)
jsf	7	https://github.com/eclipse-ee4j/mojarra/issues/4737 - Pending integration to glassfish
signaturetest/javaee	3	Pending integration of resource api to glassfish, ref: https://github.com/eclipse-ee4j/jca-api/pull/108
CDI porting kit	47	https://github.com/eclipse-ee4j/glassfish/issues/23184

Date : 2020-08-30

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/25/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-08-30.zip

test group	failure count	issue link(s)
ejb32	1
webservices12	62
webservices13	1

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/25/junit-reports-with-handlebars & eftl-jakartaeetck-run-web-900/26/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-08-30.zip

All tests in platform TCK now passes in web profile mode.

test group	failure count	issue link(s)
CDI porting kit	47	https://github.com/eclipse-ee4j/glassfish/issues/23184

Platform TCK Standalone build/run

All tests in standalone TCKs passes.

Date : 2020-08-23

Full Platform TCK results

CI Job: eftl-jakartaeetck-run-900/23/junit-reports-with-handlebars

Glassfish Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/glassfish-6.0.0-SNAPSHOT-2020-08-23.zip

test group	failure count	issue link(s)
ejb32	1
securityapi	5	https://github.com/eclipse-ee4j/soteria/issues/280
webservices12	62
webservices13	1

Web Profile TCK results

CI Job: eftl-jakartaeetck-run-web-900/22/junit-reports-with-handlebars

Glassfish Web Bundle used: https://download.eclipse.org/ee4j/glassfish/weekly/web-6.0.0-SNAPSHOT-2020-08-23.zip

test group	failure count	issue link(s)
ejb30_lite_packaging	31
ejb30_lite_tx	163
ejb32	8
jaspic	50
jdbc	2386
jpa	1878
jstl	85
samples	1
CDI porting kit	47	https://github.com/eclipse-ee4j/glassfish/issues/23184

Platform TCK Standalone build/run

CI Job: jakartaee-tck/job/eftl-standalonetck-certification

standalone TCK	failure count	issue link(s)
security api	5	https://github.com/eclipse-ee4j/soteria/issues/280