-
Notifications
You must be signed in to change notification settings - Fork 110
Jakarta EE 9.1 TCK results
CI Job: https://ci.eclipse.org/jakartaee-tck/job/standalonetck-certification/99/ with https://ci.eclipse.org/jakartaee-tck/job/standalonetck-certification/99/testReport/
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JDK Version: JDK11
Results: 3,060 failures
CI Job: (https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/50/) with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1346/artifact/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1346/pipeline
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JDK Version: JDK11
Result: All Tests Pass!
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/46/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1338/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1338/pipeline
Glassfish Bundle used: https://jakarta.oss.sonatype.org/content/repositories/staging/org/glassfish/main/distributions/glassfish/6.0.0/glassfish-6.0.0.zip
JDK Version: JDK8
Result: All Tests Pass!
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-web-910/10/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1337/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1337/pipeline
Glassfish Web Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip
JDK Version: JDK11
Result: All Tests Pass!
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-standalonetck-build-run-910/48/
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JDK Version: JDK11
Results: All Tests Pass!
CI Job: (https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/30) with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1297/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1297/pipeline
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JDK Version: JDK11
Result :
Note:
- Issue raised for loading derby classes - https://github.com/eclipse-ee4j/jakartaee-tck/issues/627 has been fixed and closed.
- Below testsuites ran without any failure's : appclient,assembly,concurrency,connector,ejb30/assembly,ejb30/bb,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/singleton,ejb30/lite/stateful,ejb30/lite/tx,ejb30/lite/view,ejb30/lite/xmloverride,ejb30/misc,ejb30/zombie,ejb32,el,integration,jacc,jaspic,javaee,javamail,jbatch,jdbc_appclient,jdbc_ejb,jdbc_jsp,jdbc_servlet,jms,jpa_appmanaged,jpa_appmanagedNoTx,jpa_pmservlet,jpa_puservlet,jpa_stateful3,jpa_stateless3,jsf,jsonb,jsonp,jsp,jta,rmiiiop,samples,websocket,xa
- With the latest run https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1314/, for webservices12, now total test failures are 120.
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/40/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1323/testReport]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1323/pipeline/155
Glassfish Bundle used: https://jakarta.oss.sonatype.org/content/repositories/staging/org/glassfish/main/distributions/glassfish/6.0.0/glassfish-6.0.0.zip
JDK Version: JDK8
Result :
Test group | Failure count | Issue link(s) |
---|---|---|
webservices12 | 1 | |
Total failure count | 1 |
Note:
- Below TCK's ran without any failure's : assembly,appclient,concurrency,connector,ejb,ejb30/bb,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/packaging,ejb30/lite/singleton,ejb30/lite/stateful,ejb30/lite/tx,ejb30/lite/view,ejb30/lite/xmloverride,ejb30/assembly,ejb30/timer,ejb30/webservice,ejb30/zombie,ejb30/misc,ejb30/sec,ejb32,el,integration,jacc,jaspic,jaxrs,javaee,javamail,jbatch,jdbc_appclient,jdbc_ejb,jdbc_jsp,jdbc_servlet,jms,jpa_appmanaged,jpa_appmanagedNoTx,jpa_pmservlet,jpa_puservlet,jpa_stateful3,jpa_stateless3,jsf,jsonb,jsonp,jsp,jstl,jta,rmiiiop,samples,securityapi,servlet,signaturetest/javaee,webservices13,websocket,xa
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-web-910/7/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1299/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1299/pipeline/107
Glassfish Web Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip
JDK Version: JDK11
Result :
Test group | Failure count | Issue link(s) | Comments |
---|---|---|---|
jstl | 29 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/631 | Changes with COMPAT are passing, further testing is in progress(https://ci.eclipse.org/jakartaee-tck/job/guru/job/jakartaee-tck-guru/job/jstl-fix/lastCompletedBuild/testReport/) |
securityapi | 20 | https://github.com/eclipse-ee4j/glassfish/issues/23418 | Fix PR has been merged (https://github.com/eclipse-ee4j/glassfish/pull/23423) |
signaturetest/javaee | 2 | ||
Total failure count | 51 |
Note:
- Below TCK's ran without any failure's : connector,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/packaging,ejb30/lite/singleton/concurrency,ejb30/lite/singleton/dependson,ejb30/lite/singleton/lifecycle,ejb30/lite/stateful,ejb30/lite/tx,ejb30/lite/view,ejb30/lite/xmloverride,ejb32,el,jacc,jaspic,javamail,jaxrs,jdbc,jpa,jsf,jsonb,jsonp,jsp,jta,samples,servlet,websocket
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-standalonetck-build-run-910/35/
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JDK Version: JDK11
Test group | Failure count | Issue link(s) | Comments |
---|---|---|---|
authentication-tck | 38 | https://github.com/eclipse-ee4j/glassfish/issues/23412 | With 3.0.0-b01 webservices-osgi.jar issue shouldn't be seen. more details can be found here - https://github.com/eclipse-ee4j/glassfish/issues/23412#issuecomment-801129882 |
restful-ws-tck | 14 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/640 | |
security-tck | 20 | https://github.com/eclipse-ee4j/glassfish/issues/23418 | Fix PR has been merged |
tags-tck | 29 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/631 | Changes with COMPAT are passing, further testing is in progress(https://ci.eclipse.org/jakartaee-tck/job/guru/job/jakartaee-tck-guru/job/jstl-fix/lastCompletedBuild/testReport/) |
xml-ws-tck | 852 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/649 | Fix PR has been merged (https://github.com/eclipse-ee4j/jakartaee-tck/pull/662) |
Total failure count | 953 |
Note:
- Below TCK's ran without any failure's: annotations-tck,authorization-tck,concurrency-tck,connectors-tck,expression-language-tck,faces-tck,jsonb-tck,jsonp-tck,messaging-tck,pages-tck,persistence-tck,servlet-tck,soap-tck,transactions-tck,websocket-tck
- There is a total of 851 errors observed for xml-ws-tck.
CI Job: https://ci.eclipse.org/jakartaee-tck/job/cditck-porting/job/master/120/
Profile: FULL
CI Job: https://ci.eclipse.org/jakartaee-tck/job/cditck-porting/job/master/121/
Profile: WEB
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip
JDK Version: JDK11
Result: All Tests Pass!
CI Job: eftl-jakartaeetck-run-910/24 with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1275/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1275/pipeline/158
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JDK Version: JDK11
Result :
Test group | Failure count | Issue link(s) |
---|---|---|
appclient | 12 | |
concurrency | 14 | |
ejb | 1,444 | |
ejb30/lite/packaging | 32 | |
ejb30/lite/tx | 163 | |
ejb30/sec | 87 | |
ejb30/timer | 2 | |
ejb30/webservice | 3 | |
ejb32 | 8 | |
integration | 6 | |
jacc | 40 | |
jaxrs | 46 | |
jbatch | 18 | |
jdbc_appclient | 1,193 | |
jdbc_ejb | 1,193 | |
jdbc_jsp | 1,193 | |
jdbc_servlet | 1,193 | |
jpa_appmanaged | 1,715 | |
jpa_appmanagedNoTx | 1,854 | |
jpa_pmservlet | 1,863 | |
jpa_puservlet | 1,852 | |
jpa_stateful3 | 1,715 | |
jpa_stateless3 | 1,865 | |
jstl | 121 | |
jta | 18 | |
samples | 3 | |
securityapi | 28 | |
servlet | 9 | |
signaturetest/javaee | 4 | |
webservices12 | 126 | |
webservices13 | 53 | |
xa | 45 | |
Total failure count | 17,918 |
Note:
- Most Full Profile Platform TCK failures are due to derby classes, more details can be found with issue here - https://github.com/eclipse-ee4j/jakartaee-tck/issues/627
- Below TCK's ran without any failure's : assembly,connector,ejb30/assembly,ejb30/bb,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/singleton,ejb30/lite/stateful,ejb30/lite/view,ejb30/lite/xmloverride,ejb30/misc,ejb30/zombie,el,jaspic,javaee,javamail,jms,jsf,jsonb,jsonp,jsp,rmiiiop,websocket
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-910/25/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1281/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1281/pipeline/131
Glassfish Bundle used: https://jakarta.oss.sonatype.org/content/repositories/staging/org/glassfish/main/distributions/glassfish/6.0.0/glassfish-6.0.0.zip
JDK Version: JDK8
Result :
test group | failure count | issue link(s) |
---|---|---|
jaxrs | 38 | |
servlet | 2 | |
webservices12 | 1 | |
Total failure count | 41 |
Note:
- Below TCK's ran without any failure's : assembly,appclient,concurrency,connector,ejb,ejb30/bb,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/packaging,ejb30/lite/singleton,ejb30/lite/stateful,ejb30/lite/tx,ejb30/lite/view,ejb30/lite/xmloverride,ejb30/assembly,ejb30/timer,ejb30/webservice,ejb30/zombie,ejb30/misc,ejb30/sec,ejb32,el,integration,jacc,jaspic,javaee,javamail,jbatch,jdbc_appclient,jdbc_ejb,jdbc_jsp,jdbc_servlet,jms,jpa_appmanaged,jpa_appmanagedNoTx,jpa_pmservlet,jpa_puservlet,jpa_stateful3,jpa_stateless3,jsf,jsonb,jsonp,jsp,jstl,jta,rmiiiop,samples,securityapi,signaturetest/javaee,webservices13,websocket,xa
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-jakartaeetck-run-web-910/5/ with [https://ci.eclipse.org/jakartaee-tck/job/jakartaee-tck/job/master/1272/testReport/]
Pipeline URL: https://ci.eclipse.org/jakartaee-tck/blue/organizations/jenkins/jakartaee-tck/detail/master/1272/pipeline/107
Glassfish Web Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/web/target/web.zip
Result :
Test group | Failure count | Issue link(s) |
---|---|---|
ejb30/lite/packaging | 31 | |
ejb30/lite/tx | 163 | |
ejb32 | 8 | |
jacc | 24 | |
jdbc | 2,386 | |
jpa | 1,878 | |
jstl | 121 | |
samples | 1 | |
securityapi | 28 | |
signaturetest/javaee | 2 | |
Total failure count | 4,642 |
Note:
- Most Web Profile Platform TCK failures are due to derby classes, more details can be found with issue here - https://github.com/eclipse-ee4j/jakartaee-tck/issues/627
- Below TCK's ran without any failure's : connector,ejb30/lite/appexception,ejb30/lite/async,ejb30/lite/basic,ejb30/lite/ejbcontext,ejb30/lite/enventry,ejb30/lite/interceptor,ejb30/lite/lookup,ejb30/lite/naming,ejb30/lite/nointerface,ejb30/lite/singleton/concurrency,ejb30/lite/singleton/dependson,ejb30/lite/singleton/lifecycle,ejb30/lite/stateful,ejb30/lite/view,ejb30/lite/xmloverride,el,jaspic,javamail,jaxrs,jsf,jsonb,jsonp,jsp,jta,servlet,websocket
CI Job: https://ci.eclipse.org/jakartaee-tck/job/9.1/job/eftl-standalonetck-build-run-910/25/
CDITCK-Porting (CI Job): https://ci.eclipse.org/jakartaee-tck/job/cditck-porting/job/master/119/
Glassfish Bundle used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
Test group | Failure count | Issue link(s) |
---|---|---|
authentication-tck | 81 | https://github.com/eclipse-ee4j/glassfish/issues/23412 |
authorization-tck | 31 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/642 |
pages-tck | 2 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/624 |
restful-ws-tck | 14 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/640 |
security-tck | 20 | https://github.com/eclipse-ee4j/glassfish/issues/23418 |
servlet-tck | 2 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/625 |
tags-tck | 29 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/631 |
xml-ws-tck | 852 | https://github.com/eclipse-ee4j/jakartaee-tck/issues/649 |
cditck-porting | 7 | https://github.com/eclipse-ee4j/cditck-porting/issues/25 |
Total failure count | 1038 |
Note:
- Below TCK's ran without any failure's: annotations-tck,concurrency-tck,connectors-tck,expression-language-tck,faces-tck,jsonb-tck,jsonp-tck,messaging-tck,persistence-tck,transactions-tck,websocket-tck
- There is a total of 851 errors observed for xml-ws-tck.
Glassfish Bundle Used: https://ci.eclipse.org/jakartaee-tck/job/build-glassfish/lastSuccessfulBuild/artifact/appserver/distributions/glassfish/target/glassfish.zip
JAXB-TCK (CI Job): https://ci.eclipse.org/jakartaee-tck/job/jaxb-tck/job/master/82/
DSOL-TCK (CI Job): https://ci.eclipse.org/jakartaee-tck/job/debugging-support-for-other-languages-tck/job/master/258/
DITCK-Porting (CI Job): https://ci.eclipse.org/jakartaee-tck/job/ditck-porting/job/master/114/
BVTCK-Porting (CI Job): https://ci.eclipse.org/jakartaee-tck/job/bvtck-porting/job/master/108/
Result: All Tests Pass!
commit 26bfe1ac26e7093d02e87b394e94e6ee72ed1345
Merge: f23c73484 17530e319
Author: Gaurav Gupta <[email protected]>
Date: Sat Mar 6 21:32:32 2021 +0530
Merge pull request #23409 from arjantijms/subjectdn
Replace the denigrated getSubjectDN by getSubjectX500Principal
Result: ...
Note that on a weekly basis, we will update this page and previous results will just appear below (with the latest results always at top).