From 651a808aac0cb6b9f916a77411a02a9dc7e46c11 Mon Sep 17 00:00:00 2001 From: Stephan Linz Date: Fri, 29 Sep 2023 08:42:15 +0200 Subject: [PATCH 01/12] dts: stm32f7(6/7)xxx: can2/3: deprecate sjw properties Deprecate the (Re-)Synchronization Jump Width (SJW) devicetree properties for both arbitration and data phase timing as these are now only used in combination with the other TQ-based CAN timing properties, which are all deprecated. Related to upstream changes: - https://github.com/zephyrproject-rtos/zephyr/pull/63034 Signed-off-by: Stephan Linz --- dts/arm/st/f7/stm32f7-can2.dtsi | 1 - dts/arm/st/f7/stm32f7-can3.dtsi | 1 - 2 files changed, 2 deletions(-) diff --git a/dts/arm/st/f7/stm32f7-can2.dtsi b/dts/arm/st/f7/stm32f7-can2.dtsi index 4c41e6a0a1..267044003d 100644 --- a/dts/arm/st/f7/stm32f7-can2.dtsi +++ b/dts/arm/st/f7/stm32f7-can2.dtsi @@ -15,7 +15,6 @@ clocks = <&rcc STM32_CLOCK_BUS_APB1 0x04000000>; master-can-reg = <0x40006400>; status = "disabled"; - sjw = <1>; sample-point = <875>; }; }; diff --git a/dts/arm/st/f7/stm32f7-can3.dtsi b/dts/arm/st/f7/stm32f7-can3.dtsi index b20225db20..1a827ff430 100644 --- a/dts/arm/st/f7/stm32f7-can3.dtsi +++ b/dts/arm/st/f7/stm32f7-can3.dtsi @@ -14,7 +14,6 @@ interrupt-names = "TX", "RX0", "RX1", "SCE"; clocks = <&rcc STM32_CLOCK_BUS_APB1 0x00002000>; status = "disabled"; - sjw = <1>; sample-point = <875>; }; }; From 75c60264c7aff19d4ce844679b7cea37c6408626 Mon Sep 17 00:00:00 2001 From: Stephan Linz Date: Thu, 28 Sep 2023 21:51:00 +0200 Subject: [PATCH 02/12] snippets: add CAN timing adjustments for tests Some systems needs reduced bus speeds to pass Zephyr's standard CAN test suite successfully. Signed-off-by: Stephan Linz --- snippets/can-timing-adj/README.rst | 49 +++++++++++++++++++ .../can-timing-adj/boards/tiac_magpie.overlay | 27 ++++++++++ snippets/can-timing-adj/snippet.yml | 6 +++ 3 files changed, 82 insertions(+) create mode 100644 snippets/can-timing-adj/README.rst create mode 100644 snippets/can-timing-adj/boards/tiac_magpie.overlay create mode 100644 snippets/can-timing-adj/snippet.yml diff --git a/snippets/can-timing-adj/README.rst b/snippets/can-timing-adj/README.rst new file mode 100644 index 0000000000..677e4827f8 --- /dev/null +++ b/snippets/can-timing-adj/README.rst @@ -0,0 +1,49 @@ +.. _snippet-can-timing-adj: + +CAN timing adjustments (can-timing-adj) +####################################### + +Overview +******** + +With this snippet, the user can create Zephyr standard CAN drivers and API test +suites and also run them successfully. Since boards are very often designed for +high performance and thus a high CPU clock, lower CAN speeds can no longer be +set by the Zephyr API without acceptable errors. This is also not an issue for +normal operation. The test suites, however, want to prove that this is also +possible in principle. However, this requires an individual board-specific +reduction of the CPU clock. + +How to add support of a new board +********************************* + +* add board dts overlay to this snippet which overwrites CPU clock setup nodes; +* add correct CPU clock setup ready for the Zephyr standard CAN test suites + +Programming +*********** + +Correct snippet designation must be entered when you invoke ``west build``. +For example: + +.. code-block:: console + + west build -b tiac_magpie \ + -d build/tiac_magpie \ + -p always \ + -S can-timing-adj \ + zephyr/tests/drivers/can/timing + west flash -d build/tiac_magpie + +Testing +******* + +Correct snippet designation must be entered when you invoke ``west twister``. +For example: + +.. code-block:: console + + west twister --device-testing \ + --hardware-map map_tiac_magpie.yaml \ + --extra-args SNIPPET="can-timing-adj" \ + --testsuite-root zephyr/tests/drivers/can/timing diff --git a/snippets/can-timing-adj/boards/tiac_magpie.overlay b/snippets/can-timing-adj/boards/tiac_magpie.overlay new file mode 100644 index 0000000000..fb1be2e272 --- /dev/null +++ b/snippets/can-timing-adj/boards/tiac_magpie.overlay @@ -0,0 +1,27 @@ +/* + * Copyright (c) 2022-2023 TiaC Systems + * SPDX-License-Identifier: Apache-2.0 + */ + +&clk_hse { + hse-bypass; + clock-frequency = ; /* 25MHz crystal */ +}; + +&pll { + /* Reduce PLL speed to achieve test window timings */ + clocks = <&clk_hse>; + div-m = <25>; + mul-n = <192>; + div-p = <2>; + div-q = <4>; +}; + +&rcc { + /* Reduce APB1 and APB2 speed to achieve test window timings */ + clocks = <&pll>; + ahb-prescaler = <1>; + apb1-prescaler = <2>; + apb2-prescaler = <2>; + clock-frequency = ; +}; diff --git a/snippets/can-timing-adj/snippet.yml b/snippets/can-timing-adj/snippet.yml new file mode 100644 index 0000000000..b2b0ab5fa8 --- /dev/null +++ b/snippets/can-timing-adj/snippet.yml @@ -0,0 +1,6 @@ +name: can-timing-adj + +boards: + tiac_magpie: + append: + EXTRA_DTC_OVERLAY_FILE: boards/tiac_magpie.overlay From 2ff8c26afcd165ec26aa78bd0de4ba5442283b92 Mon Sep 17 00:00:00 2001 From: Stephan Linz Date: Thu, 28 Sep 2023 22:30:31 +0200 Subject: [PATCH 03/12] shields: revert CAN timing adjustments for tests This reverts commit ad49608981d9d7e299851e07652084c71d9b4ece. Since the beginning, the adjustments of the CAN timing for board TiaC Magpie STM32F777NIHx as a shield was more a workaround than a clean and correct abstraction of this problem. With introduction of snippets as part of the Zephyr build process, this way over a shield can now be abandoned and the general-purpose snippet 'can-timing-adj' have to be used instead. Signed-off-by: Stephan Linz --- boards/shields/can_timing_adj/Kconfig.shield | 7 ----- .../can_timing_adj/boards/tiac_magpie.overlay | 27 ------------------- .../can_timing_adj/can_timing_adj.overlay | 10 ------- 3 files changed, 44 deletions(-) delete mode 100644 boards/shields/can_timing_adj/Kconfig.shield delete mode 100644 boards/shields/can_timing_adj/boards/tiac_magpie.overlay delete mode 100644 boards/shields/can_timing_adj/can_timing_adj.overlay diff --git a/boards/shields/can_timing_adj/Kconfig.shield b/boards/shields/can_timing_adj/Kconfig.shield deleted file mode 100644 index 529bf415d4..0000000000 --- a/boards/shields/can_timing_adj/Kconfig.shield +++ /dev/null @@ -1,7 +0,0 @@ -# Copyright (c) 2022 TiaC Systems -# SPDX-License-Identifier: Apache-2.0 - -# CAN timing (adjustment) shield configuration - -config SHIELD_CAN_TIMING_ADJ - def_bool $(shields_list_contains,can_timing_adj) diff --git a/boards/shields/can_timing_adj/boards/tiac_magpie.overlay b/boards/shields/can_timing_adj/boards/tiac_magpie.overlay deleted file mode 100644 index 32df99c604..0000000000 --- a/boards/shields/can_timing_adj/boards/tiac_magpie.overlay +++ /dev/null @@ -1,27 +0,0 @@ -/* - * Copyright (c) 2022 TiaC Systems - * SPDX-License-Identifier: Apache-2.0 - */ - -&clk_hse { - hse-bypass; - clock-frequency = ; /* 25MHz crystal */ -}; - -&pll { - /* Reduce PLL speed to achieve test window timings */ - clocks = <&clk_hse>; - div-m = <25>; - mul-n = <192>; - div-p = <2>; - div-q = <4>; -}; - -&rcc { - /* Reduce APB1 and APB2 speed to achieve test window timings */ - clocks = <&pll>; - ahb-prescaler = <1>; - apb1-prescaler = <2>; - apb2-prescaler = <2>; - clock-frequency = ; -}; diff --git a/boards/shields/can_timing_adj/can_timing_adj.overlay b/boards/shields/can_timing_adj/can_timing_adj.overlay deleted file mode 100644 index 6a2a7f0394..0000000000 --- a/boards/shields/can_timing_adj/can_timing_adj.overlay +++ /dev/null @@ -1,10 +0,0 @@ -/* - * Copyright (c) 2022 TiaC Systems - * SPDX-License-Identifier: Apache-2.0 - */ - -/* - * This file is intentionally empty. Please confer with shield documentation - * for instructions to use this shield. CAN timing adjustments are all board - * specific and do not provide any common setups. - */ From df336b9b0ac6fc86cc9879372f7a08ce662abaec Mon Sep 17 00:00:00 2001 From: Stephan Linz Date: Thu, 28 Sep 2023 22:50:38 +0200 Subject: [PATCH 04/12] tests: can: provide alternate configuration With this alternative configuration the downstream board 'tiac_magpie' will be sopported by the Zephyr upstream can test suite. Signed-off-by: Stephan Linz --- .../drivers/can/shell/testcase.yaml | 11 +++++++++ .../drivers/can/timing/testcase.yaml | 24 +++++++++++++++++++ 2 files changed, 35 insertions(+) create mode 100644 zephyr/alt-config/drivers/can/shell/testcase.yaml create mode 100644 zephyr/alt-config/drivers/can/timing/testcase.yaml diff --git a/zephyr/alt-config/drivers/can/shell/testcase.yaml b/zephyr/alt-config/drivers/can/shell/testcase.yaml new file mode 100644 index 0000000000..1e6791a38d --- /dev/null +++ b/zephyr/alt-config/drivers/can/shell/testcase.yaml @@ -0,0 +1,11 @@ +common: + timeout: 120 +tests: + drivers.can.shell: + integration_platforms: + - native_posix + - native_posix_64 + tags: + - drivers + - can + - shell diff --git a/zephyr/alt-config/drivers/can/timing/testcase.yaml b/zephyr/alt-config/drivers/can/timing/testcase.yaml new file mode 100644 index 0000000000..4486804993 --- /dev/null +++ b/zephyr/alt-config/drivers/can/timing/testcase.yaml @@ -0,0 +1,24 @@ +tests: + drivers.can.timing: + tags: + - drivers + - can + depends_on: can + filter: dt_chosen_enabled("zephyr,canbus") + # required_snippets: + # - can-timing-adj + # required_snippets can not yet be used, because of open issues, see: + # - https://github.com/zephyrproject-rtos/zephyr/issues/63011 + # - https://github.com/zephyrproject-rtos/zephyr/pull/63232 + platform_exclude: + - tiac_magpie + drivers.can.timing.tiac_magpie: + tags: + - drivers + - can + depends_on: can + filter: dt_chosen_enabled("zephyr,canbus") + extra_args: + - DTC_OVERLAY_FILE=${ZEPHYR_BRIDLE_MODULE_DIR}/snippets/can-timing-adj/boards/tiac_magpie.overlay + platform_allow: + - tiac_magpie From 6a6b4037ded3c033a12fcdea0e6111e619e66a59 Mon Sep 17 00:00:00 2001 From: Stephan Linz Date: Thu, 28 Sep 2023 22:38:00 +0200 Subject: [PATCH 05/12] tests: watchdog: provide alternate configuration With this alternative configuration the downstream board 'tiac_magpie' will be sopported by the Zephyr upstream watchdog test suite. Signed-off-by: Stephan Linz --- .../watchdog/wdt_basic_api/testcase.yaml | 126 ++++++++++++++++++ 1 file changed, 126 insertions(+) create mode 100644 zephyr/alt-config/drivers/watchdog/wdt_basic_api/testcase.yaml diff --git a/zephyr/alt-config/drivers/watchdog/wdt_basic_api/testcase.yaml b/zephyr/alt-config/drivers/watchdog/wdt_basic_api/testcase.yaml new file mode 100644 index 0000000000..86c6c767e3 --- /dev/null +++ b/zephyr/alt-config/drivers/watchdog/wdt_basic_api/testcase.yaml @@ -0,0 +1,126 @@ +common: + depends_on: watchdog + tags: + - drivers + - watchdog +tests: + drivers.watchdog: + filter: > + not (CONFIG_WDT_SAM or dt_compat_enabled("st,stm32-window-watchdog") + or dt_compat_enabled("st,stm32-watchdog") or CONFIG_SOC_FAMILY_LPC or + CONFIG_SOC_SERIES_IMX_RT6XX or CONFIG_SOC_SERIES_IMX_RT5XX or + CONFIG_SOC_FAMILY_GD32 or SOC_SERIES_GD32VF103) + platform_exclude: + - mec15xxevb_assy6853 + - s32z270dc2_rtu0_r52 + - s32z270dc2_rtu1_r52 + drivers.watchdog.stm32wwdg: + filter: dt_compat_enabled("st,stm32-window-watchdog") or dt_compat_enabled("st,stm32-watchdog") + extra_args: DTC_OVERLAY_FILE="boards/stm32_wwdg.overlay" + platform_allow: + - tiac_magpie + - nucleo_f091rc + - nucleo_f103rb + - nucleo_f207zg + - stm32f3_disco + - nucleo_f429zi + - nucleo_f746zg + - nucleo_g071rb + - nucleo_g474re + - nucleo_l073rz + - nucleo_l152re + - nucleo_l4r5zi + - stm32l562e_dk + - nucleo_wb55rg + - nucleo_wl55jc + - b_u585i_iot02a + - nucleo_u575zi_q + - nucleo_c031c6 + - stm32h573i_dk + - nucleo_wba52cg + integration_platforms: + - nucleo_f091rc + drivers.watchdog.stm32wwdg_h7: + filter: dt_compat_enabled("st,stm32-window-watchdog") or dt_compat_enabled("st,stm32-watchdog") + extra_args: DTC_OVERLAY_FILE="boards/stm32_wwdg_h7.overlay" + platform_allow: + - nucleo_h753zi + - nucleo_h743zi + drivers.watchdog.stm32iwdg: + filter: dt_compat_enabled("st,stm32-window-watchdog") or dt_compat_enabled("st,stm32-watchdog") + extra_args: DTC_OVERLAY_FILE="boards/stm32_iwdg.overlay" + platform_allow: + - tiac_magpie + - nucleo_f091rc + - nucleo_f103rb + - nucleo_f207zg + - stm32f3_disco + - nucleo_f429zi + - nucleo_f746zg + - nucleo_g071rb + - nucleo_g474re + - nucleo_l073rz + - nucleo_l152re + - nucleo_l4r5zi + - stm32l562e_dk + - nucleo_wb55rg + - nucleo_wl55jc + - b_u585i_iot02a + - nucleo_u575zi_q + - nucleo_h753zi + - nucleo_h743zi + - nucleo_c031c6 + - nucleo_h753zi + - nucleo_wba52cg + integration_platforms: + - nucleo_f091rc + drivers.watchdog.mec15xxevb_assy6853: + build_only: true + platform_allow: mec15xxevb_assy6853 + drivers.watchdog.counter_watchdog: + platform_allow: nrf52840dk_nrf52840 + extra_args: + - OVERLAY_CONFIG="boards/nrf52840dk_nrf52840_counter.conf" + - DTC_OVERLAY_FILE="boards/nrf52840dk_nrf52840_counter.overlay" + drivers.watchdog.gd32fwdgt: + filter: dt_compat_enabled("gd,gd32-fwdgt") + extra_args: DTC_OVERLAY_FILE="boards/gd32_fwdgt.overlay" + platform_allow: + - gd32e103v_eval + - gd32e507v_start + - gd32f350r_eval + - gd32f403z_eval + - gd32f450i_eval + - gd32f450z_eval + - gd32f470i_eval + - gd32vf103c_starter + - gd32vf103v_eval + - longan_nano + integration_platforms: + - gd32e103v_eval + drivers.watchdog.gd32wwdgt: + filter: dt_compat_enabled("gd,gd32-wwdgt") + extra_args: DTC_OVERLAY_FILE="boards/gd32_wwdgt.overlay" + platform_allow: + - gd32e103v_eval + - gd32e507v_start + - gd32f350r_eval + - gd32f403z_eval + - gd32f450i_eval + - gd32f450z_eval + - gd32f470i_eval + - gd32vf103c_starter + - gd32vf103v_eval + - longan_nano + integration_platforms: + - gd32e103v_eval + drivers.watchdog.nxp_s32: + build_only: true + platform_allow: + - s32z270dc2_rtu0_r52 + - s32z270dc2_rtu1_r52 + - mr_canhubk3 + drivers.watchdog.mimxrt1050_evk_ti_tps382x: + filter: dt_compat_enabled("ti,tps382x") + platform_allow: mimxrt1050_evk + extra_args: DTC_OVERLAY_FILE="boards/mimxrt1050_evk_ti_tps382x.overlay" From 0779d453c805d46d8fc81b6e549778203f08c63e Mon Sep 17 00:00:00 2001 From: Stephan Linz Date: Thu, 28 Sep 2023 22:48:45 +0200 Subject: [PATCH 06/12] tests: wdt_basic_api: revert watchdog API test clone This reverts commit bd2ff4eaffa80d36dbf80e8ffd65341fc732d48f. This reverts commit 637267c89978065347760961b37bc0c3288c6591. This reverts commit e7efc409988f001e33ab45e882fe9d9863aad722. Since Twister understands alternative test spec configuration, the "clone and own" strategy can be abandoned. Signed-off-by: Stephan Linz --- .../watchdog/wdt_basic_api/CMakeLists.txt | 10 ---------- .../wdt_basic_api/boards/stm32_iwdg.overlay | 13 ------------- .../wdt_basic_api/boards/stm32_wwdg.overlay | 18 ------------------ tests/drivers/watchdog/wdt_basic_api/prj.conf | 5 ----- .../watchdog/wdt_basic_api/testcase.yaml | 15 --------------- 5 files changed, 61 deletions(-) delete mode 100644 tests/drivers/watchdog/wdt_basic_api/CMakeLists.txt delete mode 100644 tests/drivers/watchdog/wdt_basic_api/boards/stm32_iwdg.overlay delete mode 100644 tests/drivers/watchdog/wdt_basic_api/boards/stm32_wwdg.overlay delete mode 100644 tests/drivers/watchdog/wdt_basic_api/prj.conf delete mode 100644 tests/drivers/watchdog/wdt_basic_api/testcase.yaml diff --git a/tests/drivers/watchdog/wdt_basic_api/CMakeLists.txt b/tests/drivers/watchdog/wdt_basic_api/CMakeLists.txt deleted file mode 100644 index 42115c94ff..0000000000 --- a/tests/drivers/watchdog/wdt_basic_api/CMakeLists.txt +++ /dev/null @@ -1,10 +0,0 @@ -# Copyright (c) 2022 TiaC Systems -# SPDX-License-Identifier: Apache-2.0 - -cmake_minimum_required(VERSION 3.20.0) -find_package(Zephyr REQUIRED HINTS $ENV{ZEPHYR_BASE}) -project(wdt_basic_api) - -# still using Zephyr's sources -FILE(GLOB app_sources ${ZEPHYR_BASE}/tests/drivers/watchdog/wdt_basic_api/src/*.c) -target_sources(app PRIVATE ${app_sources}) diff --git a/tests/drivers/watchdog/wdt_basic_api/boards/stm32_iwdg.overlay b/tests/drivers/watchdog/wdt_basic_api/boards/stm32_iwdg.overlay deleted file mode 100644 index 4356558b3f..0000000000 --- a/tests/drivers/watchdog/wdt_basic_api/boards/stm32_iwdg.overlay +++ /dev/null @@ -1,13 +0,0 @@ -/* - * Copyright (c) 2022 STMicroelectronics - * - * SPDX-License-Identifier: Apache-2.0 - */ - -&wwdg { - status = "disabled"; -}; - -&iwdg { - status = "okay"; -}; diff --git a/tests/drivers/watchdog/wdt_basic_api/boards/stm32_wwdg.overlay b/tests/drivers/watchdog/wdt_basic_api/boards/stm32_wwdg.overlay deleted file mode 100644 index 3982a79bd9..0000000000 --- a/tests/drivers/watchdog/wdt_basic_api/boards/stm32_wwdg.overlay +++ /dev/null @@ -1,18 +0,0 @@ -/* - * Copyright (c) 2022 STMicroelectronics - * - * SPDX-License-Identifier: Apache-2.0 - */ - -&rcc { - /* Reduce APB1 speed to achieve test window timings */ - apb1-prescaler = <16>; -}; - -&wwdg { - status = "okay"; -}; - -&iwdg { - status = "disabled"; -}; diff --git a/tests/drivers/watchdog/wdt_basic_api/prj.conf b/tests/drivers/watchdog/wdt_basic_api/prj.conf deleted file mode 100644 index 4954b4358b..0000000000 --- a/tests/drivers/watchdog/wdt_basic_api/prj.conf +++ /dev/null @@ -1,5 +0,0 @@ -CONFIG_WATCHDOG=y -CONFIG_WDT_DISABLE_AT_BOOT=n -CONFIG_ZTEST=y -CONFIG_ZTEST_NEW_API=y -CONFIG_BOOT_BANNER=n diff --git a/tests/drivers/watchdog/wdt_basic_api/testcase.yaml b/tests/drivers/watchdog/wdt_basic_api/testcase.yaml deleted file mode 100644 index c30bb8c6e4..0000000000 --- a/tests/drivers/watchdog/wdt_basic_api/testcase.yaml +++ /dev/null @@ -1,15 +0,0 @@ -common: - depends_on: watchdog - tags: drivers watchdog -tests: - drivers.watchdog.tiac_magpie: - filter: not (dt_compat_enabled("st,stm32-window-watchdog") or dt_compat_enabled("st,stm32-watchdog")) - platform_exclude: tiac_magpie - drivers.watchdog.stm32wwdg.tiac_magpie: - filter: dt_compat_enabled("st,stm32-window-watchdog") or dt_compat_enabled("st,stm32-watchdog") - extra_args: DTC_OVERLAY_FILE="boards/stm32_wwdg.overlay" - platform_allow: tiac_magpie - drivers.watchdog.stm32iwdg.tiac_magpie: - filter: dt_compat_enabled("st,stm32-window-watchdog") or dt_compat_enabled("st,stm32-watchdog") - extra_args: DTC_OVERLAY_FILE="boards/stm32_iwdg.overlay" - platform_allow: tiac_magpie From 72b75cb1af4505ea895a9115d08fd8ade4ef0acb Mon Sep 17 00:00:00 2001 From: Stephan Linz Date: Thu, 28 Sep 2023 23:37:49 +0200 Subject: [PATCH 07/12] tests: i2c: provide alternate configuration With this alternative configuration the downstream board 'tiac_magpie' will be sopported by the Zephyr upstream i2c test suite. Signed-off-by: Stephan Linz --- .../drivers/i2c/i2c_target_api/testcase.yaml | 30 +++++++++++++++++++ 1 file changed, 30 insertions(+) create mode 100644 zephyr/alt-config/drivers/i2c/i2c_target_api/testcase.yaml diff --git a/zephyr/alt-config/drivers/i2c/i2c_target_api/testcase.yaml b/zephyr/alt-config/drivers/i2c/i2c_target_api/testcase.yaml new file mode 100644 index 0000000000..de98324d41 --- /dev/null +++ b/zephyr/alt-config/drivers/i2c/i2c_target_api/testcase.yaml @@ -0,0 +1,30 @@ +common: + depends_on: i2c + tags: + - drivers + - i2c + harness: ztest + harness_config: + fixture: i2c_bus_short + +tests: + drivers.i2c.target_api.dual_role: + platform_allow: + - tiac_magpie + - nucleo_f746zg + - nucleo_g474re + - nucleo_f091rc + - stm32f072b_disco + - nucleo_g071rb + - nucleo_f207zg + - nucleo_f429zi + - nucleo_wl55jc + - nucleo_l073rz + - nucleo_l152re + - rpi_pico + - efr32bg22_brd4184a + - mr_canhubk3 + integration_platforms: + - nucleo_f091rc + extra_configs: + - CONFIG_APP_DUAL_ROLE_I2C=y From c4c98afbe2173bc993f039c5245ac5d3d3c5b746 Mon Sep 17 00:00:00 2001 From: Stephan Linz Date: Thu, 28 Sep 2023 23:50:06 +0200 Subject: [PATCH 08/12] tests: i2c_target_api: revert I2C target API test clone This reverts commit 3d3a3d3282e25f9fc2ffe5d7f5830a2b7f58b5c6. This reverts commit a2eeded6c980b6181e5ea7ef640a07f9e3ba60a6, also remove 'boards/shields/loopback_test/tests/i2c_slave_api.defconfig'. Since Twister understands alternative test spec configuration, the "clone and own" strategy can be abandoned. Signed-off-by: Stephan Linz --- .../shields/loopback_test/boards/tiac_magpie.conf | 2 -- .../loopback_test/tests/i2c_target_api.defconfig | 12 ------------ tests/drivers/i2c/i2c_target_api/CMakeLists.txt | 13 ------------- tests/drivers/i2c/i2c_target_api/Kconfig | 8 -------- tests/drivers/i2c/i2c_target_api/prj.conf | 9 --------- tests/drivers/i2c/i2c_target_api/testcase.yaml | 14 -------------- 6 files changed, 58 deletions(-) delete mode 100644 boards/shields/loopback_test/tests/i2c_target_api.defconfig delete mode 100644 tests/drivers/i2c/i2c_target_api/CMakeLists.txt delete mode 100644 tests/drivers/i2c/i2c_target_api/Kconfig delete mode 100644 tests/drivers/i2c/i2c_target_api/prj.conf delete mode 100644 tests/drivers/i2c/i2c_target_api/testcase.yaml diff --git a/boards/shields/loopback_test/boards/tiac_magpie.conf b/boards/shields/loopback_test/boards/tiac_magpie.conf index 03a1373c80..d8605fe2bd 100644 --- a/boards/shields/loopback_test/boards/tiac_magpie.conf +++ b/boards/shields/loopback_test/boards/tiac_magpie.conf @@ -10,6 +10,4 @@ CONFIG_SPI_STM32_USE_HW_SS=y CONFIG_SPI_STM32_DMA=n CONFIG_SPI_STM32_INTERRUPT=y -CONFIG_I2C_VIRTUAL=n -CONFIG_APP_DUAL_ROLE_I2C=n CONFIG_I2C_STM32_INTERRUPT=y diff --git a/boards/shields/loopback_test/tests/i2c_target_api.defconfig b/boards/shields/loopback_test/tests/i2c_target_api.defconfig deleted file mode 100644 index 6676d17bab..0000000000 --- a/boards/shields/loopback_test/tests/i2c_target_api.defconfig +++ /dev/null @@ -1,12 +0,0 @@ -# Copyright (c) 2021-2023 TiaC Systems -# Copyright (c) 2021 Li-Pro.Net -# SPDX-License-Identifier: Apache-2.0 - -menu "I2C Target API Test" - -# workaround to be configurable with different test cases -# copied from "zephyr/tests/drivers/i2c/i2c_target_api/Kconfig" - -source "tests/drivers/i2c/i2c_target_api/common/Kconfig" - -endmenu # I2C Target API Test diff --git a/tests/drivers/i2c/i2c_target_api/CMakeLists.txt b/tests/drivers/i2c/i2c_target_api/CMakeLists.txt deleted file mode 100644 index ef991ead7c..0000000000 --- a/tests/drivers/i2c/i2c_target_api/CMakeLists.txt +++ /dev/null @@ -1,13 +0,0 @@ -# Copyright (c) 2022-2023 TiaC Systems -# SPDX-License-Identifier: Apache-2.0 - -cmake_minimum_required(VERSION 3.20.0) -find_package(Zephyr REQUIRED HINTS $ENV{ZEPHYR_BASE}) -project(i2c_target_api) - -# still using Zephyr's sources -FILE(GLOB app_sources ${ZEPHYR_BASE}/tests/drivers/i2c/i2c_target_api/src/*.c) -target_sources(app PRIVATE ${app_sources}) - -zephyr_sources_ifdef(CONFIG_I2C_VIRTUAL -${ZEPHYR_BASE}/tests/drivers/i2c/i2c_target_api/common/i2c_virtual.c) diff --git a/tests/drivers/i2c/i2c_target_api/Kconfig b/tests/drivers/i2c/i2c_target_api/Kconfig deleted file mode 100644 index 34c1fd6b31..0000000000 --- a/tests/drivers/i2c/i2c_target_api/Kconfig +++ /dev/null @@ -1,8 +0,0 @@ -# Copyright (c) 2022-2023 TiaC Systems -# SPDX-License-Identifier: Apache-2.0 - -mainmenu "I2C Target API Test" - -source "Kconfig.zephyr" - -source "${ZEPHYR_BASE}/tests/drivers/i2c/i2c_target_api/common/Kconfig" diff --git a/tests/drivers/i2c/i2c_target_api/prj.conf b/tests/drivers/i2c/i2c_target_api/prj.conf deleted file mode 100644 index 9fe909e2e7..0000000000 --- a/tests/drivers/i2c/i2c_target_api/prj.conf +++ /dev/null @@ -1,9 +0,0 @@ -CONFIG_LOG=y -CONFIG_I2C_LOG_LEVEL_INF=y -CONFIG_BOOT_BANNER=y -CONFIG_ZTEST=y -CONFIG_ZTEST_NEW_API=y -CONFIG_I2C=y -CONFIG_I2C_TARGET=y -CONFIG_I2C_EEPROM_TARGET=y -CONFIG_I2C_VIRTUAL=y diff --git a/tests/drivers/i2c/i2c_target_api/testcase.yaml b/tests/drivers/i2c/i2c_target_api/testcase.yaml deleted file mode 100644 index b6e1e3eda7..0000000000 --- a/tests/drivers/i2c/i2c_target_api/testcase.yaml +++ /dev/null @@ -1,14 +0,0 @@ -common: - depends_on: i2c - tags: drivers i2c - harness: ztest - harness_config: - fixture: i2c_bus_short - -tests: - drivers.i2c.target_api.tiac_magpie: - platform_allow: tiac_magpie - drivers.i2c.target_api.dual_role.tiac_magpie: - platform_allow: tiac_magpie - extra_configs: - - CONFIG_APP_DUAL_ROLE_I2C=y From a596a6f81d5137ff2412943bb0c14a5d60c23900 Mon Sep 17 00:00:00 2001 From: Stephan Linz Date: Thu, 28 Sep 2023 22:52:39 +0200 Subject: [PATCH 09/12] tests: bridle: common: fix min flash size Signed-off-by: Stephan Linz --- tests/bridle/common/testcase.yaml | 8 ++++++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/tests/bridle/common/testcase.yaml b/tests/bridle/common/testcase.yaml index 95ce4713f3..5ea6e7c395 100644 --- a/tests/bridle/common/testcase.yaml +++ b/tests/bridle/common/testcase.yaml @@ -1,6 +1,10 @@ common: - tags: base userspace - min_flash: 33 + tags: + - base + - bridle + - userspace + min_flash: 32 + min_ram: 32 timeout: 120 tests: bridle.common: From 6d9cd78ef4ca0d3511a2abd4fd566add367ff1fc Mon Sep 17 00:00:00 2001 From: Stephan Linz Date: Fri, 29 Sep 2023 04:08:06 +0200 Subject: [PATCH 10/12] tiac_magpie: tests: convert to use alt-config Signed-off-by: Stephan Linz --- boards/arm/tiac_magpie/doc/index.rst | 50 ++-- boards/arm/tiac_magpie/doc/tests/arch/arm.rst | 53 ++-- .../arm/tiac_magpie/doc/tests/drivers/adc.rst | 39 +-- .../arm/tiac_magpie/doc/tests/drivers/can.rst | 28 ++- .../tiac_magpie/doc/tests/drivers/counter.rst | 11 +- .../tiac_magpie/doc/tests/drivers/entropy.rst | 34 +-- .../tiac_magpie/doc/tests/drivers/gpio.rst | 21 +- .../tiac_magpie/doc/tests/drivers/hwinfo.rst | 11 +- .../arm/tiac_magpie/doc/tests/drivers/i2c.rst | 57 ++--- .../arm/tiac_magpie/doc/tests/drivers/pwm.rst | 21 +- .../arm/tiac_magpie/doc/tests/drivers/spi.rst | 17 +- .../tiac_magpie/doc/tests/drivers/uart.rst | 20 +- .../doc/tests/drivers/watchdog.rst | 16 +- .../arm/tiac_magpie/doc/tests/os/bridle.rst | 13 +- .../arm/tiac_magpie/doc/tests/os/kernel.rst | 228 ++++++++++-------- 15 files changed, 314 insertions(+), 305 deletions(-) diff --git a/boards/arm/tiac_magpie/doc/index.rst b/boards/arm/tiac_magpie/doc/index.rst index c47e1fa104..5a59d6b366 100644 --- a/boards/arm/tiac_magpie/doc/index.rst +++ b/boards/arm/tiac_magpie/doc/index.rst @@ -478,29 +478,31 @@ with a single call to Twister. .. group-tab:: Running - .. attention:: This will take more than a quarter of an hour. - Build and run the tests on target as follows: .. code-block:: console - $ ./zephyr/scripts/twister --jobs 4 \ + $ west twister --jobs 4 \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --extra-args SHIELD="loopback_test_tmph can_timing_adj" \ - --testsuite-root bridle/tests/bridle \ - --testsuite-root zephyr/tests/kernel \ - --testsuite-root zephyr/tests/arch/arm \ - --testsuite-root zephyr/tests/crypto/rand32 \ - --testsuite-root zephyr/tests/drivers/entropy \ - --testsuite-root zephyr/tests/drivers/watchdog \ - --testsuite-root bridle/tests/drivers/watchdog \ - --testsuite-root zephyr/tests/drivers/counter \ - --testsuite-root zephyr/tests/drivers/hwinfo \ - --testsuite-root zephyr/tests/drivers/uart \ - --testsuite-root zephyr/tests/drivers/gpio \ - --testsuite-root zephyr/tests/drivers/spi \ - --testsuite-root zephyr/tests/drivers/can + --extra-args SHIELD="loopback_test_tmph" \ + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root bridle/tests \ + --testsuite-root zephyr/tests \ + --tag arm --tag vector_relay \ + --tag kernel --exclude-tag security \ + --tag bridle \ + --tag hwinfo \ + --tag random \ + --tag entropy \ + --tag watchdog \ + --tag counter \ + --tag gpio \ + --tag spi \ + --tag uart \ + --tag can + + .. attention:: This will take more than a quarter of an hour. .. group-tab:: Results @@ -517,19 +519,17 @@ with a single call to Twister. INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - - INFO - Total complete: :bgn:`248`/ :bgn:`248` 100% skipped: :byl:`125`, failed: :brd:`0`, error: :brd:`0` - - INFO - 248 test scenarios (248 test instances) selected, 125 configurations skipped (105 by static filter, 20 at runtime). - INFO - :bgn:`123 of 248` test configurations passed (100.00%), :brd:`0` failed, :byl:`125` skipped with :bbk:`0` warnings in :bbk:`1852.06 seconds` - INFO - In total 1247 test cases were executed, 751 skipped on 1 out of total 580 platforms (0.17%) - INFO - :bgn:`123` test configurations executed on platforms, :brd:`0` test configurations were only built. + INFO - Total complete: :bgn:`1800/1800` 100% skipped: :byl:`1662`, failed: :bbk:`0`, error: :bbk:`0` + INFO - 2012 test scenarios (1800 test instances) selected, 1662 configurations skipped (1639 by static filter, 23 at runtime). + INFO - :bgn:`138 of 1800` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1662` skipped with :bbk:`0` warnings in :bbk:`1723.80 seconds` + INFO - In total 1327 test cases were executed, 9726 skipped on 1 out of total 634 platforms (0.16%) + INFO - :bgn:`138` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: \| Board \| ID \| Counter \| \|-------------\|----------\|-----------\| - \| tiac_magpie \| DT04BNT1 \| 123 \| + \| tiac_magpie \| DT04BNT1 \| 138 \| .. admonition:: Known but currently tolerated test cases with errors :class: attention diff --git a/boards/arm/tiac_magpie/doc/tests/arch/arm.rst b/boards/arm/tiac_magpie/doc/tests/arch/arm.rst index b686fdc4c1..59e9222bb3 100644 --- a/boards/arm/tiac_magpie/doc/tests/arch/arm.rst +++ b/boards/arm/tiac_magpie/doc/tests/arch/arm.rst @@ -32,7 +32,8 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --testsuite-root zephyr/tests/arch/arm + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag arm --tag vector_relay .. group-tab:: Results @@ -49,31 +50,31 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - - INFO - 3/22 tiac_magpie tests/arch/arm/arm_mem_protect/arch.arm.mem_protect.syscalls :byl:`SKIPPED` (runtime filter) - INFO - 4/22 tiac_magpie tests/arch/arm/arm_irq_advanced_features/arch.arm.irq_advanced_features.secure_fw :byl:`SKIPPED` (runtime filter) - INFO - 5/22 tiac_magpie tests/arch/arm/arm_irq_vector_table/arch.arm.irq_vector_table :bgn:`PASSED` (device 3.636s) - INFO - 6/22 tiac_magpie tests/arch/arm/arm_runtime_nmi/arch.interrupt.arm.nmi :bgn:`PASSED` (device 6.163s) - INFO - 7/22 tiac_magpie tests/arch/arm/arm_thread_swap_tz/arch.arm.swap.tz_off :byl:`SKIPPED` (runtime filter) - INFO - 8/22 tiac_magpie tests/arch/arm/arm_irq_advanced_features/arch.arm.irq_advanced_features :bgn:`PASSED` (device 2.346s) - INFO - 9/22 tiac_magpie tests/arch/arm/arm_tz_wrap_func/arch.arm.tz_wrap_func :bgn:`PASSED` (device 2.341s) - INFO - 10/22 tiac_magpie tests/arch/arm/arm_thread_swap_tz/arch.arm.swap.tz :byl:`SKIPPED` (runtime filter) - INFO - 11/22 tiac_magpie tests/arch/arm/arm_sw_vector_relay/arch.arm.sw_vector_relay :bgn:`PASSED` (device 2.480s) - INFO - 12/22 tiac_magpie tests/arch/arm/arm_thread_swap/arch.arm.swap.common.fpu_sharing.no_optimizations :bgn:`PASSED` (device 6.677s) - INFO - 13/22 tiac_magpie tests/arch/arm/arm_irq_zero_latency_levels/arch.arm.irq_zero_latency_levels.secure_fw :byl:`SKIPPED` (runtime filter) - INFO - 14/22 tiac_magpie tests/arch/arm/arm_thread_swap/arch.arm.swap.common.no_optimizations :bgn:`PASSED` (device 5.894s) - INFO - 15/22 tiac_magpie tests/arch/arm/arm_thread_swap/arch.arm.swap.common.fpu_sharing :bgn:`PASSED` (device 3.012s) - INFO - 16/22 tiac_magpie tests/arch/arm/arm_thread_swap/arch.arm.swap.common :bgn:`PASSED` (device 3.134s) - INFO - 17/22 tiac_magpie tests/arch/arm/arm_irq_zero_latency_levels/arch.arm.irq_zero_latency_levels :bgn:`PASSED` (device 4.351s) - INFO - 18/22 tiac_magpie tests/arch/arm/arm_interrupt/arch.interrupt.no_optimizations :bgn:`PASSED` (device 7.037s) - INFO - 19/22 tiac_magpie tests/arch/arm/arm_interrupt/arch.interrupt.extra_exception_info :bgn:`PASSED` (device 3.281s) - INFO - 20/22 tiac_magpie tests/arch/arm/arm_interrupt/arch.interrupt.arm :bgn:`PASSED` (device 3.147s) - INFO - 21/22 tiac_magpie tests/arch/arm/arm_ramfunc/arch.arm.ramfunc :bgn:`PASSED` (device 3.023s) - INFO - 22/22 tiac_magpie tests/arch/arm/arm_hardfault_validation/arch.interrupt.arm.hardfault_validation :bgn:`PASSED` (device 2.387s) - - INFO - 22 test scenarios (22 test instances) selected, 7 configurations skipped (2 by static filter, 5 at runtime). - INFO - :bgn:`15 of 22` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`7` skipped with :bbk:`0` warnings in :bbk:`191.27 seconds` - INFO - In total 34 test cases were executed, 9 skipped on 1 out of total 580 platforms (0.17%) + INFO - 1523/1543 tiac_magpie tests/arch/arm/arm_mem_protect/arch.arm.mem_protect.syscalls :byl:`SKIPPED` (runtime filter) + INFO - 1524/1543 tiac_magpie tests/arch/arm/arm_irq_advanced_features/arch.arm.irq_advanced_features.secure_fw :byl:`SKIPPED` (runtime filter) + INFO - 1525/1543 tiac_magpie tests/arch/arm/arm_irq_vector_table/arch.arm.irq_vector_table :bgn:`PASSED` (device: DT04BNT1, 2.398s) + INFO - 1526/1543 tiac_magpie tests/arch/arm/arm_runtime_nmi/arch.interrupt.arm.nmi :bgn:`PASSED` (device: DT04BNT1, 5.039s) + INFO - 1527/1543 tiac_magpie tests/arch/arm/arm_tz_wrap_func/arch.arm.tz_wrap_func :bgn:`PASSED` (device: DT04BNT1, 2.405s) + INFO - 1528/1543 tiac_magpie tests/arch/arm/arm_thread_swap_tz/arch.arm.swap.tz_off :byl:`SKIPPED` (runtime filter) + INFO - 1529/1543 tiac_magpie tests/arch/arm/arm_irq_advanced_features/arch.arm.irq_advanced_features :bgn:`PASSED` (device: DT04BNT1, 2.497s) + INFO - 1530/1543 tiac_magpie tests/arch/arm/arm_thread_swap_tz/arch.arm.swap.tz :byl:`SKIPPED` (runtime filter) + INFO - 1531/1543 tiac_magpie tests/arch/arm/arm_sw_vector_relay/arch.arm.sw_vector_relay :bgn:`PASSED` (device: DT04BNT1, 2.341s) + INFO - 1532/1543 tiac_magpie tests/arch/arm/arm_thread_swap/arch.arm.swap.common.fpu_sharing.no_optimizations :bgn:`PASSED` (device: DT04BNT1, 6.862s) + INFO - 1533/1543 tiac_magpie tests/arch/arm/arm_irq_zero_latency_levels/arch.arm.irq_zero_latency_levels.secure_fw :byl:`SKIPPED` (runtime filter) + INFO - 1534/1543 tiac_magpie tests/arch/arm/arm_thread_swap/arch.arm.swap.common.no_optimizations :bgn:`PASSED` (device: DT04BNT1, 5.969s) + INFO - 1535/1543 tiac_magpie tests/arch/arm/arm_thread_swap/arch.arm.swap.common.fpu_sharing :bgn:`PASSED` (device: DT04BNT1, 3.752s) + INFO - 1536/1543 tiac_magpie tests/arch/arm/arm_thread_swap/arch.arm.swap.common :bgn:`PASSED` (device: DT04BNT1, 3.073s) + INFO - 1537/1543 tiac_magpie tests/arch/arm/arm_irq_zero_latency_levels/arch.arm.irq_zero_latency_levels :bgn:`PASSED` (device: DT04BNT1, 2.658s) + INFO - 1538/1543 tiac_magpie tests/arch/arm/arm_interrupt/arch.interrupt.no_optimizations :bgn:`PASSED` (device: DT04BNT1, 6.192s) + INFO - 1539/1543 tiac_magpie tests/arch/arm/arm_interrupt/arch.interrupt.extra_exception_info :bgn:`PASSED` (device: DT04BNT1, 3.486s) + INFO - 1540/1543 tiac_magpie tests/arch/arm64/arm64_psci/arch.arm64.psci :byl:`SKIPPED` (runtime filter) + INFO - 1541/1543 tiac_magpie tests/arch/arm/arm_interrupt/arch.interrupt.arm :bgn:`PASSED` (device: DT04BNT1, 3.239s) + INFO - 1542/1543 tiac_magpie tests/arch/arm/arm_ramfunc/arch.arm.ramfunc :bgn:`PASSED` (device: DT04BNT1, 3.220s) + INFO - 1543/1543 tiac_magpie tests/arch/arm/arm_hardfault_validation/arch.interrupt.arm.hardfault_validation :bgn:`PASSED` (device: DT04BNT1, 2.414s) + + INFO - 1755 test scenarios (1543 test instances) selected, 1528 configurations skipped (1522 by static filter, 6 at runtime). + INFO - :bgn:`15 of 1543` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1528` skipped with :bbk:`0` warnings in :bbk:`140.68 seconds` + INFO - In total 34 test cases were executed, 10775 skipped on 1 out of total 634 platforms (0.16%) INFO - :bgn:`15` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: diff --git a/boards/arm/tiac_magpie/doc/tests/drivers/adc.rst b/boards/arm/tiac_magpie/doc/tests/drivers/adc.rst index cbca5bfedb..89de92104b 100644 --- a/boards/arm/tiac_magpie/doc/tests/drivers/adc.rst +++ b/boards/arm/tiac_magpie/doc/tests/drivers/adc.rst @@ -38,8 +38,9 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --extra-args SHIELD=loopback_test_tmph \ - --testsuite-root zephyr/tests/drivers/adc + --extra-args SHIELD="loopback_test_tmph" \ + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag adc .. group-tab:: Results @@ -56,13 +57,13 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 3/3 tiac_magpie tests/drivers/adc/adc_api/drivers.adc :brd:`ERROR` Build failure (device) - INFO - see: :byl:`.../twister-out/tiac_magpie/tests/drivers/adc/adc_api/drivers.adc/build.log` + INFO - 1543/1543 tiac_magpie tests/drivers/adc/adc_api/drivers.adc :brd:`ERROR` Build failure (device) + INFO - :byl:`.../twister-out/tiac_magpie/tests/drivers/adc/adc_api/drivers.adc/build.log` ERROR - Loading Zephyr default modules (Zephyr base). - INFO - 3 test scenarios (3 test instances) selected, 2 configurations skipped (2 by static filter, 0 at runtime). - INFO - :bgn:`0 of 3` test configurations passed (0.00%), :bbk:`0` failed, :brd:`1` errored, :byl:`2` skipped with :bbk:`0` warnings in :bbk:`8.19 seconds` - INFO - In total 6 test cases were executed, 15 skipped on 1 out of total 580 platforms (0.17%) + INFO - 1755 test scenarios (1543 test instances) selected, 1542 configurations skipped (1542 by static filter, 0 at runtime). + INFO - :bgn:`0 of 1543` test configurations passed (0.00%), :bbk:`0` failed, :brd:`1` errored, :byl:`1542` skipped with :bbk:`0` warnings in :bbk:`12.99 seconds` + INFO - In total 6 test cases were executed, 10803 skipped on 1 out of total 634 platforms (0.16%) INFO - :bgn:`0` test configurations executed on platforms, :brd:`1` test configurations were only built. Hardware distribution summary: @@ -79,10 +80,10 @@ Building and Running INFO - -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ INFO - The following issues were found (showing the top 10 items): INFO - 1) tests/drivers/adc/adc_api/drivers.adc on tiac_magpie error (Build failure) - INFO - + INFO - INFO - To rerun the tests, call twister using the following commandline: INFO - west twister -p -s , for example: - INFO - + INFO - INFO - west twister -p tiac_magpie -s tests/drivers/adc/adc_api/drivers.adc INFO - or with west: INFO - west build -p -b tiac_magpie -T tests/drivers/adc/adc_api/drivers.adc @@ -97,19 +98,19 @@ Open Issues ... ... ... .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:33:2: :brd:`error:` #error "Unsupported board." - .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:38:30: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... - .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:50:38: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... - .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:52:29: :brd:`error:` :bbk:`'adc_channels_count'` undeclared here ... + .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:38:31: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... + .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:50:39: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... + .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:52:25: :brd:`error:` :bbk:`'adc_channels_count'` undeclared here ... .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:94:37: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:121:37: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:123:29: :brd:`error:` :bbk:`'adc_channels_count'` undeclared here ... - .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:137:13: :brd:`error:` :bbk:`'adc_channels_count'` undeclared here ... - .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:169:37: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... - .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:228:37: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... - .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:258:31: :brd:`error:` :bbk:`'adc_channels_count'` undeclared here ... - .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:301:37: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... - .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:303:13: :brd:`error:` :bbk:`'adc_channels_count'` undeclared here ... - .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:325:36: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... + .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:140:13: :brd:`error:` :bbk:`'adc_channels_count'` undeclared here ... + .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:172:37: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... + .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:231:37: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... + .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:264:35: :brd:`error:` :bbk:`'adc_channels_count'` undeclared here ... + .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:307:37: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... + .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:309:13: :brd:`error:` :bbk:`'adc_channels_count'` undeclared here ... + .../zephyr/tests/drivers/adc/adc_api/src/test_adc.c:334:36: :brd:`error:` :bbk:`'adc_channels'` undeclared here ... ... ... ... ... ... ... ... ... ... diff --git a/boards/arm/tiac_magpie/doc/tests/drivers/can.rst b/boards/arm/tiac_magpie/doc/tests/drivers/can.rst index d080996026..aa68f8863c 100644 --- a/boards/arm/tiac_magpie/doc/tests/drivers/can.rst +++ b/boards/arm/tiac_magpie/doc/tests/drivers/can.rst @@ -32,8 +32,8 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --extra-args SHIELD=can_timing_adj \ - --testsuite-root zephyr/tests/drivers/can + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag can .. group-tab:: Results @@ -50,20 +50,26 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 2/4 tiac_magpie tests/drivers/can/shell/drivers.can.shell :bgn:`PASSED` (device 5.781s) - INFO - 3/4 tiac_magpie tests/drivers/can/timing/drivers.can.timing :bgn:`PASSED` (device 3.224s) - INFO - 4/4 tiac_magpie tests/drivers/can/api/drivers.can.api :bgn:`PASSED` (device 5.158s) - - INFO - 4 test scenarios (4 test instances) selected, 1 configurations skipped (1 by static filter, 0 at runtime). - INFO - :bgn:`3 of 4` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1` skipped with :bbk:`0` warnings in :bbk:`43.26 seconds` - INFO - In total 86 test cases were executed, 46 skipped on 1 out of total 580 platforms (0.17%) - INFO - :bgn:`3` test configurations executed on platforms, :brd:`0` test configurations were only built. + INFO - 1535/1543 tiac_magpie tests/subsys/canbus/isotp/implementation/canbus.isotp.implementation PASSED (device: DT04BNT1, 17.651s) + INFO - 1536/1543 tiac_magpie tests/subsys/canbus/isotp/conformance/canbus.isotp.conformance.fd.txdl_64 PASSED (device: DT04BNT1, 3.085s) + INFO - 1537/1543 tiac_magpie tests/subsys/canbus/isotp/conformance/canbus.isotp.conformance.fd.txdl_32 PASSED (device: DT04BNT1, 3.136s) + INFO - 1538/1543 tiac_magpie tests/subsys/canbus/isotp/conformance/canbus.isotp.conformance.fd.unused PASSED (device: DT04BNT1, 13.632s) + INFO - 1539/1543 tiac_magpie tests/subsys/canbus/isotp/conformance/canbus.isotp.conformance PASSED (device: DT04BNT1, 13.850s) + INFO - 1540/1543 tiac_magpie tests/drivers/can/shell/drivers.can.shell PASSED (device: DT04BNT1, 4.353s) + INFO - 1541/1543 tiac_magpie tests/drivers/can/api/drivers.can.api PASSED (device: DT04BNT1, 5.113s) + INFO - 1542/1543 tiac_magpie tests/net/socket/can/net.socket.can PASSED (device: DT04BNT1, 2.382s) + INFO - 1543/1543 tiac_magpie tests/drivers/can/timing/drivers.can.timing.tiac_magpie PASSED (device: DT04BNT1, 3.233s) + + INFO - 1755 test scenarios (1543 test instances) selected, 1534 configurations skipped (1534 by static filter, 0 at runtime). + INFO - :bgn:`9 of 1543` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1534` skipped with :bbk:`0` warnings in :bbk:`100.98 seconds` + INFO - In total 171 test cases were executed, 10639 skipped on 1 out of total 634 platforms (0.16%) + INFO - :bgn:`9` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: \| Board \| ID \| Counter \| \|-------------\|----------\|-----------\| - \| tiac_magpie \| DT04BNT1 \| 3 \| + \| tiac_magpie \| DT04BNT1 \| 9 \| INFO - Saving reports... INFO - Writing JSON report .../twister-out/twister.json diff --git a/boards/arm/tiac_magpie/doc/tests/drivers/counter.rst b/boards/arm/tiac_magpie/doc/tests/drivers/counter.rst index 8caff7c981..2505f0fe5e 100644 --- a/boards/arm/tiac_magpie/doc/tests/drivers/counter.rst +++ b/boards/arm/tiac_magpie/doc/tests/drivers/counter.rst @@ -32,7 +32,8 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --testsuite-root zephyr/tests/drivers/counter + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag counter .. group-tab:: Results @@ -49,11 +50,11 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 6/6 tiac_magpie tests/drivers/counter/counter_basic_api/drivers.counter.basic_api :bgn:`PASSED` (device 324.738s) + INFO - 1543/1543 tiac_magpie tests/drivers/counter/counter_basic_api/drivers.counter.basic_api :bgn:`PASSED` (device: DT04BNT1, 324.817s) - INFO - 6 test scenarios (6 test instances) selected, 5 configurations skipped (5 by static filter, 0 at runtime). - INFO - :bgn:`1 of 6` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`5` skipped with :bbk:`0` warnings in :bbk:`355.30 seconds` - INFO - In total 10 test cases were executed, 22 skipped on 1 out of total 580 platforms (0.17%) + INFO - 1755 test scenarios (1543 test instances) selected, 1542 configurations skipped (1542 by static filter, 0 at runtime). + INFO - :bgn:`1 of 1543` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1542` skipped with :bbk:`0` warnings in :bbk:`350.80 seconds` + INFO - In total 10 test cases were executed, 10799 skipped on 1 out of total 634 platforms (0.16%) INFO - :bgn:`1` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: diff --git a/boards/arm/tiac_magpie/doc/tests/drivers/entropy.rst b/boards/arm/tiac_magpie/doc/tests/drivers/entropy.rst index 2053c88d68..f89df7afa8 100644 --- a/boards/arm/tiac_magpie/doc/tests/drivers/entropy.rst +++ b/boards/arm/tiac_magpie/doc/tests/drivers/entropy.rst @@ -36,7 +36,8 @@ Drivers --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --testsuite-root zephyr/tests/drivers/entropy + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag entropy .. group-tab:: Results @@ -53,12 +54,12 @@ Drivers INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 2/3 tiac_magpie tests/drivers/entropy/api/drivers.entropy.psa_crypto :byl:`SKIPPED` (runtime filter) - INFO - 3/3 tiac_magpie tests/drivers/entropy/api/drivers.entropy :bgn:`PASSED` (device 2.357s) + INFO - 1542/1543 tiac_magpie tests/drivers/entropy/api/drivers.entropy.psa_crypto :byl:`SKIPPED` (runtime filter) + INFO - 1543/1543 tiac_magpie tests/drivers/entropy/api/drivers.entropy :bgn:`PASSED` (device: DT04BNT1, 2.452s) - INFO - 3 test scenarios (3 test instances) selected, 2 configurations skipped (1 by static filter, 1 at runtime). - INFO - :bgn:`1 of 3` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`2` skipped with :bbk:`0` warnings in :bbk:`20.45 seconds` - INFO - In total 1 test cases were executed, 2 skipped on 1 out of total 580 platforms (0.17%) + INFO - 1755 test scenarios (1543 test instances) selected, 1542 configurations skipped (1541 by static filter, 1 at runtime). + INFO - :bgn:`1 of 1543` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1542` skipped with :bbk:`0` warnings in :bbk:`21.59 seconds` + INFO - In total 1 test cases were executed, 10808 skipped on 1 out of total 634 platforms (0.16%) INFO - :bgn:`1` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: @@ -89,7 +90,8 @@ Cryptography --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --testsuite-root zephyr/tests/crypto/rand32 + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag random .. group-tab:: Results @@ -106,15 +108,15 @@ Cryptography INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 1/5 tiac_magpie tests/crypto/rand32/drivers.rand32.random_psa_crypto :byl:`SKIPPED` (runtime filter) - INFO - 2/5 tiac_magpie tests/crypto/rand32/crypto.rand32.random_sw_systimer :bgn:`PASSED` (device 5.536s) - INFO - 3/5 tiac_magpie tests/crypto/rand32/crypto.rand32.random_hw_xoshiro :bgn:`PASSED` (device 2.313s) - INFO - 4/5 tiac_magpie tests/crypto/rand32/crypto.rand32.random_ctr_drbg :bgn:`PASSED` (device 2.383s) - INFO - 5/5 tiac_magpie tests/crypto/rand32/crypto.rand32 :bgn:`PASSED` (device 2.417s) - - INFO - 5 test scenarios (5 test instances) selected, 1 configurations skipped (0 by static filter, 1 at runtime). - INFO - :bgn:`4 of 5` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1` skipped with :bbk:`0` warnings in :bbk:`44.94 seconds` - INFO - In total 4 test cases were executed, 1 skipped on 1 out of total 580 platforms (0.17%) + INFO - 1539/1543 tiac_magpie tests/crypto/rand32/drivers.rand32.random_psa_crypto :byl:`SKIPPED` (runtime filter) + INFO - 1540/1543 tiac_magpie tests/crypto/rand32/crypto.rand32.random_sw_systimer :bgn:`PASSED` (device: DT04BNT1, 2.514s) + INFO - 1541/1543 tiac_magpie tests/crypto/rand32/crypto.rand32.random_hw_xoshiro :bgn:`PASSED` (device: DT04BNT1, 2.423s) + INFO - 1542/1543 tiac_magpie tests/crypto/rand32/crypto.rand32.random_ctr_drbg :bgn:`PASSED` (device: DT04BNT1, 2.450s) + INFO - 1543/1543 tiac_magpie tests/crypto/rand32/crypto.rand32 :bgn:`PASSED` (device: DT04BNT1, 2.480s) + + INFO - 1755 test scenarios (1543 test instances) selected, 1539 configurations skipped (1538 by static filter, 1 at runtime). + INFO - :bgn:`4 of 1543` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1539` skipped with :bbk:`0` warnings in :bbk:`36.76 seconds` + INFO - In total 4 test cases were executed, 10805 skipped on 1 out of total 634 platforms (0.16%) INFO - :bgn:`4` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: diff --git a/boards/arm/tiac_magpie/doc/tests/drivers/gpio.rst b/boards/arm/tiac_magpie/doc/tests/drivers/gpio.rst index 3c56564330..e6557a179e 100644 --- a/boards/arm/tiac_magpie/doc/tests/drivers/gpio.rst +++ b/boards/arm/tiac_magpie/doc/tests/drivers/gpio.rst @@ -38,8 +38,9 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --extra-args SHIELD=loopback_test_tmph \ - --testsuite-root zephyr/tests/drivers/gpio + --extra-args SHIELD="loopback_test_tmph" \ + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag gpio .. group-tab:: Results @@ -56,14 +57,14 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 3/6 tiac_magpie tests/drivers/gpio/gpio_enable_disable_interrupt/drivers.gpio.enable_disable_interrupt :byl:`SKIPPED` (runtime filter) - INFO - 4/6 tiac_magpie tests/drivers/gpio/gpio_get_direction/drivers.gpio.get_direction :bgn:`PASSED` (device 2.438s) - INFO - 5/6 tiac_magpie tests/drivers/gpio/gpio_basic_api/drivers.gpio.2pin :bgn:`PASSED` (device 17.724s) - INFO - 6/6 tiac_magpie tests/drivers/gpio/gpio_api_1pin/drivers.gpio.1pin :bgn:`PASSED` (device 9.330s) - - INFO - 6 test scenarios (6 test instances) selected, 3 configurations skipped (2 by static filter, 1 at runtime). - INFO - :bgn:`3 of 6` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`3` skipped with :bbk:`0` warnings in :bbk:`61.92 seconds` - INFO - In total 26 test cases were executed, 25 skipped on 1 out of total 580 platforms (0.17%) + INFO - 1540/1543 tiac_magpie tests/drivers/gpio/gpio_enable_disable_interrupt/drivers.gpio.enable_disable_interrupt :byl:`SKIPPED` (runtime filter) + INFO - 1541/1543 tiac_magpie tests/drivers/gpio/gpio_basic_api/drivers.gpio.2pin :bgn:`PASSED` (device: DT04BNT1, 17.746s) + INFO - 1542/1543 tiac_magpie tests/drivers/gpio/gpio_api_1pin/drivers.gpio.1pin :bgn:`PASSED` (device: DT04BNT1, 9.384s) + INFO - 1543/1543 tiac_magpie tests/drivers/gpio/gpio_get_direction/drivers.gpio.get_direction :bgn:`PASSED` (device: DT04BNT1, 2.432s) + + INFO - 1755 test scenarios (1543 test instances) selected, 1540 configurations skipped (1539 by static filter, 1 at runtime). + INFO - :bgn:`3 of 1543` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1540` skipped with :bbk:`0` warnings in :bbk:`54.52 seconds` + INFO - In total 26 test cases were executed, 10783 skipped on 1 out of total 634 platforms (0.16%) INFO - :bgn:`3` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: diff --git a/boards/arm/tiac_magpie/doc/tests/drivers/hwinfo.rst b/boards/arm/tiac_magpie/doc/tests/drivers/hwinfo.rst index 873bb38a00..d22e54c5ca 100644 --- a/boards/arm/tiac_magpie/doc/tests/drivers/hwinfo.rst +++ b/boards/arm/tiac_magpie/doc/tests/drivers/hwinfo.rst @@ -32,7 +32,8 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --testsuite-root zephyr/tests/drivers/hwinfo + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag hwinfo .. group-tab:: Results @@ -49,11 +50,11 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 1/1 tiac_magpie tests/drivers/hwinfo/api/drivers.hwinfo.api :bgn:`PASSED` (device 2.371s) + INFO - 1543/1543 tiac_magpie tests/drivers/hwinfo/api/drivers.hwinfo.api :bgn:`PASSED` (device: DT04BNT1, 2.447s) - INFO - 1 test scenarios (1 test instances) selected, 0 configurations skipped (0 by static filter, 0 at runtime). - INFO - :bgn:`1 of 1` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`0` skipped with :bbk:`0` warnings in :bbk:`16.88 seconds` - INFO - In total 4 test cases were executed, 0 skipped on 1 out of total 580 platforms (0.17%) + INFO - 1755 test scenarios (1543 test instances) selected, 1542 configurations skipped (1542 by static filter, 0 at runtime). + INFO - :bgn:`1 of 1543` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1542` skipped with :bbk:`0` warnings in :bbk:`17.30 seconds` + INFO - In total 4 test cases were executed, 10805 skipped on 1 out of total 634 platforms (0.16%) INFO - :bgn:`1` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: diff --git a/boards/arm/tiac_magpie/doc/tests/drivers/i2c.rst b/boards/arm/tiac_magpie/doc/tests/drivers/i2c.rst index 75e215490b..6c1b4302bd 100644 --- a/boards/arm/tiac_magpie/doc/tests/drivers/i2c.rst +++ b/boards/arm/tiac_magpie/doc/tests/drivers/i2c.rst @@ -38,9 +38,9 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --extra-args SHIELD=loopback_test_tmph \ - --testsuite-root zephyr/tests/drivers/i2c \ - --testsuite-root bridle/tests/drivers/i2c + --extra-args SHIELD="loopback_test_tmph" \ + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag i2c .. group-tab:: Results @@ -57,24 +57,15 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 3/5 tiac_magpie tests/drivers/i2c/i2c_api/drivers.i2c.api :byl:`SKIPPED` (runtime filter) - INFO - 4/5 tiac_magpie i2c_target_api/drivers.i2c.target_api.dual_role.tiac_magpie :brd:`ERROR` Build failure (device) - INFO - see: :byl:`.../twister-out/tiac_magpie/i2c_slave_api/drivers.i2c.target_api.dual_role.tiac_magpie/handler.log` + INFO - 1542/1543 tiac_magpie tests/drivers/i2c/i2c_api/drivers.i2c.api :byl:`SKIPPED` (runtime filter) + INFO - 1543/1543 tiac_magpie tests/drivers/i2c/i2c_target_api/drivers.i2c.target_api.dual_role :brd:`ERROR` Build failure (device) + INFO - :byl:`.../twister-out/tiac_magpie/tests/drivers/i2c/i2c_target_api/drivers.i2c.target_api.dual_role/build.log` ERROR - Loading Zephyr default modules (Zephyr base). - INFO - 5/5 tiac_magpie i2c_target_api/drivers.i2c.target_api.tiac_magpie :brd:`ERROR` Build failure (device) - INFO - see: :byl:`.../twister-out/tiac_magpie/i2c_slave_api/drivers.i2c.target_api.tiac_magpie/handler.log` - ERROR - Loading Zephyr default modules (Zephyr base). - - INFO - 3/5 tiac_magpie tests/drivers/i2c/i2c_api/drivers.i2c.api :byl:`SKIPPED` (runtime filter) - INFO - 4/5 tiac_magpie i2c_target_api/drivers.i2c.target_api.tiac_magpie :brd:`FAILED` Failed (device 2.637s) - ERROR - see: :byl:`.../twister-out/tiac_magpie/i2c_slave_api/drivers.i2c.target_api.tiac_magpie/handler.log` - INFO - 5/5 tiac_magpie i2c_target_api/drivers.i2c.target_api.dual_role.tiac_magpie :brd:`FAILED` Failed (device 2.637s) - ERROR - see: :byl:`.../twister-out/tiac_magpie/i2c_slave_api/drivers.i2c.target_api.dual_role.tiac_magpie/handler.log` - INFO - 5 test scenarios (5 test instances) selected, 3 configurations skipped (2 by static filter, 1 at runtime). - INFO - :brd:`0 of 5` test configurations passed (0.00%), :bbk:`0` failed, :brd:`2` errored, :byl:`3` skipped with :bbk:`0` warnings in :bbk:`11.26 seconds` - INFO - In total 2 test cases were executed, 4 skipped on 1 out of total 580 platforms (0.17%) - INFO - :bgn:`0` test configurations executed on platforms, :brd:`2` test configurations were only built. + INFO - 1755 test scenarios (1543 test instances) selected, 1542 configurations skipped (1541 by static filter, 1 at runtime). + INFO - :bgn:`0 of 1543` test configurations passed (0.00%), :bbk:`0` failed, :brd:`1` errored, :byl:`1542` skipped with :bbk:`0` warnings in :bbk:`16.02 seconds` + INFO - In total 1 test cases were executed, 10808 skipped on 1 out of total 634 platforms (0.16%) + INFO - :bgn:`0` test configurations executed on platforms, :brd:`1` test configurations were only built. Hardware distribution summary: @@ -89,34 +80,20 @@ Building and Running INFO - Writing target report for tiac_magpie... INFO - -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ INFO - The following issues were found (showing the top 10 items): - INFO - 1) i2c_target_api/drivers.i2c.target_api.tiac_magpie on tiac_magpie failed (Failed) - INFO - 2) i2c_target_api/drivers.i2c.target_api.dual_role.tiac_magpie on tiac_magpie failed (Failed) - INFO - + INFO - 1) tests/drivers/i2c/i2c_target_api/drivers.i2c.target_api.dual_role on tiac_magpie error (Build failure) + INFO - INFO - To rerun the tests, call twister using the following commandline: INFO - west twister -p -s , for example: - INFO - - INFO - west twister -p tiac_magpie -s i2c_target_api/drivers.i2c.target_api.dual_role.tiac_magpie + INFO - + INFO - west twister -p tiac_magpie -s tests/drivers/i2c/i2c_target_api/drivers.i2c.target_api.dual_role INFO - or with west: - INFO - west build -p -b tiac_magpie -T i2c_target_api/drivers.i2c.target_api.dual_role.tiac_magpie + INFO - west build -p -b tiac_magpie -T tests/drivers/i2c/i2c_target_api/drivers.i2c.target_api.dual_role INFO - -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ INFO - Run completed Open Issues *********** -Single role with two I2C controller -=================================== - -.. parsed-literal:: - :class: highlight - - ... ... ... - .../zephyr/drivers/i2c/target/eeprom_target.c:180:12: :brd:`error:` 'i2c_eeprom_target_init' defined but not used - .../zephyr/drivers/i2c/target/eeprom_target.c:167:43: :brd:`error:` 'api_funcs' defined but not used - ... ... ... - ... ... ... - ... ... ... - Dual role with one I2C controller and one I2C device ==================================================== @@ -124,8 +101,8 @@ Dual role with one I2C controller and one I2C device :class: highlight ... ... ... - .../zephyr/drivers/i2c/target/eeprom_target.c:180:12: :brd:`error:` 'i2c_eeprom_target_init' defined but not used - .../zephyr/drivers/i2c/target/eeprom_target.c:167:43: :brd:`error:` 'api_funcs' defined but not used + .../zephyr/drivers/i2c/target/eeprom_target.c:229:12: :brd:`error:` 'i2c_eeprom_target_init' defined but not used + .../zephyr/drivers/i2c/target/eeprom_target.c:212:43: :brd:`error:` 'api_funcs' defined but not used ... ... ... ... ... ... ... ... ... diff --git a/boards/arm/tiac_magpie/doc/tests/drivers/pwm.rst b/boards/arm/tiac_magpie/doc/tests/drivers/pwm.rst index 38a7d6d034..36031fc4ec 100644 --- a/boards/arm/tiac_magpie/doc/tests/drivers/pwm.rst +++ b/boards/arm/tiac_magpie/doc/tests/drivers/pwm.rst @@ -38,8 +38,9 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --extra-args SHIELD=loopback_test_tmph \ - --testsuite-root zephyr/tests/drivers/pwm + --extra-args SHIELD="loopback_test_tmph" \ + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag pwm .. group-tab:: Results @@ -56,13 +57,13 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 1/2 tiac_magpie tests/drivers/pwm/pwm_api/drivers.pwm :bgn:`PASSED` (device 8.945s) - INFO - 2/2 tiac_magpie tests/drivers/pwm/pwm_loopback/drivers.pwm.loopback :brd:`FAILED` Failed (device 3.286s) - ERROR - see: :byl:`.../twister-out/tiac_magpie/tests/drivers/pwm/pwm_loopback/drivers.pwm.loopback/handler.log` + INFO - 1542/1543 tiac_magpie tests/drivers/pwm/pwm_api/drivers.pwm :bgn:`PASSED` (device: DT04BNT1, 9.111s) + INFO - 1543/1543 tiac_magpie tests/drivers/pwm/pwm_loopback/drivers.pwm.loopback :brd:`FAILED` Failed (device: DT04BNT1, 3.379s) + INFO - :byl:`.../twister-out/tiac_magpie/tests/drivers/pwm/pwm_loopback/drivers.pwm.loopback/handler.log` - INFO - 2 test scenarios (2 test instances) selected, 0 configurations skipped (0 by static filter, 0 at runtime). - INFO - :brd:`1 of 2` test configurations passed (50.00%), :brd:`1` failed, :bbk:`1` errored, :byl:`0` skipped with :bbk:`0` warnings in :bbk:`42.55 seconds` - INFO - In total 10 test cases were executed, 0 skipped on 1 out of total 580 platforms (0.17%) + INFO - 1755 test scenarios (1543 test instances) selected, 1541 configurations skipped (1541 by static filter, 0 at runtime). + INFO - :brd:`1 of 1543` test configurations passed (50.00%), :brd:`1` failed, :bbk:`0` errored, :byl:`1541` skipped with :bbk:`0` warnings in :bbk:`54.90 seconds` + INFO - In total 10 test cases were executed, 10799 skipped on 1 out of total 634 platforms (0.16%) INFO - :bgn:`2` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: @@ -79,10 +80,10 @@ Building and Running INFO - -+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ INFO - The following issues were found (showing the top 10 items): INFO - 1) tests/drivers/pwm/pwm_loopback/drivers.pwm.loopback on tiac_magpie failed (Failed) - INFO - + INFO - INFO - To rerun the tests, call twister using the following commandline: INFO - west twister -p -s , for example: - INFO - + INFO - INFO - west twister -p tiac_magpie -s tests/drivers/pwm/pwm_loopback/drivers.pwm.loopback INFO - or with west: INFO - west build -p -b tiac_magpie -T tests/drivers/pwm/pwm_loopback/drivers.pwm.loopback diff --git a/boards/arm/tiac_magpie/doc/tests/drivers/spi.rst b/boards/arm/tiac_magpie/doc/tests/drivers/spi.rst index dc32e8c4ae..690aca7be2 100644 --- a/boards/arm/tiac_magpie/doc/tests/drivers/spi.rst +++ b/boards/arm/tiac_magpie/doc/tests/drivers/spi.rst @@ -38,8 +38,9 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --extra-args SHIELD=loopback_test_tmph \ - --testsuite-root zephyr/tests/drivers/spi + --extra-args SHIELD="loopback_test_tmph" \ + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag spi .. group-tab:: Results @@ -56,13 +57,13 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 12/14 tiac_magpie tests/drivers/spi/spi_loopback/drivers.spi.loopback.internal :byl:`SKIPPED` (runtime filter) - INFO - 13/14 tiac_magpie tests/drivers/spi/dt_spec/drivers.spi.dt_spec :bgn:`PASSED` (device 3.103s) - INFO - 14/14 tiac_magpie tests/drivers/spi/spi_loopback/drivers.spi.loopback :bgn:`PASSED` (device 2.335s) + INFO - 1541/1543 tiac_magpie tests/drivers/spi/spi_loopback/drivers.spi.loopback.internal :byl:`SKIPPED` (runtime filter) + INFO - 1542/1543 tiac_magpie tests/drivers/spi/dt_spec/drivers.spi.dt_spec :bgn:`PASSED` (device: DT04BNT1, 2.673s) + INFO - 1543/1543 tiac_magpie tests/drivers/spi/spi_loopback/drivers.spi.loopback :bgn:`PASSED` (device: DT04BNT1, 2.386s) - INFO - 14 test scenarios (14 test instances) selected, 12 configurations skipped (11 by static filter, 1 at runtime). - INFO - :bgn:`2 of 14` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`12` skipped with :bbk:`0` warnings in :bbk:`24.60 seconds` - INFO - In total 2 test cases were executed, 24 skipped on 1 out of total 580 platforms (0.17%) + INFO - 1755 test scenarios (1543 test instances) selected, 1541 configurations skipped (1540 by static filter, 1 at runtime). + INFO - :bgn:`2 of 1543` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1541` skipped with :bbk:`0` warnings in :bbk:`22.08 seconds` + INFO - In total 2 test cases were executed, 10806 skipped on 1 out of total 634 platforms (0.16%) INFO - :bgn:`2` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: diff --git a/boards/arm/tiac_magpie/doc/tests/drivers/uart.rst b/boards/arm/tiac_magpie/doc/tests/drivers/uart.rst index 3c9503641e..8e453bba68 100644 --- a/boards/arm/tiac_magpie/doc/tests/drivers/uart.rst +++ b/boards/arm/tiac_magpie/doc/tests/drivers/uart.rst @@ -38,8 +38,9 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --extra-args SHIELD=loopback_test_tmph \ - --testsuite-root zephyr/tests/drivers/uart + --extra-args SHIELD="loopback_test_tmph" \ + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag uart .. group-tab:: Results ... t.b.d. @@ -56,19 +57,20 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 24/25 tiac_magpie tests/drivers/uart/uart_async_api/drivers.uart.async_api.lpuart :byl:`SKIPPED` (runtime filter) - INFO - 25/25 tiac_magpie tests/drivers/uart/uart_async_api/drivers.uart.async_api :byl:`SKIPPED` (runtime filter) + INFO - 1541/1543 tiac_magpie tests/drivers/uart/uart_async_api/drivers.uart.async_api :byl:`SKIPPED` (runtime filter) + INFO - 1542/1543 tiac_magpie tests/drivers/uart/uart_async_api/drivers.uart.async_api.lpuart :byl:`SKIPPED` (runtime filter) + INFO - 1543/1543 tiac_magpie tests/drivers/console/drivers.console.uart :bgn:`PASSED` (device: DT04BNT1, 2.420s) - INFO - 25 test scenarios (25 test instances) selected, 25 configurations skipped (23 by static filter, 2 at runtime). - INFO - :bgn:`0 of 25` test configurations passed (0.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`25` skipped with :bbk:`0` warnings in :bbk:`5.36 seconds` - INFO - In total 0 test cases were executed, 96 skipped on 1 out of total 580 platforms (0.17%) - INFO - :bgn:`0` test configurations executed on platforms, :brd:`0` test configurations were only built. + INFO - 1755 test scenarios (1543 test instances) selected, 1542 configurations skipped (1540 by static filter, 2 at runtime). + INFO - :bgn:`1 of 1543` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1542` skipped with :bbk:`0` warnings in :bbk:`22.21 seconds` + INFO - In total 1 test cases were executed, 10808 skipped on 1 out of total 634 platforms (0.16%) + INFO - :bgn:`1` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: \| Board \| ID \| Counter \| \|-------------\|----------\|-----------\| - \| tiac_magpie \| DT04BNT1 \| 0 \| + \| tiac_magpie \| DT04BNT1 \| 1 \| INFO - Saving reports... INFO - Writing JSON report .../twister-out/twister.json diff --git a/boards/arm/tiac_magpie/doc/tests/drivers/watchdog.rst b/boards/arm/tiac_magpie/doc/tests/drivers/watchdog.rst index 60ee974791..55cba0483d 100644 --- a/boards/arm/tiac_magpie/doc/tests/drivers/watchdog.rst +++ b/boards/arm/tiac_magpie/doc/tests/drivers/watchdog.rst @@ -32,8 +32,8 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --testsuite-root zephyr/tests/drivers/watchdog \ - --testsuite-root bridle/tests/drivers/watchdog + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag watchdog .. group-tab:: Results @@ -50,13 +50,13 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 12/14 tiac_magpie tests/drivers/watchdog/wdt_basic_api/drivers.watchdog :byl:`SKIPPED` (runtime filter) - INFO - 13/14 tiac_magpie wdt_basic_api/drivers.watchdog.stm32iwdg.tiac_magpie :bgn:`PASSED` (device 4.404s) - INFO - 14/14 tiac_magpie wdt_basic_api/drivers.watchdog.stm32wwdg.tiac_magpie :bgn:`PASSED` (device 2.414s) + INFO - 1541/1543 tiac_magpie tests/drivers/watchdog/wdt_basic_api/drivers.watchdog :byl:`SKIPPED` (runtime filter) + INFO - 1542/1543 tiac_magpie tests/drivers/watchdog/wdt_basic_api/drivers.watchdog.stm32iwdg :bgn:`PASSED` (device: DT04BNT1, 4.466s) + INFO - 1543/1543 tiac_magpie tests/drivers/watchdog/wdt_basic_api/drivers.watchdog.stm32wwdg :bgn:`PASSED` (device: DT04BNT1, 2.453s) - INFO - 14 test scenarios (14 test instances) selected, 12 configurations skipped ((0 by static filter, 1 at runtime). - INFO - :bgn:`2 of 14` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`12` skipped with :bbk:`0` warnings in :bbk:`31.40 seconds` - INFO - In total 2 test cases were executed, 13 skipped on 1 out of total 580 platforms (0.17%) + INFO - 1755 test scenarios (1543 test instances) selected, 1541 configurations skipped (1540 by static filter, 1 at runtime). + INFO - :bgn:`2 of 1543` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1541` skipped with :bbk:`0` warnings in :bbk:`27.89 seconds` + INFO - In total 2 test cases were executed, 10807 skipped on 1 out of total 634 platforms (0.16%) INFO - :bgn:`2` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: diff --git a/boards/arm/tiac_magpie/doc/tests/os/bridle.rst b/boards/arm/tiac_magpie/doc/tests/os/bridle.rst index 7c7fe0d058..58e5a7073b 100644 --- a/boards/arm/tiac_magpie/doc/tests/os/bridle.rst +++ b/boards/arm/tiac_magpie/doc/tests/os/bridle.rst @@ -32,7 +32,8 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --testsuite-root bridle/tests/bridle + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root bridle/tests --tag bridle .. group-tab:: Results @@ -49,12 +50,12 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 1/1 tiac_magpie common/bridle.common :bgn:`PASSED` (device 3.444s) + INFO - 257/257 tiac_magpie bridle/common/bridle.common :bgn:`PASSED` (device: DT04BNT1, 3.496s) - INFO - 1 test scenarios (1 test instances) selected, 0 configurations skipped (0 by static filter, 0 at runtime). - INFO - :bgn:`1 of 1` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`0` skipped with :bbk:`0` warnings in :bbk:`33.16 seconds` - INFO - In total 1 test cases were executed, 0 skipped on 1 out of total 580 platforms (0.17%) - INFO - :bgn:`1` test configurations executed on platforms, :brd:`0` test configurations were only built. + INFO - 257 test scenarios (257 test instances) selected, 256 configurations skipped (256 by static filter, 0 at runtime). + INFO - :bgn:`1 of 257` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`256` skipped with :bbk:`0` warnings in :bbk:`27.41 seconds` + INFO - In total 1 test cases were executed, 256 skipped on 1 out of total 634 platforms (0.16%) + INFO - 1 test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: diff --git a/boards/arm/tiac_magpie/doc/tests/os/kernel.rst b/boards/arm/tiac_magpie/doc/tests/os/kernel.rst index 10f0bc7327..6a66d56686 100644 --- a/boards/arm/tiac_magpie/doc/tests/os/kernel.rst +++ b/boards/arm/tiac_magpie/doc/tests/os/kernel.rst @@ -32,7 +32,8 @@ Building and Running --verbose --jobs 4 --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map map.yaml \ - --testsuite-root zephyr/tests/kernel + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root zephyr/tests --tag kernel --exclude-tag security .. group-tab:: Results @@ -49,117 +50,130 @@ Building and Running INFO - Adding tasks to the queue... INFO - Added initial list of jobs to queue - INFO - 48/147 tiac_magpie tests/kernel/mem_slab/mslab_stats/kernel.memory_slab.stats :bgn:`PASSED` (device 2.361s) - INFO - 49/147 tiac_magpie tests/kernel/pending/kernel.objects :bgn:`PASSED` (device 8.306s) - INFO - 50/147 tiac_magpie tests/kernel/mem_slab/mslab/kernel.memory_slabs :bgn:`PASSED` (device 3.094s) - INFO - 51/147 tiac_magpie tests/kernel/mem_slab/mslab_threadsafe/kernel.memory_slabs.threadsafe :bgn:`PASSED` (device 2.347s) - INFO - 52/147 tiac_magpie tests/kernel/mem_slab/mslab_api/kernel.memory_slabs.api :bgn:`PASSED` (device 8.388s) - INFO - 53/147 tiac_magpie tests/kernel/mem_slab/mslab_concept/kernel.memory_slabs.concept :bgn:`PASSED` (device 6.043s) - INFO - 54/147 tiac_magpie tests/kernel/stack/stack/kernel.stack.usage :bgn:`PASSED` (device 4.694s) - INFO - 55/147 tiac_magpie tests/kernel/semaphore/semaphore/kernel.semaphore :bgn:`PASSED` (device 15.413s) - INFO - 56/147 tiac_magpie tests/kernel/semaphore/sys_sem/kernel.semaphore.usage :bgn:`PASSED` (device 4.026s) - INFO - 57/147 tiac_magpie tests/kernel/common/kernel.common.picolibc :bgn:`PASSED` (device 7.653s) - INFO - 58/147 tiac_magpie tests/kernel/common/kernel.common.misra :byl:`SKIPPED` (runtime filter) - INFO - 59/147 tiac_magpie tests/kernel/common/kernel.common.nano64 :bgn:`PASSED` (device 7.716s) - INFO - 60/147 tiac_magpie tests/kernel/common/kernel.common.nano32 :bgn:`PASSED` (device 8.510s) - INFO - 61/147 tiac_magpie tests/kernel/common/kernel.common.minimallibc :bgn:`PASSED` (device 7.802s) - INFO - 62/147 tiac_magpie tests/kernel/spinlock/kernel.multiprocessing.spinlock :byl:`SKIPPED` (runtime filter) - INFO - 63/147 tiac_magpie tests/kernel/common/kernel.common.tls :bgn:`PASSED` (device 8.450s) - INFO - 64/147 tiac_magpie tests/kernel/usage/thread_runtime_stats/kernel.usage :bgn:`PASSED` (device 2.392s) - INFO - 65/147 tiac_magpie tests/kernel/common/kernel.common :bgn:`PASSED` (device 8.440s) - INFO - 66/147 tiac_magpie tests/kernel/mbox/mbox_api/kernel.mailbox.api :bgn:`PASSED` (device 3.964s) - INFO - 67/147 tiac_magpie tests/kernel/workq/critical/kernel.workqueue.critical.sam :byl:`SKIPPED` (runtime filter) - INFO - 68/147 tiac_magpie tests/kernel/mbox/mbox_usage/kernel.mailbox.usage :bgn:`PASSED` (device 2.554s) - INFO - 69/147 tiac_magpie tests/kernel/tickless/tickless_concept/kernel.tickless.concept :bgn:`PASSED` (device 3.286s) - INFO - 70/147 tiac_magpie tests/kernel/xip/arch.common.xip :bgn:`PASSED` (device 3.191s) - INFO - 71/147 tiac_magpie tests/kernel/workq/work/kernel.work.api :bgn:`PASSED` (device 6.074s) - INFO - 72/147 tiac_magpie tests/kernel/workq/critical/kernel.workqueue.critical :bgn:`PASSED` (device 2.483s) - INFO - 73/147 tiac_magpie tests/kernel/workq/work_queue/kernel.workqueue :bgn:`PASSED` (device 7.461s) - INFO - 74/147 tiac_magpie tests/kernel/profiling/profiling_api/kernel.common.profiling :bgn:`PASSED` (device 3.491s) - INFO - 75/147 tiac_magpie tests/kernel/sched/preempt/kernel.scheduler.preempt :bgn:`PASSED` (device 2.343s) - INFO - 76/147 tiac_magpie tests/kernel/workq/user_work/kernel.work.user :bgn:`PASSED` (device 3.113s) - INFO - 77/147 tiac_magpie tests/kernel/sched/metairq/kernel.scheduler.metairq :bgn:`PASSED` (device 2.981s) - INFO - 78/147 tiac_magpie tests/kernel/poll/kernel.poll :bgn:`PASSED` (device 7.785s) - INFO - 79/147 tiac_magpie tests/kernel/sched/deadline/kernel.scheduler.deadline :bgn:`PASSED` (device 4.943s) - INFO - 80/147 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler.dumb_no_timeslicing :bgn:`PASSED` (device 5.292s) - INFO - 81/147 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler.dumb_timeslicing :bgn:`PASSED` (device 21.162s) - INFO - 82/147 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler.multiq_no_timeslicing :bgn:`PASSED` (device 5.297s) - INFO - 83/147 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler.multiq :bgn:`PASSED` (device 21.072s) - INFO - 84/147 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler.slice_perthread :bgn:`PASSED` (device 21.848s) - INFO - 85/147 tiac_magpie tests/kernel/smp/kernel.multiprocessing.smp :byl:`SKIPPED` (runtime filter) - INFO - 86/147 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler.no_timeslicing :bgn:`PASSED` (device 5.242s) - INFO - 87/147 tiac_magpie tests/kernel/interrupt/arch.interrupt :bgn:`PASSED` (device 2.414s) - INFO - 88/147 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler :bgn:`PASSED` (device 21.145s) - INFO - 89/147 tiac_magpie tests/kernel/obj_tracking/kernel.objects.tracking :bgn:`PASSED` (device 3.299s) - INFO - 90/147 tiac_magpie tests/kernel/queue/kernel.queue :bgn:`PASSED` (device 4.688s) - INFO - 91/147 tiac_magpie tests/kernel/sleep/kernel.common.timing :bgn:`PASSED` (device 5.934s) - INFO - 92/147 tiac_magpie tests/kernel/timer/timer_api/kernel.timer.tickless :bgn:`PASSED` (device 7.325s) - INFO - 93/147 tiac_magpie tests/kernel/timer/timer_behavior/kernel.timer.timer :bgn:`PASSED` (device 33.383s) - INFO - 94/147 tiac_magpie tests/kernel/timer/timer_error_case/kernel.timer.error_case :bgn:`PASSED` (device 3.459s) - INFO - 95/147 tiac_magpie tests/kernel/cache/kernel.cache.api :byl:`SKIPPED` (runtime filter) - INFO - 96/147 tiac_magpie tests/kernel/timer/timer_api/kernel.timer :bgn:`PASSED` (device 6.616s) - INFO - 97/147 tiac_magpie tests/kernel/timer/timer_monotonic/kernel.timer.monotonic :bgn:`PASSED` (device 4.286s) - INFO - 98/147 tiac_magpie tests/kernel/mem_heap/mheap_api_concept/kernel.memory_heap :bgn:`PASSED` (device 3.103s) - INFO - 99/147 tiac_magpie tests/kernel/mem_heap/k_heap_api/kernel.k_heap_api :bgn:`PASSED` (device 3.171s) - INFO - 100/147 tiac_magpie tests/kernel/fifo/fifo_usage/kernel.fifo.usage :bgn:`PASSED` (device 3.500s) - INFO - 101/147 tiac_magpie tests/kernel/fifo/fifo_api/kernel.fifo :bgn:`PASSED` (device 2.966s) - INFO - 102/147 tiac_magpie tests/kernel/fpu_sharing/float_disable/kernel.fpu_sharing.float_disable :bgn:`PASSED` (device 3.761s) - INFO - 103/147 tiac_magpie tests/kernel/fifo/fifo_timeout/kernel.fifo.timeout :bgn:`PASSED` (device 2.648s) - INFO - 104/147 tiac_magpie tests/kernel/early_sleep/kernel.common.sleep :bgn:`PASSED` (device 3.906s) - INFO - 105/147 tiac_magpie tests/kernel/threads/tls/kernel.threads.tls :bgn:`PASSED` (device 3.768s) - INFO - 106/147 tiac_magpie tests/kernel/threads/tls/kernel.threads.tls.userspace :bgn:`PASSED` (device 4.177s) - INFO - 107/147 tiac_magpie tests/kernel/threads/thread_apis/kernel.threads.apis :bgn:`PASSED` (device 9.400s) - INFO - 108/147 tiac_magpie tests/kernel/threads/dynamic_thread/kernel.threads.dynamic :bgn:`PASSED` (device 4.763s) - INFO - 109/147 tiac_magpie tests/kernel/threads/thread_stack/kernel.threads.armv8m_mpu_stack_guard :byl:`SKIPPED` (runtime filter) - INFO - 110/147 tiac_magpie tests/kernel/threads/thread_init/kernel.threads.init :bgn:`PASSED` (device 6.969s) - INFO - 111/147 tiac_magpie tests/kernel/fatal/message_capture/kernel.logging.message_capture :bgn:`PASSED` (device 2.460s) - INFO - 112/147 tiac_magpie tests/kernel/threads/thread_error_case/kernel.threads.error.case :bgn:`PASSED` (device 4.110s) - INFO - 113/147 tiac_magpie tests/kernel/fatal/exception/kernel.common.stack_protection_armv8m_mpu_stack_guard :byl:`SKIPPED` (runtime filter) - INFO - 114/147 tiac_magpie tests/kernel/fatal/exception/kernel.common.stack_sentinel :bgn:`PASSED` (device 2.625s) - INFO - 115/147 tiac_magpie tests/kernel/threads/thread_stack/kernel.threads.thread_stack :bgn:`PASSED` (device 3.409s) - INFO - 116/147 tiac_magpie tests/kernel/fatal/exception/kernel.common.stack_protection_no_userspace :bgn:`PASSED` (device 3.588s) - INFO - 117/147 tiac_magpie tests/kernel/fatal/exception/kernel.common.stack_protection_arm_fpu_sharing :bgn:`PASSED` (device 4.135s) - INFO - 118/147 tiac_magpie tests/kernel/fatal/exception/kernel.common.stack_protection :bgn:`PASSED` (device 3.473s) - INFO - 119/147 tiac_magpie tests/kernel/device/kernel.device.pm :bgn:`PASSED` (device 3.233s) - INFO - 120/147 tiac_magpie tests/kernel/device/kernel.device :bgn:`PASSED` (device 3.743s) - INFO - 121/147 tiac_magpie tests/kernel/msgq/msgq_usage/kernel.message_queue_usage :bgn:`PASSED` (device 4.282s) - INFO - 122/147 tiac_magpie tests/kernel/msgq/msgq_api/kernel.message_queue :bgn:`PASSED` (device 4.454s) - INFO - 123/147 tiac_magpie tests/kernel/mp/kernel.multiprocessing :byl:`SKIPPED` (runtime filter) - INFO - 124/147 tiac_magpie tests/kernel/condvar/condvar_api/kernel.condvar :bgn:`PASSED` (device 4.716s) - INFO - 125/147 tiac_magpie tests/kernel/pipe/pipe_api/kernel.pipe.api :bgn:`PASSED` (device 5.586s) - INFO - 126/147 tiac_magpie tests/kernel/pipe/pipe/kernel.pipe :bgn:`PASSED` (device 5.788s) - INFO - 127/147 tiac_magpie tests/kernel/events/event_api/kernel.events :bgn:`PASSED` (device 3.730s) - INFO - 128/147 tiac_magpie tests/kernel/lifo/lifo_usage/kernel.lifo.usage :bgn:`PASSED` (device 3.380s) - INFO - 129/147 tiac_magpie tests/kernel/lifo/lifo_api/kernel.lifo :bgn:`PASSED` (device 3.046s) - INFO - 130/147 tiac_magpie tests/kernel/events/sys_event/kernel.events.usage :bgn:`PASSED` (device 4.203s) - INFO - 131/147 tiac_magpie tests/kernel/mem_protect/protection/kernel.memory_protection.protection :bgn:`PASSED` (device 2.830s) - INFO - 132/147 tiac_magpie tests/kernel/mem_protect/stack_random/kernel.memory_protection.stack_random :bgn:`PASSED` (device 2.921s) - INFO - 133/147 tiac_magpie tests/kernel/mem_protect/obj_validation/kernel.memory_protection.obj_validation :bgn:`PASSED` (device 3.048s) - INFO - 134/147 tiac_magpie tests/kernel/mem_protect/stackprot/kernel.memory_protection.stackprot :bgn:`PASSED` (device 4.569s) - INFO - 135/147 tiac_magpie tests/kernel/mem_protect/sys_sem/kernel.memory_protection.sys_sem.nouser :bgn:`PASSED` (device 3.270s) - INFO - 136/147 tiac_magpie tests/kernel/mem_protect/syscalls/kernel.memory_protection.syscalls :bgn:`PASSED` (device 18.117s) - INFO - 137/147 tiac_magpie tests/kernel/mem_protect/futex/kernel.futex :bgn:`PASSED` (device 3.463s) - INFO - 138/147 tiac_magpie tests/kernel/mem_protect/mem_map/kernel.memory_protection.mem_map.x86_64 :byl:`SKIPPED` (runtime filter) - INFO - 139/147 tiac_magpie tests/kernel/mem_protect/sys_sem/kernel.memory_protection.sys_sem :bgn:`PASSED` (device 3.894s) - INFO - 140/147 tiac_magpie tests/kernel/mem_protect/mem_map/kernel.memory_protection.mem_map :byl:`SKIPPED` (runtime filter) - INFO - 141/147 tiac_magpie tests/kernel/mem_protect/mem_protect/kernel.memory_protection :bgn:`PASSED` (device 7.617s) - INFO - 142/147 tiac_magpie tests/kernel/mutex/sys_mutex/system.mutex.nouser :bgn:`PASSED` (device 9.950s) - INFO - 143/147 tiac_magpie tests/kernel/mem_protect/userspace/kernel.memory_protection.userspace :bgn:`PASSED` (device 5.383s) - INFO - 144/147 tiac_magpie tests/kernel/mutex/sys_mutex/system.mutex :bgn:`PASSED` (device 11.270s) - INFO - 145/147 tiac_magpie tests/kernel/mutex/mutex_api/kernel.mutex :bgn:`PASSED` (device 15.075s) - INFO - 146/147 tiac_magpie tests/kernel/context/kernel.context :bgn:`PASSED` (device 7.912s) - INFO - 147/147 tiac_magpie tests/kernel/mutex/mutex_error_case/kernel.mutex_error_case :bgn:`PASSED` (device 3.347s) - - INFO - 147 test scenarios (147 test instances) selected, 57 configurations skipped (68 by static filter, 10 at runtime). - INFO - :bgn:`90 of 147` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`57` skipped with :bbk:`0` warnings in :bbk:`1186.80 seconds` - INFO - In total 1077 test cases were executed, 513 skipped on 1 out of total 580 platforms (0.17%) - INFO - :bgn:`90` test configurations executed on platforms, :brd:`0` test configurations were only built. + INFO - 1431/1543 tiac_magpie tests/kernel/mem_slab/mslab_stats/kernel.memory_slabs.stats :bgn:`PASSED` (device: DT04BNT1, 2.418s) + INFO - 1432/1543 tiac_magpie tests/kernel/mem_slab/mslab/kernel.memory_slabs :bgn:`PASSED` (device: DT04BNT1, 3.075s) + INFO - 1433/1543 tiac_magpie tests/kernel/pending/kernel.objects :bgn:`PASSED` (device: DT04BNT1, 8.381s) + INFO - 1434/1543 tiac_magpie tests/kernel/pending/kernel.objects.minimallibc :bgn:`PASSED` (device: DT04BNT1, 8.900s) + INFO - 1435/1543 tiac_magpie tests/kernel/mem_slab/mslab_threadsafe/kernel.memory_slabs.threadsafe :bgn:`PASSED` (device: DT04BNT1, 2.391s) + INFO - 1436/1543 tiac_magpie tests/kernel/mem_slab/mslab_api/kernel.memory_slabs.api :bgn:`PASSED` (device: DT04BNT1, 8.454s) + INFO - 1437/1543 tiac_magpie tests/kernel/mem_slab/mslab_concept/kernel.memory_slabs.concept :bgn:`PASSED` (device: DT04BNT1, 5.110s) + INFO - 1438/1543 tiac_magpie tests/kernel/stack/stack/kernel.stack.usage :bgn:`PASSED` (device: DT04BNT1, 5.112s) + INFO - 1439/1543 tiac_magpie tests/kernel/semaphore/semaphore/kernel.semaphore :bgn:`PASSED` (device: DT04BNT1, 16.140s) + INFO - 1440/1543 tiac_magpie tests/kernel/semaphore/sys_sem/kernel.semaphore.usage :bgn:`PASSED` (device: DT04BNT1, 3.242s) + INFO - 1441/1543 tiac_magpie tests/kernel/common/kernel.common.picolibc :bgn:`PASSED` (device: DT04BNT1, 7.822s) + INFO - 1442/1543 tiac_magpie tests/kernel/common/kernel.common.misra :byl:`SKIPPED` (runtime filter) + INFO - 1443/1543 tiac_magpie tests/kernel/common/kernel.common.nano64 :bgn:`PASSED` (device: DT04BNT1, 8.526s) + INFO - 1444/1543 tiac_magpie tests/kernel/common/kernel.common.nano32 :bgn:`PASSED` (device: DT04BNT1, 9.613s) + INFO - 1445/1543 tiac_magpie tests/kernel/common/kernel.common.minimallibc :bgn:`PASSED` (device: DT04BNT1, 7.819s) + INFO - 1446/1543 tiac_magpie tests/kernel/common/kernel.common.tls :bgn:`PASSED` (device: DT04BNT1, 8.064s) + INFO - 1447/1543 tiac_magpie tests/kernel/common/kernel.common :bgn:`PASSED` (device: DT04BNT1, 7.771s) + INFO - 1448/1543 tiac_magpie tests/kernel/usage/thread_runtime_stats/kernel.usage :bgn:`PASSED` (device: DT04BNT1, 2.341s) + INFO - 1449/1543 tiac_magpie tests/kernel/mbox/mbox_usage/kernel.mailbox.usage :bgn:`PASSED` (device: DT04BNT1, 2.348s) + INFO - 1450/1543 tiac_magpie tests/kernel/mbox/mbox_api/kernel.mailbox.api :bgn:`PASSED` (device: DT04BNT1, 3.505s) + INFO - 1451/1543 tiac_magpie tests/kernel/tickless/tickless_concept/kernel.tickless.concept :bgn:`PASSED` (device: DT04BNT1, 3.355s) + INFO - 1452/1543 tiac_magpie tests/kernel/workq/critical/kernel.workqueue.critical.sam :byl:`SKIPPED` (runtime filter) + INFO - 1453/1543 tiac_magpie tests/kernel/xip/arch.common.xip.minimallibc :bgn:`PASSED` (device: DT04BNT1, 2.587s) + INFO - 1454/1543 tiac_magpie tests/kernel/xip/arch.common.xip :bgn:`PASSED` (device: DT04BNT1, 2.973s) + INFO - 1455/1543 tiac_magpie tests/kernel/workq/work/kernel.workqueue.api :bgn:`PASSED` (device: DT04BNT1, 4.594s) + INFO - 1456/1543 tiac_magpie tests/kernel/workq/critical/kernel.workqueue.critical :bgn:`PASSED` (device: DT04BNT1, 2.501s) + INFO - 1457/1543 tiac_magpie tests/kernel/workq/work_queue/kernel.workqueue :bgn:`PASSED` (device: DT04BNT1, 7.511s) + INFO - 1458/1543 tiac_magpie tests/kernel/profiling/profiling_api/kernel.common.profiling :bgn:`PASSED` (device: DT04BNT1, 2.529s) + INFO - 1459/1543 tiac_magpie tests/kernel/workq/user_work/kernel.workqueue.user :bgn:`PASSED` (device: DT04BNT1, 3.059s) + INFO - 1460/1543 tiac_magpie tests/kernel/poll/kernel.poll :bgn:`PASSED` (device: DT04BNT1, 7.219s) + INFO - 1461/1543 tiac_magpie tests/kernel/sched/preempt/kernel.scheduler.preempt :bgn:`PASSED` (device: DT04BNT1, 2.990s) + INFO - 1462/1543 tiac_magpie tests/kernel/poll/kernel.poll.minimallibc :bgn:`PASSED` (device: DT04BNT1, 7.226s) + INFO - 1463/1543 tiac_magpie tests/kernel/sched/metairq/kernel.scheduler.metairq :bgn:`PASSED` (device: DT04BNT1, 3.009s) + INFO - 1464/1543 tiac_magpie tests/kernel/sched/deadline/kernel.scheduler.deadline :bgn:`PASSED` (device: DT04BNT1, 2.935s) + INFO - 1465/1543 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler.dumb_no_timeslicing :bgn:`PASSED` (device: DT04BNT1, 5.454s) + INFO - 1466/1543 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler.dumb_timeslicing :bgn:`PASSED` (device: DT04BNT1, 21.173s) + INFO - 1467/1543 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler.multiq :bgn:`PASSED` (device: DT04BNT1, 21.176s) + INFO - 1468/1543 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler.slice_perthread :bgn:`PASSED` (device: DT04BNT1, 21.144s) + INFO - 1469/1543 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler.multiq_no_timeslicing :bgn:`PASSED` (device: DT04BNT1, 5.339s) + INFO - 1470/1543 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler.no_timeslicing :bgn:`PASSED` (device: DT04BNT1, 5.348s) + INFO - 1471/1543 tiac_magpie tests/kernel/sched/schedule_api/kernel.scheduler :bgn:`PASSED` (device: DT04BNT1, 21.840s) + INFO - 1472/1543 tiac_magpie tests/kernel/interrupt/arch.interrupt :bgn:`PASSED` (device: DT04BNT1, 2.434s) + INFO - 1473/1543 tiac_magpie tests/kernel/smp/kernel.multiprocessing.smp.minimallibc :byl:`SKIPPED` (runtime filter) + INFO - 1474/1543 tiac_magpie tests/kernel/interrupt/arch.shared_interrupt :bgn:`PASSED` (device: DT04BNT1, 2.538s) + INFO - 1475/1543 tiac_magpie tests/kernel/smp/kernel.multiprocessing.smp :byl:`SKIPPED` (runtime filter) + INFO - 1476/1543 tiac_magpie tests/kernel/interrupt/arch.interrupt.minimallibc :bgn:`PASSED` (device: DT04BNT1, 2.521s) + INFO - 1477/1543 tiac_magpie tests/kernel/obj_tracking/kernel.objects.tracking :bgn:`PASSED` (device: DT04BNT1, 3.016s) + INFO - 1478/1543 tiac_magpie tests/kernel/obj_tracking/kernel.objects.tracking.minimallibc :bgn:`PASSED` (device: DT04BNT1, 2.639s) + INFO - 1479/1543 tiac_magpie tests/kernel/queue/kernel.queue :bgn:`PASSED` (device: DT04BNT1, 4.803s) + INFO - 1480/1543 tiac_magpie tests/kernel/queue/kernel.queue.minimallibc :bgn:`PASSED` (device: DT04BNT1, 4.790s) + INFO - 1481/1543 tiac_magpie tests/kernel/sleep/kernel.common.timing :bgn:`PASSED` (device: DT04BNT1, 6.559s) + INFO - 1482/1543 tiac_magpie tests/kernel/sleep/kernel.common.timing.minimallibc :bgn:`PASSED` (device: DT04BNT1, 6.804s) + INFO - 1483/1543 tiac_magpie tests/kernel/timer/timer_behavior/kernel.timer.timer :bgn:`PASSED` (device: DT04BNT1, 32.908s) + INFO - 1484/1543 tiac_magpie tests/kernel/timer/timer_error_case/kernel.timer.error_case :bgn:`PASSED` (device: DT04BNT1, 3.476s) + INFO - 1485/1543 tiac_magpie tests/kernel/timer/timer_api/kernel.timer.tickless :bgn:`PASSED` (device: DT04BNT1, 6.548s) + INFO - 1486/1543 tiac_magpie tests/kernel/cache/kernel.cache.api.minimallibc :byl:`SKIPPED` (runtime filter) + INFO - 1487/1543 tiac_magpie tests/kernel/timer/timer_api/kernel.timer :bgn:`PASSED` (device: DT04BNT1, 6.959s) + INFO - 1488/1543 tiac_magpie tests/kernel/cache/kernel.cache.api :byl:`SKIPPED` (runtime filter) + INFO - 1489/1543 tiac_magpie tests/kernel/timer/timepoints/kernel.timer.timepoints :bgn:`PASSED` (device: DT04BNT1, 3.419s) + INFO - 1490/1543 tiac_magpie tests/kernel/timer/timer_monotonic/kernel.timer.monotonic :bgn:`PASSED` (device: DT04BNT1, 3.723s) + INFO - 1491/1543 tiac_magpie tests/kernel/mem_heap/mheap_api_concept/kernel.memory_heap :bgn:`PASSED` (device: DT04BNT1, 3.221s) + INFO - 1492/1543 tiac_magpie tests/kernel/mem_heap/k_heap_api/kernel.k_heap_api :bgn:`PASSED` (device: DT04BNT1, 3.338s) + INFO - 1493/1543 tiac_magpie tests/kernel/fifo/fifo_usage/kernel.fifo.usage :bgn:`PASSED` (device: DT04BNT1, 2.421s) + INFO - 1494/1543 tiac_magpie tests/kernel/fifo/fifo_api/kernel.fifo :bgn:`PASSED` (device: DT04BNT1, 3.644s) + INFO - 1495/1543 tiac_magpie tests/kernel/fpu_sharing/float_disable/kernel.fpu_sharing.float_disable :bgn:`PASSED` (device: DT04BNT1, 3.051s) + INFO - 1496/1543 tiac_magpie tests/kernel/fifo/fifo_timeout/kernel.fifo.timeout :bgn:`PASSED` (device: DT04BNT1, 3.427s) + INFO - 1497/1543 tiac_magpie tests/kernel/early_sleep/kernel.common.sleep.minimallibc :bgn:`PASSED` (device: DT04BNT1, 4.697s) + INFO - 1498/1543 tiac_magpie tests/kernel/early_sleep/kernel.common.sleep :bgn:`PASSED` (device: DT04BNT1, 3.862s) + INFO - 1499/1543 tiac_magpie tests/kernel/threads/tls/kernel.threads.tls :bgn:`PASSED` (device: DT04BNT1, 3.426s) + INFO - 1500/1543 tiac_magpie tests/kernel/threads/tls/kernel.threads.tls.userspace :bgn:`PASSED` (device: DT04BNT1, 3.994s) + INFO - 1501/1543 tiac_magpie tests/kernel/threads/thread_apis/kernel.threads.apis :bgn:`PASSED` (device: DT04BNT1, 9.494s) + INFO - 1502/1543 tiac_magpie tests/kernel/threads/dynamic_thread/kernel.threads.dynamic :bgn:`PASSED` (device: DT04BNT1, 4.925s) + INFO - 1503/1543 tiac_magpie tests/kernel/threads/thread_init/kernel.threads.init :bgn:`PASSED` (device: DT04BNT1, 7.067s) + INFO - 1504/1543 tiac_magpie tests/kernel/fatal/message_capture/kernel.logging.message_capture :bgn:`PASSED` (device: DT04BNT1, 2.893s) + INFO - 1505/1543 tiac_magpie tests/kernel/fatal/exception/kernel.common.stack_protection_armv8m_mpu_stack_guard :byl:`SKIPPED` (runtime filter) + INFO - 1506/1543 tiac_magpie tests/kernel/fatal/exception/kernel.common.stack_sentinel :bgn:`PASSED` (device: DT04BNT1, 2.663s) + INFO - 1507/1543 tiac_magpie tests/kernel/threads/thread_error_case/kernel.threads.error.case :bgn:`PASSED` (device: DT04BNT1, 3.492s) + INFO - 1508/1543 tiac_magpie tests/kernel/fatal/exception/kernel.common.stack_protection_no_userspace :bgn:`PASSED` (device: DT04BNT1, 2.645s) + INFO - 1509/1543 tiac_magpie tests/kernel/fatal/exception/kernel.common.stack_protection_arm_fpu_sharing :bgn:`PASSED` (device: DT04BNT1, 4.218s) + INFO - 1510/1543 tiac_magpie tests/kernel/device/kernel.device.pm :bgn:`PASSED` (device: DT04BNT1, 4.461s) + INFO - 1511/1543 tiac_magpie tests/kernel/fatal/exception/kernel.common.stack_protection :bgn:`PASSED` (device: DT04BNT1, 3.468s) + INFO - 1512/1543 tiac_magpie tests/kernel/msgq/msgq_usage/kernel.message_queue.usage :bgn:`PASSED` (device: DT04BNT1, 3.452s) + INFO - 1513/1543 tiac_magpie tests/kernel/device/kernel.device.minimallibc :bgn:`PASSED` (device: DT04BNT1, 3.281s) + INFO - 1514/1543 tiac_magpie tests/kernel/device/kernel.device :bgn:`PASSED` (device: DT04BNT1, 3.912s) + INFO - 1515/1543 tiac_magpie tests/kernel/msgq/msgq_api/kernel.message_queue :bgn:`PASSED` (device: DT04BNT1, 4.669s) + INFO - 1516/1543 tiac_magpie tests/kernel/condvar/condvar_api/kernel.condvar :bgn:`PASSED` (device: DT04BNT1, 5.407s) + INFO - 1517/1543 tiac_magpie tests/kernel/pipe/pipe_api/kernel.pipe.api :bgn:`PASSED` (device: DT04BNT1, 5.511s) + INFO - 1518/1543 tiac_magpie tests/kernel/pipe/pipe/kernel.pipe :bgn:`PASSED` (device: DT04BNT1, 6.406s) + INFO - 1519/1543 tiac_magpie tests/kernel/events/sys_event/kernel.events.usage :bgn:`PASSED` (device: DT04BNT1, 4.018s) + INFO - 1520/1543 tiac_magpie tests/kernel/lifo/lifo_usage/kernel.lifo.usage :bgn:`PASSED` (device: DT04BNT1, 2.944s) + INFO - 1521/1543 tiac_magpie tests/kernel/mem_protect/stackprot/kernel.memory_protection.stackprot_tls :byl:`SKIPPED` (runtime filter) + INFO - 1522/1543 tiac_magpie tests/kernel/events/event_api/kernel.events :bgn:`PASSED` (device: DT04BNT1, 3.564s) + INFO - 1523/1543 tiac_magpie tests/kernel/lifo/lifo_api/kernel.lifo :bgn:`PASSED` (device: DT04BNT1, 2.918s) + INFO - 1524/1543 tiac_magpie tests/kernel/mem_protect/stack_random/kernel.memory_protection.stack_random :bgn:`PASSED` (device: DT04BNT1, 2.930s) + INFO - 1525/1543 tiac_magpie tests/kernel/mem_protect/sys_sem/kernel.memory_protection.sys_sem.nouser :bgn:`PASSED` (device: DT04BNT1, 3.880s) + INFO - 1526/1543 tiac_magpie tests/kernel/mem_protect/mem_map/kernel.memory_protection.mem_map.x86_64 :byl:`SKIPPED` (runtime filter) + INFO - 1527/1543 tiac_magpie tests/kernel/mem_protect/stackprot/kernel.memory_protection.stackprot :bgn:`PASSED` (device: DT04BNT1, 3.903s) + INFO - 1528/1543 tiac_magpie tests/kernel/mem_protect/mem_map/kernel.memory_protection.mem_map :byl:`SKIPPED` (runtime filter) + INFO - 1529/1543 tiac_magpie tests/kernel/mem_protect/futex/kernel.futex :bgn:`PASSED` (device: DT04BNT1, 3.525s) + INFO - 1530/1543 tiac_magpie tests/kernel/mutex/sys_mutex/kernel.mutex.system.nouser :bgn:`PASSED` (device: DT04BNT1, 9.947s) + INFO - 1531/1543 tiac_magpie tests/kernel/mem_protect/sys_sem/kernel.memory_protection.sys_sem :bgn:`PASSED` (device: DT04BNT1, 4.078s) + INFO - 1532/1543 tiac_magpie tests/kernel/mutex/sys_mutex/kernel.mutex.system :bgn:`PASSED` (device: DT04BNT1, 10.678s) + INFO - 1533/1543 tiac_magpie tests/kernel/context/kernel.context.minimallibc :bgn:`PASSED` (device: DT04BNT1, 7.949s) + INFO - 1534/1543 tiac_magpie tests/kernel/mutex/mutex_error_case/kernel.mutex.error :bgn:`PASSED` (device: DT04BNT1, 3.320s) + INFO - 1535/1543 tiac_magpie tests/kernel/mutex/mutex_api/kernel.mutex :bgn:`PASSED` (device: DT04BNT1, 15.215s) + INFO - 1536/1543 tiac_magpie tests/lib/p4workq/libraries.p4wq :bgn:`PASSED` (device: DT04BNT1, 2.600s) + INFO - 1537/1543 tiac_magpie tests/benchmarks/latency_measure/benchmark.kernel.latency :byl:`SKIPPED` (runtime filter) + INFO - 1538/1543 tiac_magpie tests/benchmarks/latency_measure/benchmark.kernel.latency.stm32 :bgn:`PASSED` (device: DT04BNT1, 3.055s) + INFO - 1539/1543 tiac_magpie tests/kernel/context/kernel.context :bgn:`PASSED` (device: DT04BNT1, 7.937s) + INFO - 1540/1543 tiac_magpie tests/benchmarks/sys_kernel/benchmark.kernel.core :bgn:`PASSED` (device: DT04BNT1, 4.759s) + INFO - 1541/1543 tiac_magpie tests/benchmarks/data_structure_perf/rbtree_perf/benchmark.data_structure_perf.rbtree :bgn:`PASSED` (device: DT04BNT1, 2.344s) + INFO - 1542/1543 tiac_magpie tests/benchmarks/data_structure_perf/dlist_perf/benchmark.data_structure_perf.dlist :bgn:`PASSED` (device: DT04BNT1, 2.903s) + INFO - 1543/1543 tiac_magpie tests/benchmarks/app_kernel/benchmark.kernel.application :bgn:`PASSED` (device: DT04BNT1, 9.464s) + + INFO - 1755 test scenarios (1543 test instances) selected, 1441 configurations skipped (1430 by static filter, 11 at runtime). + INFO - :bgn:`102 of 1543` test configurations passed (100.00%), :bbk:`0` failed, :bbk:`0` errored, :byl:`1441` skipped with :bbk:`0` warnings in :bbk:`895.49 seconds` + INFO - In total 1075 test cases were executed, 9721 skipped on 1 out of total 634 platforms (0.16%) + INFO - :bgn:`102` test configurations executed on platforms, :brd:`0` test configurations were only built. Hardware distribution summary: \| Board \| ID \| Counter \| \|-------------\|----------\|-----------\| - \| tiac_magpie \| DT04BNT1 \| 90 \| + \| tiac_magpie \| DT04BNT1 \| 102 \| INFO - Saving reports... INFO - Writing JSON report .../twister-out/twister.json From 5b88911d2c3369400b54fa5545edd3370445c4b4 Mon Sep 17 00:00:00 2001 From: Stephan Linz Date: Fri, 29 Sep 2023 04:09:55 +0200 Subject: [PATCH 11/12] ci: github: qa-shields: convert to use alt-config Signed-off-by: Stephan Linz --- .github/workflows/qa-integration.yml | 30 ++++++++++++++++------------ 1 file changed, 17 insertions(+), 13 deletions(-) diff --git a/.github/workflows/qa-integration.yml b/.github/workflows/qa-integration.yml index 13589852a7..eae473d4b3 100644 --- a/.github/workflows/qa-integration.yml +++ b/.github/workflows/qa-integration.yml @@ -209,25 +209,29 @@ jobs: # too high and most of the core tests are already performed by # Zephyr in any case: # - # --testsuite-root zephyr/tests/kernel \ - # --testsuite-root zephyr/tests/arch/arm \ + # --tag arm \ + # --tag vector_relay \ + # --tag kernel \ # west twister --verbose --jobs 4 \ --retry-failed 5 --retry-interval 120 \ --outdir twister-out --no-clean --inline-logs \ --enable-size-report --platform-reports \ --device-testing --hardware-map ${HARDWARE_MAP} \ - --extra-args SHIELD="loopback_test_tmph can_timing_adj" \ - --testsuite-root bridle/tests/bridle \ - --testsuite-root zephyr/tests/crypto/rand32 \ - --testsuite-root zephyr/tests/drivers/entropy \ - --testsuite-root bridle/tests/drivers/watchdog \ - --testsuite-root zephyr/tests/drivers/watchdog \ - --testsuite-root zephyr/tests/drivers/counter \ - --testsuite-root zephyr/tests/drivers/hwinfo \ - --testsuite-root zephyr/tests/drivers/gpio \ - --testsuite-root zephyr/tests/drivers/spi \ - --testsuite-root zephyr/tests/drivers/can + --extra-args SHIELD="loopback_test_tmph" \ + --alt-config-root bridle/zephyr/alt-config \ + --testsuite-root bridle/tests \ + --testsuite-root zephyr/tests \ + --tag bridle \ + --tag hwinfo \ + --tag random \ + --tag entropy \ + --tag watchdog \ + --tag counter \ + --tag gpio \ + --tag spi \ + --tag uart \ + --tag can - name: Upload integration test results uses: actions/upload-artifact@v3 From c844acf5de94a9dde689b9bf074d96c4d615af7e Mon Sep 17 00:00:00 2001 From: Stephan Linz Date: Fri, 29 Sep 2023 04:13:26 +0200 Subject: [PATCH 12/12] release: update draft notes for upcoming 3.5.0 Signed-off-by: Stephan Linz --- doc/bridle/releases/release-notes-3.5.0.rst | 3 +++ 1 file changed, 3 insertions(+) diff --git a/doc/bridle/releases/release-notes-3.5.0.rst b/doc/bridle/releases/release-notes-3.5.0.rst index db94fb0fdd..283886a3a3 100644 --- a/doc/bridle/releases/release-notes-3.5.0.rst +++ b/doc/bridle/releases/release-notes-3.5.0.rst @@ -144,6 +144,8 @@ Take over the new build principles from Zephyr: * Rename CAN driver: ``stm32-can`` to ``stm32-bxcan``. * Convert all specific ``@usbcons`` board revisions to USB Console Snippet. * Remove all specific ``@uartcons`` board revisions. +* Convert all active test cases to use the new Twister CLI argument + ``--alt-config-root``. Also remove the abandoned shield ``can_timing_adj``. Documentation ============= @@ -165,6 +167,7 @@ Issue Related Items These GitHub issues were addressed since project bootstrapping: * :github:`128` - [FER] Provide USB console by snippets instead of specific board revision +* :github:`127` - [FER] Provide CAN timing tweak for TiaC Magpie by snippets instead of a shield * :github:`125` - [BUG] Nightly QA integration test fails (convert to ``stm32-bxcan``) * :github:`122` - [HW] Waveshare RP2040 * :github:`120` - [BUG] Nightly QA integration test fails