Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update dependencies #22

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Update action.yml

6a21ceb
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

Update dependencies #22

Update action.yml
6a21ceb
Select commit
Loading
Failed to load commit list.
GitHub Actions / Test Results (macOS python installed) failed Feb 22, 2024 in 0s

6 fail, 426 pass in 7m 3s

       26 files  ±0         26 suites  ±0   7m 3s ⏱️ -2s
     432 tests ±0       426 ✔️ +  1      0 💤 ±0      6 ❌  -   1 
11 232 runs  ±0  10 894 ✔️ +13  182 💤 ±0  156 ❌  - 13 

Results for commit 6a21ceb. ± Comparison against earlier commit 9ef807a.

Annotations

Check warning on line 1163 in python/test/test_action_script.py

See this annotation in the file changed.

@github-actions github-actions / Test Results (macOS python installed)

All 26 runs failed: test_main (python.test.test_action_script.Test) 

artifacts/Test Results (python-3.10, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.7, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.7, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, windows-2022)/test-results/pytest.xml [took 0s]
Raw output 
AssertionError: 735 != 731
self = <test_action_script.Test testMethod=test_main>

    def test_main(self):
        with tempfile.TemporaryDirectory() as path:
            filepath = os.path.join(path, 'file')
            with open(filepath, 'wt', encoding='utf-8') as file:
                file.write('{}')
    
            gha = mock.MagicMock()
            settings = get_settings(dict(
                COMMIT='commit',
                GITHUB_TOKEN='********',
                GITHUB_EVENT_PATH=file.name,
                GITHUB_EVENT_NAME='push',
                GITHUB_REPOSITORY='repo',
                EVENT_FILE=None,
                FILES='\n'.join(str(path) for path in [test_files_path / '**' / '*.xml',
                                                       test_files_path / '**' / '*.trx',
                                                       test_files_path / '**' / '*.json']),
                JUNIT_FILES=str(test_files_path / 'junit-xml' / '**' / '*.xml'),
                NUNIT_FILES=str(test_files_path / 'nunit' / '**' / '*.xml'),
                XUNIT_FILES=str(test_files_path / 'xunit' / '**' / '*.xml'),
                TRX_FILES=str(test_files_path / 'trx' / '**' / '*.trx'),
                REPORT_SUITE_LOGS='info'
            ), gha)
    
            with mock.patch('publish_test_results.get_github'), \
                 mock.patch('publish.publisher.Publisher.publish') as m:
                main(settings, gha)
    
                # Publisher.publish is expected to have been called once
                self.assertEqual(1, len(m.call_args_list))
                self.assertEqual(3, len(m.call_args_list[0].args))
    
                # Publisher.publish is expected to have been called with these arguments
                results, cases, conclusion = m.call_args_list[0].args
                self.assertEqual(145, results.files)
                if Version(sys.version.split(' ')[0]) < Version('3.9.0') and sys.platform.startswith('darwin') and \
                        (platform.mac_ver()[0].startswith("11.") or platform.mac_ver()[0].startswith("12.")):
                    # on macOS and below Python 3.9 we see one particular error
                    self.assertEqual(731, results.suites)
                    self.assertEqual(731, len(results.suite_details))
                    self.assertEqual(1811, len(cases))
                else:
>                   self.assertEqual(735, results.suites)
E                   AssertionError: 735 != 731

test_action_script.py:1206: AssertionError

Check warning on line 970 in python/test/test_action_script.py

See this annotation in the file changed.

@github-actions github-actions / Test Results (macOS python installed)

All 26 runs failed: test_parse_files (python.test.test_action_script.Test) 

artifacts/Test Results (python-3.10, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.7, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.7, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, windows-2022)/test-results/pytest.xml [took 0s]
Raw output 
AssertionError: 13 != 17
self = <test_action_script.Test testMethod=test_parse_files>

    def test_parse_files(self):
        gha = mock.MagicMock()
        settings = self.get_settings(files_glob='\n'.join([str(test_files_path / '**' / '*.xml'), str(test_files_path / '**' / '*.trx'), str(test_files_path / '**' / '*.json')]),
                                     junit_files_glob=str(test_files_path / 'junit-xml' / '**' / '*.xml'),
                                     nunit_files_glob=str(test_files_path / 'nunit' / '**' / '*.xml'),
                                     xunit_files_glob=str(test_files_path / 'xunit' / '**' / '*.xml'),
                                     trx_files_glob=str(test_files_path / 'trx' / '**' / '*.trx'))
        with mock.patch('publish_test_results.logger') as l:
            actual = parse_files(settings, gha)
    
            for call in l.info.call_args_list:
                print(call.args[0])
    
            self.assertEqual(17, len(l.info.call_args_list))
            self.assertTrue(any([call.args[0].startswith(f"Reading files {prettify_glob_pattern(settings.files_glob)} (76 files, ") for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Reading JUnit XML files {prettify_glob_pattern(settings.junit_files_glob)} (28 files, ') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Reading NUnit XML files {prettify_glob_pattern(settings.nunit_files_glob)} (24 files, ') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Reading XUnit XML files {prettify_glob_pattern(settings.xunit_files_glob)} (8 files, ') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Reading TRX files {prettify_glob_pattern(settings.trx_files_glob)} (9 files, ') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 27 JUnit XML files (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 24 NUnit XML files (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 8 XUnit XML files (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 9 TRX files (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 1 Dart JSON file (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 1 Mocha JSON file (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 4 unsupported files (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Unsupported file: ') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].endswith(f'python{os.sep}test{os.sep}files{os.sep}xml{os.sep}non-xml.xml') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].endswith(f'python{os.sep}test{os.sep}files{os.sep}junit-xml{os.sep}non-junit.xml') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].endswith(f'python{os.sep}test{os.sep}files{os.sep}json{os.sep}non-json.json') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].endswith(f'python{os.sep}test{os.sep}files{os.sep}json{os.sep}malformed-json.json') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Finished reading 145 files in ') for call in l.info.call_args_list]))
    
            for call in l.debug.call_args_list:
                print(call.args[0])
    
            self.assertEqual(11, len(l.debug.call_args_list))
            self.assertTrue(any([call.args[0].startswith('reading files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('reading JUnit XML files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('reading NUnit XML files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('reading XUnit XML files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('reading TRX files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('detected JUnit XML files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('detected NUnit XML files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('detected XUnit XML files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('detected TRX files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('detected Dart JSON files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('detected Mocha JSON files [') for call in l.debug.call_args_list]))
    
        self.assertEqual([], gha.method_calls)
    
        self.assertEqual(145, actual.files)
        if Version(sys.version.split(' ')[0]) < Version('3.9.0') and sys.platform.startswith('darwin') and \
                (platform.mac_ver()[0].startswith("11.") or platform.mac_ver()[0].startswith("12.")):
            # on macOS and below Python 3.9 we see one particular error
            self.assertEqual(17, len(actual.errors))
            self.assertEqual(731, actual.suites)
            self.assertEqual(4109, actual.suite_tests)
            self.assertEqual(214, actual.suite_skipped)
            self.assertEqual(450, actual.suite_failures)
            self.assertEqual(21, actual.suite_errors)
            self.assertEqual(7956, actual.suite_time)
            self.assertEqual(0, len(actual.suite_details))
            self.assertEqual(4085, len(actual.cases))
        else:
>           self.assertEqual(13, len(actual.errors))
E           AssertionError: 13 != 17

test_action_script.py:1036: AssertionError

Check warning on line 1090 in python/test/test_action_script.py

See this annotation in the file changed.

@github-actions github-actions / Test Results (macOS python installed)

All 26 runs failed: test_parse_files_with_suite_details (python.test.test_action_script.Test) 

artifacts/Test Results (python-3.10, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.7, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.7, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, windows-2022)/test-results/pytest.xml [took 0s]
Raw output 
AssertionError: 365 != 363
self = <test_action_script.Test testMethod=test_parse_files_with_suite_details>

    def test_parse_files_with_suite_details(self):
        for options in [
            {'report_suite_out_logs': True, 'report_suite_err_logs': False},
            {'report_suite_out_logs': False, 'report_suite_err_logs': True},
            {'report_suite_out_logs': True, 'report_suite_err_logs': True},
            {'json_suite_details': True}
        ]:
            with self.subTest(**options):
                gha = mock.MagicMock()
                settings = self.get_settings(junit_files_glob=str(test_files_path / 'junit-xml' / '**' / '*.xml'),
                                             nunit_files_glob=str(test_files_path / 'nunit' / '**' / '*.xml'),
                                             xunit_files_glob=str(test_files_path / 'xunit' / '**' / '*.xml'),
                                             trx_files_glob=str(test_files_path / 'trx' / '**' / '*.trx'),
                                             **options)
                actual = parse_files(settings, gha)
    
                if Version(sys.version.split(' ')[0]) < Version('3.9.0') and sys.platform.startswith('darwin') and \
                        (platform.mac_ver()[0].startswith("11.") or platform.mac_ver()[0].startswith("12.")):
                    # on macOS (below macOS 13) and Python below 3.9 we see one particular error
                    self.assertEqual(363, len(actual.suite_details))
                else:
>                   self.assertEqual(365, len(actual.suite_details))
E                   AssertionError: 365 != 363

test_action_script.py:1112: AssertionError

Check warning on line 1163 in python/test/test_action_script.py

See this annotation in the file changed.

@github-actions github-actions / Test Results (macOS python installed)

All 26 runs failed: test_main (python.test.test_junit.Test) 

artifacts/Test Results (python-3.10, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.7, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.7, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, windows-2022)/test-results/pytest.xml [took 0s]
Raw output 
AssertionError: 735 != 731
self = <test_action_script.Test testMethod=test_main>

    def test_main(self):
        with tempfile.TemporaryDirectory() as path:
            filepath = os.path.join(path, 'file')
            with open(filepath, 'wt', encoding='utf-8') as file:
                file.write('{}')
    
            gha = mock.MagicMock()
            settings = get_settings(dict(
                COMMIT='commit',
                GITHUB_TOKEN='********',
                GITHUB_EVENT_PATH=file.name,
                GITHUB_EVENT_NAME='push',
                GITHUB_REPOSITORY='repo',
                EVENT_FILE=None,
                FILES='\n'.join(str(path) for path in [test_files_path / '**' / '*.xml',
                                                       test_files_path / '**' / '*.trx',
                                                       test_files_path / '**' / '*.json']),
                JUNIT_FILES=str(test_files_path / 'junit-xml' / '**' / '*.xml'),
                NUNIT_FILES=str(test_files_path / 'nunit' / '**' / '*.xml'),
                XUNIT_FILES=str(test_files_path / 'xunit' / '**' / '*.xml'),
                TRX_FILES=str(test_files_path / 'trx' / '**' / '*.trx'),
                REPORT_SUITE_LOGS='info'
            ), gha)
    
            with mock.patch('publish_test_results.get_github'), \
                 mock.patch('publish.publisher.Publisher.publish') as m:
                main(settings, gha)
    
                # Publisher.publish is expected to have been called once
                self.assertEqual(1, len(m.call_args_list))
                self.assertEqual(3, len(m.call_args_list[0].args))
    
                # Publisher.publish is expected to have been called with these arguments
                results, cases, conclusion = m.call_args_list[0].args
                self.assertEqual(145, results.files)
                if Version(sys.version.split(' ')[0]) < Version('3.9.0') and sys.platform.startswith('darwin') and \
                        (platform.mac_ver()[0].startswith("11.") or platform.mac_ver()[0].startswith("12.")):
                    # on macOS and below Python 3.9 we see one particular error
                    self.assertEqual(731, results.suites)
                    self.assertEqual(731, len(results.suite_details))
                    self.assertEqual(1811, len(cases))
                else:
>                   self.assertEqual(735, results.suites)
E                   AssertionError: 735 != 731

test_action_script.py:1206: AssertionError

Check warning on line 970 in python/test/test_action_script.py

See this annotation in the file changed.

@github-actions github-actions / Test Results (macOS python installed)

All 26 runs failed: test_parse_files (python.test.test_junit.Test) 

artifacts/Test Results (python-3.10, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.7, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.7, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, windows-2022)/test-results/pytest.xml [took 0s]
Raw output 
AssertionError: 13 != 17
self = <test_action_script.Test testMethod=test_parse_files>

    def test_parse_files(self):
        gha = mock.MagicMock()
        settings = self.get_settings(files_glob='\n'.join([str(test_files_path / '**' / '*.xml'), str(test_files_path / '**' / '*.trx'), str(test_files_path / '**' / '*.json')]),
                                     junit_files_glob=str(test_files_path / 'junit-xml' / '**' / '*.xml'),
                                     nunit_files_glob=str(test_files_path / 'nunit' / '**' / '*.xml'),
                                     xunit_files_glob=str(test_files_path / 'xunit' / '**' / '*.xml'),
                                     trx_files_glob=str(test_files_path / 'trx' / '**' / '*.trx'))
        with mock.patch('publish_test_results.logger') as l:
            actual = parse_files(settings, gha)
    
            for call in l.info.call_args_list:
                print(call.args[0])
    
            self.assertEqual(17, len(l.info.call_args_list))
            self.assertTrue(any([call.args[0].startswith(f"Reading files {prettify_glob_pattern(settings.files_glob)} (76 files, ") for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Reading JUnit XML files {prettify_glob_pattern(settings.junit_files_glob)} (28 files, ') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Reading NUnit XML files {prettify_glob_pattern(settings.nunit_files_glob)} (24 files, ') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Reading XUnit XML files {prettify_glob_pattern(settings.xunit_files_glob)} (8 files, ') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Reading TRX files {prettify_glob_pattern(settings.trx_files_glob)} (9 files, ') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 27 JUnit XML files (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 24 NUnit XML files (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 8 XUnit XML files (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 9 TRX files (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 1 Dart JSON file (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 1 Mocha JSON file (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Detected 4 unsupported files (') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Unsupported file: ') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].endswith(f'python{os.sep}test{os.sep}files{os.sep}xml{os.sep}non-xml.xml') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].endswith(f'python{os.sep}test{os.sep}files{os.sep}junit-xml{os.sep}non-junit.xml') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].endswith(f'python{os.sep}test{os.sep}files{os.sep}json{os.sep}non-json.json') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].endswith(f'python{os.sep}test{os.sep}files{os.sep}json{os.sep}malformed-json.json') for call in l.info.call_args_list]))
            self.assertTrue(any([call.args[0].startswith(f'Finished reading 145 files in ') for call in l.info.call_args_list]))
    
            for call in l.debug.call_args_list:
                print(call.args[0])
    
            self.assertEqual(11, len(l.debug.call_args_list))
            self.assertTrue(any([call.args[0].startswith('reading files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('reading JUnit XML files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('reading NUnit XML files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('reading XUnit XML files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('reading TRX files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('detected JUnit XML files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('detected NUnit XML files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('detected XUnit XML files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('detected TRX files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('detected Dart JSON files [') for call in l.debug.call_args_list]))
            self.assertTrue(any([call.args[0].startswith('detected Mocha JSON files [') for call in l.debug.call_args_list]))
    
        self.assertEqual([], gha.method_calls)
    
        self.assertEqual(145, actual.files)
        if Version(sys.version.split(' ')[0]) < Version('3.9.0') and sys.platform.startswith('darwin') and \
                (platform.mac_ver()[0].startswith("11.") or platform.mac_ver()[0].startswith("12.")):
            # on macOS and below Python 3.9 we see one particular error
            self.assertEqual(17, len(actual.errors))
            self.assertEqual(731, actual.suites)
            self.assertEqual(4109, actual.suite_tests)
            self.assertEqual(214, actual.suite_skipped)
            self.assertEqual(450, actual.suite_failures)
            self.assertEqual(21, actual.suite_errors)
            self.assertEqual(7956, actual.suite_time)
            self.assertEqual(0, len(actual.suite_details))
            self.assertEqual(4085, len(actual.cases))
        else:
>           self.assertEqual(13, len(actual.errors))
E           AssertionError: 13 != 17

test_action_script.py:1036: AssertionError

Check warning on line 1090 in python/test/test_action_script.py

See this annotation in the file changed.

@github-actions github-actions / Test Results (macOS python installed)

All 26 runs failed: test_parse_files_with_suite_details (python.test.test_junit.Test) 

artifacts/Test Results (python-3.10, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.10, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.11, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.12.0-rc.3, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.7, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.7, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.8, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-3.9, windows-2022)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, ubuntu-20.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, ubuntu-22.04)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, windows-2019)/test-results/pytest.xml [took 0s]
artifacts/Test Results (python-installed, windows-2022)/test-results/pytest.xml [took 0s]
Raw output 
AssertionError: 365 != 363
self = <test_action_script.Test testMethod=test_parse_files_with_suite_details>

    def test_parse_files_with_suite_details(self):
        for options in [
            {'report_suite_out_logs': True, 'report_suite_err_logs': False},
            {'report_suite_out_logs': False, 'report_suite_err_logs': True},
            {'report_suite_out_logs': True, 'report_suite_err_logs': True},
            {'json_suite_details': True}
        ]:
            with self.subTest(**options):
                gha = mock.MagicMock()
                settings = self.get_settings(junit_files_glob=str(test_files_path / 'junit-xml' / '**' / '*.xml'),
                                             nunit_files_glob=str(test_files_path / 'nunit' / '**' / '*.xml'),
                                             xunit_files_glob=str(test_files_path / 'xunit' / '**' / '*.xml'),
                                             trx_files_glob=str(test_files_path / 'trx' / '**' / '*.trx'),
                                             **options)
                actual = parse_files(settings, gha)
    
                if Version(sys.version.split(' ')[0]) < Version('3.9.0') and sys.platform.startswith('darwin') and \
                        (platform.mac_ver()[0].startswith("11.") or platform.mac_ver()[0].startswith("12.")):
                    # on macOS (below macOS 13) and Python below 3.9 we see one particular error
                    self.assertEqual(363, len(actual.suite_details))
                else:
>                   self.assertEqual(365, len(actual.suite_details))
E                   AssertionError: 365 != 363

test_action_script.py:1112: AssertionError
View more details on GitHub Actions