Skip to content

feat(ingest): allow max_workers=1 with ASYNC_BATCH rest sink (#12088) #27350

feat(ingest): allow max_workers=1 with ASYNC_BATCH rest sink (#12088)

feat(ingest): allow max_workers=1 with ASYNC_BATCH rest sink (#12088) #27350

Triggered via push December 10, 2024 23:32
Status Failure
Total duration 55m 8s
Artifacts 11
Build and Push DataHub Ingestion (Base) Docker Image
23s
Build and Push DataHub Ingestion (Base) Docker Image
Build and Push DataHub Upgrade Docker Image
3m 54s
Build and Push DataHub Upgrade Docker Image
Build and Push DataHub Elasticsearch Setup Docker Image
1m 3s
Build and Push DataHub Elasticsearch Setup Docker Image
Build and Push DataHub Frontend Docker Image
6m 1s
Build and Push DataHub Frontend Docker Image
Build and Push DataHub GMS Docker Image
3m 54s
Build and Push DataHub GMS Docker Image
Build and Push DataHub Kafka Setup Docker Image
1m 18s
Build and Push DataHub Kafka Setup Docker Image
Build and Push DataHub MAE Consumer Docker Image
3m 53s
Build and Push DataHub MAE Consumer Docker Image
Build and Push DataHub MCE Consumer Docker Image
3m 55s
Build and Push DataHub MCE Consumer Docker Image
Build and Push DataHub MySQL Setup Docker Image
50s
Build and Push DataHub MySQL Setup Docker Image
smoke_test_matrix
3s
smoke_test_matrix
Build and Push DataHub Ingestion (Base-Full) Docker Image
27s
Build and Push DataHub Ingestion (Base-Full) Docker Image
Build and Push DataHub Ingestion (Base-Slim) Docker Image
32s
Build and Push DataHub Ingestion (Base-Slim) Docker Image
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
42s
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
31s
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
[Monitoring] Scan Frontend images for vulnerabilities
36s
[Monitoring] Scan Frontend images for vulnerabilities
[Monitoring] Scan GMS images for vulnerabilities
41s
[Monitoring] Scan GMS images for vulnerabilities
[Monitoring] Scan Kafka Setup images for vulnerabilities
37s
[Monitoring] Scan Kafka Setup images for vulnerabilities
[Monitoring] Scan MAE consumer images for vulnerabilities
48s
[Monitoring] Scan MAE consumer images for vulnerabilities
[Monitoring] Scan MCE consumer images for vulnerabilities
40s
[Monitoring] Scan MCE consumer images for vulnerabilities
[Monitoring] Scan MySQL Setup images for vulnerabilities
27s
[Monitoring] Scan MySQL Setup images for vulnerabilities
Build and Push DataHub Ingestion (Full) Docker Images
4m 27s
Build and Push DataHub Ingestion (Full) Docker Images
Build and Push DataHub Ingestion Docker Images
3m 42s
Build and Push DataHub Ingestion Docker Images
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
2m 46s
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
Matrix: Run Smoke Tests
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
1m 53s
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
Deploy to Datahub HEAD
0s
Deploy to Datahub HEAD
Fit to window
Zoom out
Zoom in

Annotations

1 error, 70 warnings, and 7 notices
Run Smoke Tests (no_cypress_suite0)
Process completed with exit code 1.
setup
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Base) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
smoke_test_matrix
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/elasticsearch-setup/Dockerfile#L48
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/mysql-setup/Dockerfile#L37
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
Build and Push DataHub Ingestion (Base-Full) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/kafka-setup/Dockerfile#L78
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
Build and Push DataHub Ingestion (Base-Slim) Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan ElasticSearch setup images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan MySQL Setup images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan MySQL Setup images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan Kafka Setup images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Kafka Setup images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/datahub-mae-consumer/Dockerfile#L73
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
Build and Push DataHub MAE Consumer Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub MAE Consumer Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub MAE Consumer Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with ESPIPE: invalid seek, read
Build and Push DataHub MAE Consumer Docker Image
Failed to save cache entry with path '/home/runner/.gradle/caches,/home/runner/.gradle/notifications,/home/runner/.gradle/.setup-gradle' and key: gradle-home-v1|Linux|mae_consumer_build[af3ba857d1aca0645b0e3cf4a2d3906e]-d953718ab7b2090b3a03bdc578863f865e60759f: Error: Cache service responded with 429 during upload chunk.
Build and Push DataHub Upgrade Docker Image
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Upgrade Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with ESPIPE: invalid seek, read
Build and Push DataHub Upgrade Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with ESPIPE: invalid seek, read
Build and Push DataHub Upgrade Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with ESPIPE: invalid seek, read
Build and Push DataHub Upgrade Docker Image
Failed to save cache entry with path '/home/runner/.gradle/caches,/home/runner/.gradle/notifications,/home/runner/.gradle/.setup-gradle' and key: gradle-home-v1|Linux|datahub_upgrade_build[af3ba857d1aca0645b0e3cf4a2d3906e]-d953718ab7b2090b3a03bdc578863f865e60759f: Error: Cache service responded with 429 during upload chunk.
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/datahub-gms/Dockerfile#L83
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
Build and Push DataHub GMS Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub GMS Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with ESPIPE: invalid seek, read
Build and Push DataHub GMS Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with ESPIPE: invalid seek, read
Build and Push DataHub GMS Docker Image
Failed to save cache entry with path '/home/runner/.gradle/caches,/home/runner/.gradle/notifications,/home/runner/.gradle/.setup-gradle' and key: gradle-home-v1|Linux|gms_build[af3ba857d1aca0645b0e3cf4a2d3906e]-d953718ab7b2090b3a03bdc578863f865e60759f: Error: Cache service responded with 429 during upload chunk.
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/datahub-mce-consumer/Dockerfile#L74
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
Build and Push DataHub MCE Consumer Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub MCE Consumer Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with ESPIPE: invalid seek, read
Build and Push DataHub MCE Consumer Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with ESPIPE: invalid seek, read
Build and Push DataHub MCE Consumer Docker Image
Failed to save cache entry with path '/home/runner/.gradle/caches,/home/runner/.gradle/notifications,/home/runner/.gradle/.setup-gradle' and key: gradle-home-v1|Linux|mce_consumer_build[af3ba857d1aca0645b0e3cf4a2d3906e]-d953718ab7b2090b3a03bdc578863f865e60759f: Error: Cache service responded with 429 during upload chunk.
[Monitoring] Scan GMS images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan GMS images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan DataHub Upgrade images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan MCE consumer images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan MCE consumer images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan MAE consumer images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan MAE consumer images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
Build and Push DataHub Ingestion Docker Images
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion Docker Images
Failed to save cache entry with path '/home/runner/.gradle/caches/jars-*/*/' and key: gradle-instrumented-jars-v1-1199370f9dc1c4b8e0cf6f195b97e7cf: Error: Cache service responded with 429 during upload chunk.
Build and Push DataHub Ingestion Docker Images
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Ingestion Docker Images
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Ingestion Docker Images
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Ingestion Docker Images
Failed to save cache entry with path '/home/runner/.gradle/caches,/home/runner/.gradle/notifications,/home/runner/.gradle/.setup-gradle' and key: gradle-home-v1|Linux|datahub_ingestion_slim_build[af3ba857d1aca0645b0e3cf4a2d3906e]-d953718ab7b2090b3a03bdc578863f865e60759f: Error: Cache service responded with 429 during upload chunk.
JSON arguments recommended for ENTRYPOINT/CMD to prevent unintended behavior related to OS signals: docker/datahub-frontend/Dockerfile#L55
JSONArgsRecommended: JSON arguments recommended for CMD to prevent unintended behavior related to OS signals More info: https://docs.docker.com/go/dockerfile/rule/json-args-recommended/
Build and Push DataHub Frontend Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Frontend Docker Image
Failed to save cache entry with path '/home/runner/.gradle/caches/jars-*/*/' and key: gradle-instrumented-jars-v1-806942426ed73ca2a51b3088e9740d89: Error: Cache service responded with 429 during upload chunk.
Build and Push DataHub Frontend Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Frontend Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Frontend Docker Image
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Frontend Docker Image
Failed to save cache entry with path '/home/runner/.gradle/caches,/home/runner/.gradle/notifications,/home/runner/.gradle/.setup-gradle' and key: gradle-home-v1|Linux|frontend_build[af3ba857d1aca0645b0e3cf4a2d3906e]-d953718ab7b2090b3a03bdc578863f865e60759f: Error: Cache service responded with 429 during upload chunk.
Build and Push DataHub Ingestion (Full) Docker Images
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Build and Push DataHub Ingestion (Full) Docker Images
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Ingestion (Full) Docker Images
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Ingestion (Full) Docker Images
Unhandled error in Gradle post-action - job will continue: Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
Build and Push DataHub Ingestion (Full) Docker Images
Failed to save cache entry with path '/home/runner/.gradle/caches,/home/runner/.gradle/notifications,/home/runner/.gradle/.setup-gradle' and key: gradle-home-v1|Linux|datahub_ingestion_full_build[af3ba857d1aca0645b0e3cf4a2d3906e]-d953718ab7b2090b3a03bdc578863f865e60759f: Error: Cache service responded with 429 during upload chunk.
[Monitoring] Scan Frontend images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Frontend images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
[Monitoring] Scan Datahub Ingestion images for vulnerabilities
CodeQL Action v2 will be deprecated on December 5th, 2024. Please update all occurrences of the CodeQL Action in your workflow files to v3. For more information, see https://github.blog/changelog/2024-01-12-code-scanning-deprecation-of-codeql-action-v2/
Run Smoke Tests (no_cypress_suite1)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (no_cypress_suite0)
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
Run Smoke Tests (no_cypress_suite0)
No files were found with the provided path: smoke-test/tests/cypress/cypress/screenshots/. No artifacts will be uploaded.
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "docker-logs-no_cypress_suite0", "Test Results (smoke tests) no_cypress_suite0", "Test Results (smoke tests) no_cypress_suite1". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
7 tests found
There are 7 tests, see "Raw output" for the full list of tests.
3 tests found
There are 3 tests, see "Raw output" for the full list of tests.
6 tests found
There are 6 tests, see "Raw output" for the full list of tests.
29 skipped tests found
There are 29 skipped tests, see "Raw output" for the full list of skipped tests.
1810 tests found (test 1 to 754)
There are 1810 tests, see "Raw output" for the list of tests 1 to 754.
1810 tests found (test 755 to 1465)
There are 1810 tests, see "Raw output" for the list of tests 755 to 1465.
1810 tests found (test 1466 to 1810)
There are 1810 tests, see "Raw output" for the list of tests 1466 to 1810.

Artifacts

Produced during runtime
Name Size
Test Results (smoke tests) no_cypress_suite0
17.5 KB
Test Results (smoke tests) no_cypress_suite1
5.34 KB
datahub-project~datahub~1X6HJG.dockerbuild
100 KB
datahub-project~datahub~2ZCBLG.dockerbuild
76.6 KB
datahub-project~datahub~9QTIHQ.dockerbuild
79.4 KB
datahub-project~datahub~C6JTUR.dockerbuild
59.2 KB
datahub-project~datahub~ICFMUQ.dockerbuild
89.2 KB
datahub-project~datahub~PVPVHM.dockerbuild
82.6 KB
datahub-project~datahub~UL8UEW.dockerbuild
55 KB
datahub-project~datahub~WLD8T5.dockerbuild
87.2 KB
docker-logs-no_cypress_suite0 Expired
5.43 MB