Bq-ingest failure while processing 16 backfilled releases and 1 release from 2024-12-15

[theferrit32]

It succeeded on the first 16 ones. Failed partway through the 12-15 release.

Job began at 2:45AM EST Dec 17 2024.

Failed at 11:24AM EST Dec 17 2024

clinvar-bq-ingest-5tczr | Dec 17, 2024, 2:45:05 AM | 1/1 completed | Dec 17, 2024, 11:24:41 AM

Will investigate why the job succeeded with exit code 0 even though there was an exception.

[theferrit32]

Google Cloud Logs:
downloaded-logs-20241218-144327.json

[theferrit32]

Cloud Logs query string:

resource.type = "cloud_run_job" resource.labels.job_name = "clinvar-bq-ingest" labels."run.googleapis.com/execution_name" = "clinvar-bq-ingest-5tczr" resource.labels.location = "us-east1" labels."run.googleapis.com/task_index" = "0" severity>=DEFAULT

[theferrit32]

Looks like just an intermittent network error, but the next time the bq-ingest job ran ~15 minutes later it should have re-run this one

[theferrit32]

Deleted the record for the partial bq-ingest run and deleted the 2024-12-15 v2_1_0 dataset in bigquery so it'd just run again

delete from `clingen-dev.clinvar_ingest.processing_history` 
where file_type = 'bq'
 and xml_release_date = '2024-12-15'