Skip to content

Commit

Permalink
Supporting > 10k federal awards (#3536)
Browse files Browse the repository at this point in the history 
* Allowing configurable MAX_ROWS

* Allowing 5 digits for award #s

* Lint

* Accept either AWARD-#### or AWARD-#####

This is an interim commit. It updates validations and tests to handle
one award pattern or the other, but not both within a single workbook.

* Lint

* Lint

* Removing a comment.

* Tweaking number length checks and error msgs

* Lint

* Increasing timeout to 3m

* Increasing gunicorn timeout to 3m

* Testing 10m

* Changing to 4m

* Fixing error msgs

* Bumping wb version to 1.1.0

* Bumping test wb versions to 1.1.0

* Fixing wbs that are supposed to pass

* Fixing wbs that are supposed to pass

---------

Co-authored-by: Matt Jadud <[email protected]>
  • Loading branch information
@phildominguez-gsa @jadudm
phildominguez-gsa and jadudm authored Mar 22, 2024
1 parent e2653a1 commit 1d3e326
Show file tree
Hide file tree
Showing 42 changed files with 90,369 additions and 37 deletions.
Binary file added backend/audit/fixtures/workbooks/should_fail/audit-findings/award-refs-of-mixed-lengths.xlsx
View file
Binary file not shown.
Binary file added backend/audit/fixtures/workbooks/should_fail/federal-awards/award-refs-of-mixed-lengths.xlsx
View file
Binary file not shown.
Binary file added backend/audit/fixtures/workbooks/should_fail/federal-awards/award-refs-of-wrong-lengths.xlsx
View file
Binary file not shown.
Binary file added ...udit/fixtures/workbooks/should_pass/100010-22-award-ref-len-5/additional-eins-100010.xlsx
View file
Binary file not shown.
Binary file added ...udit/fixtures/workbooks/should_pass/100010-22-award-ref-len-5/additional-ueis-100010.xlsx
View file
Binary file not shown.
Binary file added ...audit/fixtures/workbooks/should_pass/100010-22-award-ref-len-5/audit-findings-100010.xlsx
View file
Binary file not shown.
Binary file added .../fixtures/workbooks/should_pass/100010-22-award-ref-len-5/audit-findings-text-100010.xlsx
View file
Binary file not shown.
Binary file added ...xtures/workbooks/should_pass/100010-22-award-ref-len-5/corrective-action-plan-100010.xlsx
View file
Binary file not shown.
Binary file added ...audit/fixtures/workbooks/should_pass/100010-22-award-ref-len-5/federal-awards-100010.xlsx
View file
Binary file not shown.
Binary file added .../audit/fixtures/workbooks/should_pass/100010-22-award-ref-len-5/notes-to-sefa-100010.xlsx
View file
Binary file not shown.
Binary file added ...t/fixtures/workbooks/should_pass/100010-22-award-ref-len-5/secondary-auditors-100010.xlsx
View file
Binary file not shown.
387 changes: 387 additions & 0 deletions ...end/audit/fixtures/workbooks/should_pass/100010-22-award-ref-len-5/test-array-100010.json
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,387 @@
[
{
"endpoint": "additional_eins",
"report_id": "2022-06-TSTDAT-0000100010",
"rows": [],
"singletons": {
"auditee_uei": "VBF7RJTP7513"
}
},
{
"endpoint": "additional_ueis",
"report_id": "2022-06-TSTDAT-0000100010",
"rows": [],
"singletons": {
"auditee_uei": "VBF7RJTP7513"
}
},
{
"endpoint": "corrective_action_plans",
"report_id": "2022-06-TSTDAT-0000100010",
"rows": [],
"singletons": {
"auditee_uei": "VBF7RJTP7513"
}
},
{
"endpoint": "federal_awards",
"report_id": "2022-06-TSTDAT-0000100010",
"rows": [
{
"fields": [
"federal_program_name",
"federal_program_total",
"cluster_total",
"is_loan",
"is_direct",
"is_passthrough_award",
"passthrough_amount",
"is_major",
"findings_count",
"amount_expended"
],
"values": [
"COMMUNITY FACILITIES LOANS AND GRANTS",
69038,
0,
"N",
"Y",
"N",
"",
"N",
0,
69038
]
},
{
"fields": [
"federal_program_name",
"federal_program_total",
"cluster_total",
"is_loan",
"is_direct",
"is_passthrough_award",
"passthrough_amount",
"is_major",
"audit_report_type",
"findings_count",
"amount_expended"
],
"values": [
"SPECIAL PROGRAMS FOR THE AGING_TITLE III, PART B_GRANTS FOR SUPPORTIVE SERVICES AND SENIOR CENTERS",
487780,
2136511,
"N",
"N",
"Y",
279092,
"Y",
"U",
0,
487780
]
},
{
"fields": [
"federal_program_name",
"federal_program_total",
"cluster_total",
"is_loan",
"is_direct",
"is_passthrough_award",
"passthrough_amount",
"is_major",
"findings_count",
"amount_expended"
],
"values": [
"ECONOMIC DEVELOPMENT_SUPPORT FOR PLANNING ORGANIZATIONS",
217275,
0,
"N",
"Y",
"N",
"",
"N",
0,
217275
]
},
{
"fields": [
"federal_program_name",
"federal_program_total",
"cluster_total",
"is_loan",
"is_direct",
"is_passthrough_award",
"passthrough_amount",
"is_major",
"findings_count",
"amount_expended"
],
"values": [
"HIGHWAY PLANNING AND CONSTRUCTION",
15934,
0,
"N",
"N",
"N",
"",
"N",
0,
15934
]
},
{
"fields": [
"federal_program_name",
"federal_program_total",
"cluster_total",
"is_loan",
"is_direct",
"is_passthrough_award",
"passthrough_amount",
"is_major",
"audit_report_type",
"findings_count",
"amount_expended"
],
"values": [
"SPECIAL PROGRAMS FOR THE AGING_TITLE III, PART C_NUTRITION SERVICES",
1537303,
2136511,
"N",
"N",
"Y",
1435164,
"Y",
"U",
0,
1537303
]
},
{
"fields": [
"federal_program_name",
"federal_program_total",
"cluster_total",
"is_loan",
"is_direct",
"is_passthrough_award",
"passthrough_amount",
"is_major",
"audit_report_type",
"findings_count",
"amount_expended"
],
"values": [
"NUTRITION SERVICES INCENTIVE PROGRAM",
111428,
2136511,
"N",
"N",
"Y",
106587,
"Y",
"U",
0,
111428
]
},
{
"fields": [
"federal_program_name",
"federal_program_total",
"cluster_total",
"is_loan",
"is_direct",
"is_passthrough_award",
"passthrough_amount",
"is_major",
"findings_count",
"amount_expended"
],
"values": [
"SPECIAL PROGRAMS FOR THE AGING_TITLE III, PART D_DISEASE PREVENTION AND HEALTH PROMOTION SERVICES",
12958,
0,
"N",
"N",
"Y",
11771,
"N",
0,
12958
]
},
{
"fields": [
"federal_program_name",
"federal_program_total",
"cluster_total",
"is_loan",
"is_direct",
"is_passthrough_award",
"passthrough_amount",
"is_major",
"findings_count",
"amount_expended"
],
"values": [
"AFFORDABLE CARE ACT STATE HEALTH INSURANCE ASSISTANCE PROGRAM (SHIP) AND AGING AND DISABILITY RESOURCE CENTER (ADRC) OPTIONS COUNSELING FOR MEDICARE-MEDICAID INDIVIDUALS IN STATES WITH APPROVED FINANCIAL ALIGNMENT MODELS",
24996,
0,
"N",
"N",
"N",
"",
"N",
0,
24996
]
},
{
"fields": [
"federal_program_name",
"federal_program_total",
"cluster_total",
"is_loan",
"is_direct",
"is_passthrough_award",
"passthrough_amount",
"is_major",
"findings_count",
"amount_expended"
],
"values": [
"NATIONAL FAMILY CAREGIVER SUPPORT, TITLE III, PART E",
241571,
0,
"N",
"N",
"Y",
220328,
"N",
0,
241571
]
},
{
"fields": [
"federal_program_name",
"federal_program_total",
"cluster_total",
"is_loan",
"is_direct",
"is_passthrough_award",
"passthrough_amount",
"is_major",
"findings_count",
"amount_expended"
],
"values": [
"SPECIAL PROGRAMS FOR THE AGING_TITLE VII, CHAPTER 3_PROGRAMS FOR PREVENTION OF ELDER ABUSE, NEGLECT, AND EXPLOITATION",
6244,
0,
"N",
"N",
"N",
"",
"N",
0,
6244
]
},
{
"fields": [
"federal_program_name",
"federal_program_total",
"cluster_total",
"is_loan",
"is_direct",
"is_passthrough_award",
"passthrough_amount",
"is_major",
"findings_count",
"amount_expended"
],
"values": [
"MEDICARE ENROLLMENT ASSISTANCE PROGRAM",
14916,
0,
"N",
"N",
"N",
"",
"N",
0,
14916
]
},
{
"fields": [
"federal_program_name",
"federal_program_total",
"cluster_total",
"is_loan",
"is_direct",
"is_passthrough_award",
"passthrough_amount",
"is_major",
"findings_count",
"amount_expended"
],
"values": [
"SPECIAL PROGRAMS FOR THE AGING_TITLE IV_AND TITLE II_DISCRETIONARY PROJECTS",
14242,
0,
"N",
"N",
"N",
"",
"N",
0,
14242
]
}
],
"singletons": {
"auditee_uei": "VBF7RJTP7513",
"total_amount_expended": 2753685
}
},
{
"endpoint": "findings_text",
"report_id": "2022-06-TSTDAT-0000100010",
"rows": [],
"singletons": {
"auditee_uei": "VBF7RJTP7513"
}
},
{
"endpoint": "findings",
"report_id": "2022-06-TSTDAT-0000100010",
"rows": [],
"singletons": {}
},
{
"endpoint": "notes_to_sefa",
"report_id": "2022-06-TSTDAT-0000100010",
"rows": [],
"singletons": {
"accounting_policies": "Expenditures reported on the Schedule are reported on the accrual basis of accounting.Such expenditures are recognized following, as applicable, either the cost principles in OMB Circular A-87, Cost Principles for State, Local and Indian Tribal Governments, or the cost principles contained in the Uniform Guidance, wherein certain types of expenditures are not allowable or are limited as to reimbursement.",
"auditee_uei": "VBF7RJTP7513",
"is_minimis_rate_used": "N",
"rate_explained": "The auditee did not use the de minimis cost rate."
}
},
{
"endpoint": "secondary_auditor",
"report_id": "2022-06-TSTDAT-0000100010",
"rows": [],
"singletons": {
"auditee_uei": "VBF7RJTP7513"
}
}
]
Binary file modified backend/audit/fixtures/workbooks/should_pass/100010-22/federal-awards-100010.xlsx
View file
Binary file not shown.
Binary file modified backend/audit/fixtures/workbooks/should_pass/134732-21/audit-findings-134732.xlsx
View file
Binary file not shown.
Binary file modified backend/audit/fixtures/workbooks/should_pass/134732-21/federal-awards-134732.xlsx
View file
Binary file not shown.
Binary file added ...udit/fixtures/workbooks/should_pass/182926-22-award-ref-len-5/additional-eins-182926.xlsx
View file
Binary file not shown.
Binary file added ...udit/fixtures/workbooks/should_pass/182926-22-award-ref-len-5/additional-ueis-182926.xlsx
View file
Binary file not shown.
Binary file added ...audit/fixtures/workbooks/should_pass/182926-22-award-ref-len-5/audit-findings-182926.xlsx
View file
Binary file not shown.
Binary file added .../fixtures/workbooks/should_pass/182926-22-award-ref-len-5/audit-findings-text-182926.xlsx
View file
Binary file not shown.
Binary file added ...xtures/workbooks/should_pass/182926-22-award-ref-len-5/corrective-action-plan-182926.xlsx
View file
Binary file not shown.
Binary file added ...audit/fixtures/workbooks/should_pass/182926-22-award-ref-len-5/federal-awards-182926.xlsx
View file
Binary file not shown.
Binary file added .../audit/fixtures/workbooks/should_pass/182926-22-award-ref-len-5/notes-to-sefa-182926.xlsx
View file
Binary file not shown.
Binary file added ...t/fixtures/workbooks/should_pass/182926-22-award-ref-len-5/secondary-auditors-182926.xlsx
View file
Binary file not shown.
Loading

0 comments on commit 1d3e326

Please sign in to comment.