This repository has been archived by the owner on May 30, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 0
/
data_sources.yaml
173 lines (151 loc) · 13.9 KB
/
data_sources.yaml
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
# Define data sources downloaded and used in the processing
#
# Syntax:
#
# An entry for each data source:
#
# - name: The data source name (used as a filename in later data processing steps)
# url: The URL where the raw data can be downloaded from
# output_file: The filename that should be used to save the freshly-downloaded data
# type: The type of data, which determines the later processing (census_lsoa_metric,
# census_msoa_metric, imd_lsoa_2011_metric, geodata or lookup)
# licence: A reminder of the licence that applies to this data (not directly used in processing)
# indicators: A list of indicators variables that can be calculated from this file (see below)
#
# Indicator formulae:
#
# The formulae variables referencing columns in the source data, e.g.
#
# new_column_name__pc: 100 * (column1_name + column2_name) / column3_name
#
# Units are usually given after a final `__` suffix, e.g. `__pc` for percent.
- name: oa_lsoa_msoa_lookup
url: https://www.arcgis.com/sharing/rest/content/items/792f7ab3a99d403ca02cc9ca1cf8af02/data
output_file: OA21_LSOA21_MSOA21_LAD22_EW_LU.csv
type: lookup
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
- name: lsoa_extents
url: https://opendata.arcgis.com/api/v3/datasets/766da1380a3544c5a7ca9131dfd4acb6_0/downloads/data?format=shp&spatialRefId=27700&where=1%3D1
output_file: LSOA_(Dec_2021)_Boundaries_Generalised_Clipped_EW_(BGC).zip
type: geodata
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0, Contains OS data © Crown copyright and database right [year] (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
- name: msoa_extents
url: https://opendata.arcgis.com/api/v3/datasets/de60b1b3ab6d4fa78b60f080cfb53328_0/downloads/data?format=shp&spatialRefId=27700&where=1%3D1
output_file: MSOA_(Dec_2021)_Boundaries_Generalised_Clipped_EW_(BGC).zip
type: geodata
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0, Contains OS data © Crown copyright and database right [year] (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
- name: residents_lsoa
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts001.zip
type: census_lsoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
- name: residents_msoa
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts001.zip
type: census_msoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
- name: age
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts007.zip
type: census_msoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
indicators:
age__under_5__pc: "100 * `Age: Aged 4 years and under; measures: Value` / `Age: Total; measures: Value`"
age__65_and_over__pc: "100 * (`Age: Aged 65 to 74 years; measures: Value` + `Age: Aged 75 to 84 years; measures: Value` + `Age: Aged 85 years and over; measures: Value`) / `Age: Total; measures: Value`"
- name: sex
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts008.zip
type: census_lsoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
indicators:
sex__female__pc: "100 * `Sex: Female; measures: Value` / `Sex: All persons; measures: Value`"
- name: ethnicity
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts029.zip
type: census_lsoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
indicators:
english_proficiency__low__pc: "100 * (`Proficiency in English language: Main language is not English (English or Welsh in Wales): Cannot speak English well` + `Proficiency in English language: Main language is not English (English or Welsh in Wales): Cannot speak English`) / `Proficiency in English language: Total: All usual residents aged 3 years and over`"
#- name: religion
# url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts030.zip
# type: census_lsoa_metric
# licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-#government-licence/version/3/)"
# indicators:
# religion__other_than_christian__pc: "100 * (`Religion: Buddhist` + `Religion: Hindu` + `Religion: Jewish` + `Religion: Muslim` + `Religion: Sikh` + `Religion: Other religion`) / `Religion: Total: All usual residents`"
- name: education
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts067.zip
type: census_lsoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
indicators:
qualification__level_2_or_lower__pc: "100 * (`Highest level of qualification: No qualifications` + `Highest level of qualification: Level 1 and entry level qualifications` + `Highest level of qualification: Level 2 qualifications`) / `Highest level of qualification: Total: All usual residents aged 16 years and over`"
- name: general_health
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts037.zip
type: census_lsoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
indicators:
health__bad_or_very_bad__pc: "100 * (`General health: Bad health` + `General health: Very bad health`) / `General health: Total: All usual residents`"
- name: disability
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts038.zip
type: census_lsoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
indicators:
disabled_or_long_term_condition__pc: "100 * (`Disability: Disabled under the Equality Act` + `Disability: Not disabled under the Equality Act: Has long term physical or mental health condition but day-to-day activities are not limited`) / `Disability: Total: All usual residents`"
- name: unpaid_care
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts039.zip
type: census_lsoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
indicators:
unpaid_care__any__pc: "100 * (`Provision of unpaid care: Total: All usual residents aged 5 and over` - `Provision of unpaid care: Provides no unpaid care`) / `Provision of unpaid care: Total: All usual residents aged 5 and over`"
- name: population_density
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts006.zip
type: census_lsoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
indicators:
population__1k_per_km2: "0.001 * `Population Density: Persons per square kilometre; measures: Value`"
- name: accomodation_type
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts044.zip
type: census_lsoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
indicators:
accomodation__mobile_or_temporary__pc: "100 * `Accommodation type: A caravan or other mobile or temporary structure` / `Accommodation type: Total: All households`"
- name: car_or_van_availability
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts045.zip
type: census_lsoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
indicators:
cars__none_in_household__pc: "100 * `Number of cars or vans: No cars or vans in household` / `Number of cars or vans: Total: All households`"
- name: tenure
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts054.zip
type: census_lsoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
indicators:
tenure__rented_social_or_private__pc: "100 * (`Tenure of household: Social rented` + `Tenure of household: Private rented`) / `Tenure of household: Total: All households`"
#- name: communal_establishment_resident
# url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts047.zip
# type: census_msoa_metric
# licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
# indicators:
# communal__under_15__per_100k: "100_000 * (`Position in communal establishment and sex and age: Resident: Male: Aged 0 to 15 years` + `Position in communal establishment and sex and age: Resident: Female: Aged 0 to 15 years`) / `Residence type: Total; measures: Value`"
- name: household_size
url: https://www.nomisweb.co.uk/output/census/2021/census2021-ts017.zip
type: census_lsoa_metric
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
indicators:
household__living_alone__pc: "100 * `Household size: 1 person in household; measures: Value` / `Household size: Total: All household spaces; measures: Value`"
- name: lsoa_2011_to_2021_lookup
url: https://opendata.arcgis.com/api/v3/datasets/737dab81eee94ffdb5cfc6fe8119c2ab_0/downloads/data?format=csv&spatialRefId=4326&where=1%3D1
output_file: lsoa_2011_to_2021_lookup.csv
type: lookup
licence: "Source: Office for National Statistics licensed under the Open Government Licence v.3.0 (see https://www.ons.gov.uk/methodology/geography/licences and http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/)"
# Key:
# U - No Change from 2011 to 2021. This means that direct comparisons can be made between these 2011 and 2021 LSOA.
# S - Split. This means that the 2011 LSOA has been split into two or more 2021 LSOA. There will be one record for each of the 2021 LSOA that the 2011 LSOA has been split into. This means direct comparisons can be made between estimates for the single 2011 LSOA and the estimates from the aggregated 2021 LSOA.
# M - Merged. 2011 LSOA have been merged with another one or more 2011 LSOA to form a single 2021 LSOA. This means direct comparisons can be made between the aggregated 2011 LSOAs’ estimates and the single 2021 LSOA’s estimates.
# X - The relationship between 2011 and 2021 LSOA is irregular and fragmented. This has occurred where 2011 LSOA have been redesigned because of local authority district boundary changes, or to improve their social homogeneity. These can’t be easily mapped to equivalent 2021 LSOA like the regular splits (S) and merges (M), and therefore like for like comparisons of estimates for 2011 LSOA and 2021 LSOA are not possible.
- name: imd_domains
url: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/833973/File_2_-_IoD2019_Domains_of_Deprivation.xlsx
type: imd_lsoa_2011_metric
licence: "Source: Ministry of Housing, Communities & Local Government licensed under the Open Government Licence v.3.0 (see http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/), also derived from unpublished data using other licences"
indicators:
income__rank: "`Income Rank (where 1 is most deprived)`"
- name: imd_underlying_indicators
url: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/833992/File_8_-_IoD2019_Underlying_Indicators.xlsx
type: imd_lsoa_2011_metric
licence: "Source: Ministry of Housing, Communities & Local Government licensed under the Open Government Licence v.3.0 (see http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/), also derived from unpublished data using other licences"
indicators:
housing_poor__indicator: "`Housing in poor condition indicator`"