Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix chapter tracker #2356

Merged
merged 1 commit into from
Oct 3, 2021
Merged

Fix chapter tracker #2356

merged 1 commit into from
Oct 3, 2021

Conversation

tunetheweb
Copy link
Member

Fixes #2353

This broken when #2346 bumped action script which had some breaking changed.

@tunetheweb tunetheweb added the bug Something isn't working label Oct 3, 2021
@tunetheweb tunetheweb added this to the 2021 Launch 🚀 milestone Oct 3, 2021
@tunetheweb tunetheweb merged commit d4a3423 into main Oct 3, 2021
@tunetheweb tunetheweb deleted the fix-chapter-progress-tracker branch October 3, 2021 22:40
NishuGoel added a commit that referenced this pull request Oct 18, 2021
* Bump prettier from 2.4.0 to 2.4.1 in /src (#2334)

Bumps [prettier](https://github.com/prettier/prettier) from 2.4.0 to 2.4.1.
- [Release notes](https://github.com/prettier/prettier/releases)
- [Changelog](https://github.com/prettier/prettier/blob/main/CHANGELOG.md)
- [Commits](prettier/prettier@2.4.0...2.4.1)

---
updated-dependencies:
- dependency-name: prettier
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Turn off uses-passive-event-listeners Lighthouse audit (#2335)

* Bump node-watch from 0.7.1 to 0.7.2 in /src (#2336)

Bumps [node-watch](https://github.com/yuanchuan/node-watch) from 0.7.1 to 0.7.2.
- [Release notes](https://github.com/yuanchuan/node-watch/releases)
- [Changelog](https://github.com/yuanchuan/node-watch/blob/master/Changelog.md)
- [Commits](yuanchuan/node-watch@0.7.1...v0.7.2)

---
updated-dependencies:
- dependency-name: node-watch
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* PWA 2021 queries (#2272)

* Initial conversion of queries to custom metrics

* Better Lighthouse queries

* Remove comma

* Add Service Worker over time for top 1k sites query

* Change adoption ranking to include all ranking categories

* Formatting

* Linting fixes

* Spacing improvements

* Missing queries

* Query updates

* Missed some

* Remove s

* Space

* Misc updates

* More Tweaks

* Spacing fixes

* Fix assestlinks query

* Missing DESC

* Group rankings properly

* Linting fixes

* Remove unnecessary extra join

* Spacing

* Additional queries

* Linting fixes

* Update Events to look at onEvents

* Better array merge

* Misc fixes

* Better JS

* Filtering false positives for install query

* Fixes to events query

* Adding comment for install query

* Expand on comment

* Review feedback

* Linting fixes

* Correct comment

* Apply suggestions from code review

Co-authored-by: David Fox <[email protected]>

* Review feedback

* Review feedback

* Change to COUNT(DISTINCT url)

Co-authored-by: demianrenzulli <[email protected]>
Co-authored-by: David Fox <[email protected]>

* Bump sqlfluff from 0.6.5 to 0.6.6 in /src (#2339)

Bumps [sqlfluff](https://github.com/sqlfluff/sqlfluff) from 0.6.5 to 0.6.6.
- [Release notes](https://github.com/sqlfluff/sqlfluff/releases)
- [Changelog](https://github.com/sqlfluff/sqlfluff/blob/main/CHANGELOG.md)
- [Commits](sqlfluff/sqlfluff@0.6.5...0.6.6)

---
updated-dependencies:
- dependency-name: sqlfluff
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Add more 2 more PWA queries (#2340)

* Small SQL linting fixes to old media queries (#2341)

* Caching 2021 queries (#2254)

* Update README.md

* Top CDNs

* caching queries part 1

* LH queries

* caching sql part 2

* changes from review

* comment

* Delete sql/2021/third-parties directory (#2342)

* Delete sql/2021/third-parties directory

* Delete third-parties.md

* frameworks, sourcemaps queries

* 1p vs 3p

* adds unminified, preload/prefetch queries

* Bump actions/github-script from 4.1 to 5 (#2346)

Bumps [actions/github-script](https://github.com/actions/github-script) from 4.1 to 5.
- [Release notes](https://github.com/actions/github-script/releases)
- [Commits](actions/github-script@v4.1...v5)

---
updated-dependencies:
- dependency-name: actions/github-script
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump actions/setup-node from 2.4.0 to 2.4.1 (#2347)

Bumps [actions/setup-node](https://github.com/actions/setup-node) from 2.4.0 to 2.4.1.
- [Release notes](https://github.com/actions/setup-node/releases)
- [Commits](actions/setup-node@v2.4.0...v2.4.1)

---
updated-dependencies:
- dependency-name: actions/setup-node
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump github/super-linter from 4.7.3 to 4.8.0 (#2350)

* Bump github/super-linter from 4.7.3 to 4.8.0

Bumps [github/super-linter](https://github.com/github/super-linter) from 4.7.3 to 4.8.0.
- [Release notes](https://github.com/github/super-linter/releases)
- [Changelog](https://github.com/github/super-linter/blob/master/docs/release-process.md)
- [Commits](github/super-linter@v4.7.3...v4.8.0)

---
updated-dependencies:
- dependency-name: github/super-linter
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Fix queries failing linting

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Barry <[email protected]>

* Extra PWA queries (#2344)

* Add extra PWA Notification Query

* Remove date restriction

* Change workbox query to remove workbox from the name

* Split methods into components

* Remove noqa

* Fix chapter tracker (#2356)

* Bump pytest-cov from 2.12.1 to 3.0.0 in /src (#2359)

Bumps [pytest-cov](https://github.com/pytest-dev/pytest-cov) from 2.12.1 to 3.0.0.
- [Release notes](https://github.com/pytest-dev/pytest-cov/releases)
- [Changelog](https://github.com/pytest-dev/pytest-cov/blob/master/CHANGELOG.rst)
- [Commits](pytest-dev/pytest-cov@v2.12.1...v3.0.0)

---
updated-dependencies:
- dependency-name: pytest-cov
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump github/super-linter from 4.8.0 to 4.8.1 (#2358)

Bumps [github/super-linter](https://github.com/github/super-linter) from 4.8.0 to 4.8.1.
- [Release notes](https://github.com/github/super-linter/releases)
- [Changelog](https://github.com/github/super-linter/blob/main/docs/release-process.md)
- [Commits](github/super-linter@v4.8.0...v4.8.1)

---
updated-dependencies:
- dependency-name: github/super-linter
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Fonts 2021 sql (#2338)

* Create 05_01.web_fonts_usage.sql

* Create 05_02.web_fonts_usage_by_country.sql

* Rename 05_01.web_fonts_usage.sql to web_fonts_usage.sql

* Rename 05_02.web_fonts_usage_by_country.sql to .web_fonts_usage_by_country.sql

* Rename .web_fonts_usage_by_country.sql to web_fonts_usage_by_country.sql

* Update web_fonts_usage_by_country.sql

* Create fonts_format.sql

* Create impact_on_core_web_vitals.sql

* Update and rename impact_on_core_web_vitals.sql to self_hosted_vs_hosted_with_fcp_lcp.sql

* Create web_font_usage_breakdown_with_fcp_lcp.sql

* Delete self_hosted_vs_hosted_with_fcp_lcp.sql

* Create popular_typeface.sql

2020 query with 2021 date

* Create variable_font_adoption.sql

2020 queries with 2021 date

* Create color_fonts.sql

2020 Queries with 2021 dates

* Create variable_font_axis.sql

2020 query with 2021 date

* Rename variable_font_axis.sql to variable_font_axes_used.sql

2020 query with 2021 date

* Create self_hosted_vs_hosted_with_fcp_lcp.sql

2020 query with 2021 date

* Update self_hosted_vs_hosted_with_fcp_lcp.sql

* Create font_display.sql

2020 query with 2021 date

* Update self_hosted_vs_hosted_with_fcp_lcp.sql

indenting change from 2020 query with 2021 date

* Update self_hosted_vs_hosted_with_fcp_lcp.sql

2020 query w.2021 date + indentation fix.

* Update self_hosted_vs_hosted_with_fcp_lcp.sql

indentation fix

* Update self_hosted_vs_hosted_with_fcp_lcp.sql

:( indentation fix

* Update self_hosted_vs_hosted_with_fcp_lcp.sql

whitespace issues.

* Update self_hosted_vs_hosted_with_fcp_lcp.sql

space after comma

* Update self_hosted_vs_hosted_with_fcp_lcp.sql

:) new indentation issue fix

* Update self_hosted_vs_hosted_with_fcp_lcp.sql

* Update sql/2021/fonts/fonts_format.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update sql/2021/fonts/fonts_format.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update sql/2021/fonts/variable_font_axes_used.sql

Co-authored-by: Rick Viscomi <[email protected]>

Co-authored-by: Rick Viscomi <[email protected]>

* Fix old 2019 CSS query preventing the code base from linting properly (#2360)

* HTTP 2021 queries (#2309)

* 2021 HTTP/2 queries

* Linting fix

* Correct UNNEST

* Lowercase

* Convert queries to use new columns

* New queries

* Rename file

* Rank queries

* Add rank queries properly

* More queries

* Linting fixes

* Tweaking queries

* Remove rounds

* Linting fixes

* Query tweaks as running data

* Post run updates

* Linting

* Update README

* Initial conversion of 2021 queries

* Remove noqa

* Revert "Initial conversion of 2021 queries"

This reverts commit 76fb136.

* Review feedback

* Bump sqlfluff from 0.6.6 to 0.6.7 in /src (#2362)

Bumps [sqlfluff](https://github.com/sqlfluff/sqlfluff) from 0.6.6 to 0.6.7.
- [Release notes](https://github.com/sqlfluff/sqlfluff/releases)
- [Changelog](https://github.com/sqlfluff/sqlfluff/blob/main/CHANGELOG.md)
- [Commits](sqlfluff/sqlfluff@0.6.6...0.6.7)

---
updated-dependencies:
- dependency-name: sqlfluff
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump flask from 2.0.1 to 2.0.2 in /src (#2361)

Bumps [flask](https://github.com/pallets/flask) from 2.0.1 to 2.0.2.
- [Release notes](https://github.com/pallets/flask/releases)
- [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst)
- [Commits](pallets/flask@2.0.1...2.0.2)

---
updated-dependencies:
- dependency-name: flask
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* CSS 2021 queries (#2306)

* Update README.md

* initial query

* copy of 2020 queries with 2021 dates

* focus visible

* fixes

* metric cleanup
one new metric: content_values

* fix UDF timeout

* lint

* old fixes and 2021 metrics

* feedback fixes

* very minor lint fix

* PR feedback accomodate & fixes

* link fix

* Update CONTRIBUTING.md

* Update "join the team" link on Contributors page (#2365)

Point to CONTRIBUTING.md rather than the base README, which just links to the other file anyway. (I've also updated CONTRIBUTING with 2022 info and committed it directly to main)

* Feedback II update

* Bump sqlfluff from 0.6.7 to 0.6.8 in /src (#2364)

Bumps [sqlfluff](https://github.com/sqlfluff/sqlfluff) from 0.6.7 to 0.6.8.
- [Release notes](https://github.com/sqlfluff/sqlfluff/releases)
- [Changelog](https://github.com/sqlfluff/sqlfluff/blob/main/CHANGELOG.md)
- [Commits](sqlfluff/sqlfluff@0.6.7...0.6.8)

---
updated-dependencies:
- dependency-name: sqlfluff
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Resource Hints 2021 queries (#2264)

* Update README.md

* Update README.md

* Preloading multiple font types SQL

* Updated naming convention for redundant_preload_font_downloads

* Valid and Invalid resource type counts

* Find total occurences of every invalid preload type, besides total count

* Added sorting by total_occurrences; Formatted document

* Removed unused columns

* Improved error handling

* Updated name to valid/invalid

* Linting fixes

* Address review feedback from Rick - update table name & var names

* Added hints_adoption by device SQL

* Updated results sheet

* Updated lint errors

* Address some feedback by Rick on redundant_preload_font_downloads.sql

* [Draft 1] Missing crossorigin on files may create a duplicate request for the same file

Ready for initial review

* [Draft 1] Preload incorrect script type

* Updated query to check preload tags without required crossorigin attribute

* Updated missing_crossorigin query to use REGEXP_CONTAINS

* Added query returns the number of pages which preload unused resources

* Added query that returns the number of pages which preload a resource of the incorrect script type

* Resolved linting issues

* renamed files to make them consistent with others

* [Draft 1] Preloaded images below the fold

* Updated consoleLog queries to provide better result set

* Removed trailing '#' from file type

* group below fold preload images by device on July 1 CRON

* Also show the group name when showing below the fold image aggregates

* Linted resource hints queries

* Adoption of native image lazy loading

Cloned from last year

* Attribute usage

* lazy loaded viewport images

* lazy iframes

* Updated linting

* Added lighthouse audits to resource-hints SQL

* Fixed incorrect sqlfluff fix

* Reverted incorrect sqlfluff lint

* Removed unecessary total field

* Linted

* link type and resource distribution

* Added queries to get resource hint domain popularity

* Removed unused total from domain queries

* Added queries to check resource hints by href

* Added query for resource hints in HTTP headers

* Linting

* Updated resource hints by domain queries to improve code DRY

* Minor code clean-up on requests_by_client_hints_adoption

* Improved queries to get resource hints by domain

* Resolved linting issues

* Renamed sql files

* Added query for hints adoption by rank

* Minor refactoring on unused preloaded font downloads

* Minor refactoring on unused preloaded font downloads

* Added SQL for resource hints distributions

* Updated queries to improve readability and remove unused UDF following PR feedback

* Lint improvements

* Removed commented lines

* Update README.md

* Applied code review feedback

* Updated unused preloaded fonts to include .woff

* Resolved syntax error

* add more aggregate cols and remove unused cols in subqueries

* Renamed 'invalid_preload_types.sql'

* Updated filename to match convention

* Improved ordering of results; added native images lazy loading trends

* Fixed linting issues

Co-authored-by: Nitin Pasumarthy <[email protected]>
Co-authored-by: Barry <[email protected]>

* Bump web-vitals from 2.1.0 to 2.1.1 in /src (#2366)

Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 2.1.0 to 2.1.1.
- [Release notes](https://github.com/GoogleChrome/web-vitals/releases)
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v2.1.0...v2.1.1)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Periodic library updates (#2368)

* Update all npm dependencies

* Regen package-lock.json

* Privacy 2021 queries (#2227)

* first query draft

* IAB TCF queries

* Copy reusable queries from 2020

* Update queries to use correct custom metrics structure
Use [recommended JSON functions](https://cloud.google.com/bigquery/docs/reference/standard-sql/json_functions#function_overview)

* Use recommended JSON functions

* Most common privacy link keywords/texts

* Wappalyzer-based analyses

* IAB TCF compliant setup

* Blink usage queries

* Device sensor queries

* Parse data breaches data

* Count features based on strings

* ATS, GPC queries

* Stub for FLoC origin trial query based on token
Headers are not yet used

* Remote trailing whitespace

* Update sql/2021/privacy/purposes_for_iab_tcf_v2.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/privacy/top100_domains_that_set_cookies_via_response_header.sql

Co-authored-by: Barry Pollard <[email protected]>

* linting

* Linting fixes

* Percentages: Round to 100th + value between 0 and 1
(per https://github.com/HTTPArchive/almanac.httparchive.org/wiki/Analysts'-Guide#formatting-results)

* Add header comments

* Use July dataset

* Remove typo

* Round more percentages

* Correct number of total pages
Previous version would yield sum of desktop and mobile (i.e., double count)

* Referrer-Policy

* FLoC opt-out

* Linting

* Headers are case-insensitive

* Correct total number of pages

* User-Agent Client Hints

* Search meta tags as well for FLoC opt-out

* Mass rename files (`most_common` or `nb_`)

* Number of websites using UACH

* `ORDER BY`

* Privacy Sandbox experiments through Blink features

* Origin trials

* Fix updated linting issues

* Remove `noqa: PRS`

* Add resource links to README

* Update result order

* Most common Feature-/Permissions-Policy directives

* Number of websites with Feature-/Permissions-Policy

* Most common FP/PP directive values

* Most common cookies (from last year)

* Tracking queries (based on WhoTracksMe)

* Python linting fixes

* Add tracking category to cookie queries

* Do not use sample table

* Remove percentage rounding
#2262 (comment)

* Formatting `JOIN`/`USING`

* Formatting: `WHERE` clause

* Discard `pages_privacy`

* Column names in `GROUP BY`/`ORDER BY`
`ORDER BY client` everywhere
Fix `WITH` clauses

* Fix `PARTITION BY` clauses

* `summary_response_bodies` → `requests`

* Fix custom metrics queries (part 1)
Harmonize `totals`
Lowercase keywords

* Avoid repeatedly parsing `payload`

* added custom purpose legitimateInterests

* nb to number_of

* most_common_strings_for_iab_usp simplified

* number_of_websites_using_each_cmp simplified

* query simplification

* explicit ordering

* number_of_websites_with_gpc_well_known +percentage

* adjusting to a single select

* removed expiry date check

* implicit ASC

* linting

* move the python sourced data to csv's

* Change ranking approach

* Use imported `whotracksme` table

* Output TSVs for HaveIBeenPwned

* repeated blink_feature.usage rows fixed

* HaveIBeenPwned data for almanac.breaches table

wget https://haveibeenpwned.com/api/v2/breaches; node breaches.js  > breaches.tsv

* Migrate HIBP queries to SQL

* Remove `ANY_VALUE` usages

* Update sql/util/breaches.js

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/util/breaches.js

Co-authored-by: Barry Pollard <[email protected]>

* Update breaches.js

* Remove more whitespace

* Update sql/2021/privacy/number_of_websites_with_dnt_or_gpc_blink_usage.sql

Co-authored-by: Victor Le Pochat <[email protected]>
Co-authored-by: Victor Le Pochat <[email protected]>
Co-authored-by: Barry Pollard <[email protected]>
Co-authored-by: Barry <[email protected]>
Co-authored-by: Paul Calvano <[email protected]>
Co-authored-by: Victor Le Pochat <[email protected]>

* Bump sqlfluff from 0.6.8 to 0.6.9 in /src (#2370)

Bumps [sqlfluff](https://github.com/sqlfluff/sqlfluff) from 0.6.8 to 0.6.9.
- [Release notes](https://github.com/sqlfluff/sqlfluff/releases)
- [Changelog](https://github.com/sqlfluff/sqlfluff/blob/main/CHANGELOG.md)
- [Commits](sqlfluff/sqlfluff@0.6.8...0.6.9)

---
updated-dependencies:
- dependency-name: sqlfluff
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump jsdom from 17.0.0 to 18.0.0 in /src (#2369)

Bumps [jsdom](https://github.com/jsdom/jsdom) from 17.0.0 to 18.0.0.
- [Release notes](https://github.com/jsdom/jsdom/releases)
- [Changelog](https://github.com/jsdom/jsdom/blob/master/Changelog.md)
- [Commits](jsdom/jsdom@17.0.0...18.0.0)

---
updated-dependencies:
- dependency-name: jsdom
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Fix markdown linting (#2371)

* Update Timestamps and Generate Ebooks (#2372)

Co-authored-by: tunetheweb <[email protected]>

* 2020 CSS Russian translation (#2205)

* Add new translator

* [css-2020-ru] Translate meta and headings

* Fix article navigation

* Translate introduction part

* Translate visual effects, blend modes and filters

* Translate methodology part

* Translate Usage part

* Translate Selectors and the cascade part

* Translate Sass part

* Translate lengths part

* Translate calculations part

* Translate global keywords part

* Translate CP naming part

* Translate Colors part

* Translate gradients part

* Translate shorthands and longhands part

* Translate mistakes part

* Translate conclusion

* Fix length linter error

* Translate layout part

* Translate transistions part

* Translate masks and clip-paths

* Translate Responsive design part

* Translate Custom properties part

* Translate CSS and JS part

* Translate Internationalization part

* Translate Feature queries part

* Oops

* Fix md linter error

* Misc fixes

* Internationalise links

Co-authored-by: Barry <[email protected]>

* Update Timestamps and Generate Ebooks (#2374)

Co-authored-by: tunetheweb <[email protected]>

* SEO 2021 queries (#2351)

* Update to 2021 data

* Add better descriptions to each metric

* Rename files to represent what they contain

* Bugfix

* Dump pages with errors

* Create robots-text-size.sql

* Resolve linting issues.

* Create robots-txt-user-agent-usage-by-rank.sql

* Create pages-canonical-stats.sql

* Update pages-canonical-stats.sql

Removed unnecessary whitespace

* Included heading_order_valid and legible_font_size

Not sure if it makes sense to break these out as it may be too expensive to run each metric separately.

* Removed trailing whitespace

* Create lighthouse_unused_css_js_by_rank.sql

* updated linting issues.

* Updated title

* Create outgoing_links_by_rank.sql

* Updated metric name

* Update outgoing_links_by_rank.sql

* Update sql/2021/seo/content-language-usage.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/seo/robots-txt-user-agent-usage-by-rank.sql

Co-authored-by: Barry Pollard <[email protected]>

* removed rounding and partitioning

* Removed rounding and updated function name

* Update anchor-rel-attribute-usage.sql

* resolved linting errors and removed rounding

* resolved comma issue

* removed rounding and renamed function

* updated rounding and function name

* removed rounding

* removed rounding

* naming and formatting issues

* naming and formatting issues

* naming and formatting issues

* naming and formatting issues

* naming and formatting issues

* naming and formatting issues

* naming and formatting issues

* naming and formatting issues

* updated description

* fixed spacing issues

* Unnecessary trailing whitespace

* indentation and whitespace issues

* hanging whitespace

* remove rounding

* naming and formatting issues

* data accuracy and completeness

Removed restriction on desktop and create new metric for missing files.

* naming and formatting issues

* Removed desktop exclusion and limited page count.

* formatting and count changes

* removed rounding

* formatting and rounding issues

* formatting and rounding issues

* formatting and rounding issues

* naming update

* formatting issues

* formatting issue

* formatting

* formatting

* formatting

* formatting

* formatting

* added todo for 2022

* refactor

* removed metric that will always be 1

* clean up

* Misc fixes

* Update sql/2021/seo/html-response-content-language.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/seo/image-alt-stats.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/seo/outgoing_links_by_rank.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/seo/lighthouse_unused_css_js_by_rank.sql

Co-authored-by: Barry Pollard <[email protected]>

Co-authored-by: JR Oakes <[email protected]>
Co-authored-by: Barry Pollard <[email protected]>
Co-authored-by: Barry <[email protected]>

* Fixed review comment related to web_component_specs.

* WebAssembly 2021 queries (#2367)

* Add WebAssembly 2021 queries

* sqlfluff fix

* Add date filter

* Update sql/2021/webassembly/section_sizes.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Bump web-vitals from 2.1.1 to 2.1.2 in /src (#2375)

Bumps [web-vitals](https://github.com/GoogleChrome/web-vitals) from 2.1.1 to 2.1.2.
- [Release notes](https://github.com/GoogleChrome/web-vitals/releases)
- [Changelog](https://github.com/GoogleChrome/web-vitals/blob/main/CHANGELOG.md)
- [Commits](GoogleChrome/web-vitals@v2.1.1...v2.1.2)

---
updated-dependencies:
- dependency-name: web-vitals
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Page weight 2021 Queries  (#2352)

* pageweight SQL queries

* new queries

* Update pageweight_by_header_body.sql

* Change to use 2021_07_01 dataset

* Change to use 2021_07_01 dataset

* Change to use 2021_07_01 dataset

* Change to use 2021_07_01 dataset

* Change to use 2021_07_01 dataset

* Change to use 2021_07_01 dataset

* Change to use 2021_07_01 dataset

* Change to use 2021_07_01 dataset

* Change to use 2021_07_01 dataset

* Fix indentation catch from linter

* Fix indentation catch from linter

* Fix indentation catch from linter

* Fix indentation catch from linter

* Fix indentation catch from linter

* Fix indentation catch from linter

* Fix spacing.

* Apply suggestions from code review

Co-authored-by: John Teague <[email protected]>
Co-authored-by: Rick Viscomi <[email protected]>

* JavaScript 2021 queries (#2323)

* add requests, async, module queries

* Added ajax request per page percentile based query.

* Added most requested content-types.

* Formatted query.

* Added query for iframe per page.

* Percentage usage of different ajax APIs.

* Added h1 vs h2 vs h3 script.

* Added web_components_sepc sql.

* linting

* consistent syntax to count number of rows

* frameworks, sourcemaps queries

* 1p vs 3p

* adds unminified, preload/prefetch queries

* PR feedback accomodate & fixes

* link fix

* Feedback II update

* Fixed review comment related to web_component_specs.

Co-authored-by: Pankaj Parkar <[email protected]>
Co-authored-by: Max Ostapenko <[email protected]>

* Privacy 2021 extra queries (#2373)

* data_breaches adjusted to visualisations

* cmp July bug

* event-names custom metrics

* blink_features DNT

* breaches timerange adjusted

* lint

* lint

* start/end as first date of crawl

* feedback

* Revert date + add comment on non-usage

Co-authored-by: Victor Le Pochat <[email protected]>

* Security 2021 queries (#2262)

* Update README.md

* Recycle 2020 queries for 2021

* Update sql/2021/security/cookie_attributes.sql

Co-authored-by: Barry Pollard <[email protected]>

* Adjusting queries for SQL Linter

* Update sql/2021/security/tls_versions_pages.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/security/feature_adoption_by_topN_technologies.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/security/iframe_allow_directives.sql

Co-authored-by: Barry Pollard <[email protected]>

* Adjust queries for SQL Linter

* Add cookie_max-age_distribution.sql

* Fix cookie_max-age_distribution.sql

* Add CSP-Report-Only header prevalence and fix cookie max-age

* Add server_information_header_prevalence.sql

* Add Server header value prevalence and fix

* Update datasets to July instead of August

* Add `sameparty` cookie attribute

https://github.com/cfredric/sameparty

* iframe allow directive values

* Fix origins in iframe allow directive values analysis
`'self'`, `*`, etc. should also be considered origins,
so they should not be treated separately.
These will now appear as values among explicitly set domains.

* Update query to also consider values of X-Powered-By values

* Add robot_header_and_meta_tag_prevalence.sql

* Add mixed_content.sql and fix

* Add queries for robots.txt and security.txt, and fix

* Add cookie_age_percentiles.sql

* `cookie_age_percentiles`: use real (not sample) table

* Fix epoch comparison in cookie_age_percentiles.sql

* Add top values for Max-Age and Expires and prevalence of HTTPS server redirects

* Add `\s*` to regex

* Add mimetype_file_extension_mismatch.sql

* Merge branch 'main' of github.com:GJFR/almanac.httparchive.org

* Fix indentation

* Add meta_policies_allowed_vs_disallowed.sql

* Small fixes

* User  instead of  for -tag

* Use response_headers instead of payload column in httparchive.almanac.requests

* Update sql/2021/security/bot_detection.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/security/cookie_age_percentiles.sql

Co-authored-by: Barry Pollard <[email protected]>

* Remove unnecessary noqa statements

* Update sql/2021/security/bot_detection.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/security/cookie_age_percentiles.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/security/cookie_max_age_expires_top_values.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/security/cryptominer_share.sql

Co-authored-by: Barry Pollard <[email protected]>

* Simplify cookie_max_age_expires_top_values.sql

* Update cryptominer_usage.sql to calculate pct

* Rewrite cookie_max_age_expires_top_values.sql to avoid UNNEST - OVER combo

* Fix csp_allowed_host_frequency.sql: incorrect total_pages

* Fix sri_hash_functions.sql: incorrect total_sri_elements

* Rewrite sri_popular_hosts.sql to avoid UNNEST - OVER combo

* Name totals columns

* Fix linter issues

* Update sql/2021/security/csp_allowed_host_frequency.sql

Co-authored-by: Barry Pollard <[email protected]>

* Rewrite https_server_redirects.sql and fix linting issue

* Fix mixed_content.sql

* Fix feature_adoption_by_technology.sql

* Update sql/2021/security/cookie_max_age_expires_top_values.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/security/cookie_max_age_expires_top_values.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/security/cookie_max_age_expires_top_values.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/security/feature_adoption_by_country.sql

Co-authored-by: Barry Pollard <[email protected]>

* Update sql/2021/security/cookie_max_age_expires_top_values.sql

Co-authored-by: Barry Pollard <[email protected]>

* Apply suggestions from code review

Co-authored-by: Barry Pollard <[email protected]>

* Apply suggested fixes

* Extend suggestion to other file

* Apply suggestions from code review

Co-authored-by: Barry Pollard <[email protected]>

* Apply suggestions from code review

Co-authored-by: Barry Pollard <[email protected]>

* Rewrite to make cleaner

* Fix linting error

* Apply suggestions

* Fix linting issue

* Ignore non-SVG images iun mimetype_file_extension_mismatch.sql

* Add missing file extensions

* Update sql/2021/security/mimetype_file_extension_mismatch.sql

Co-authored-by: Barry Pollard <[email protected]>

* Make file_extension checking case insensitive in mimetype_file_extension_mismatch.sql

* Update sql/2021/security/mimetype_file_extension_mismatch.sql

Co-authored-by: Barry Pollard <[email protected]>
Co-authored-by: Victor Le Pochat <[email protected]>

* CSS 2021 queries (part 2) (#2363)

* more css queries

* delays and images

* images

* image dimension popularity

* keyframes

* satisfy linter

for the record i think the linter is wrong :)

* add pages to keyframes query

* tiny fix

* A11Y 2021 queries (#2299)

* Initial queries added

* Find common audio attributes

* Search for search inputs

* Added captcha usage

* Detect a11y technology usage

* Find a11y name sources for form inputs

* Button name sources

* Radio and checkbox fieldset stats

* Required form control metric

* Fix linting errors

* Spacing fixes

* Tech by domain rank

* Bugfixes

* Clarifying comment

* Better column name

* Added new domain rank metric

Co-authored-by: Barry <[email protected]>

* Structured Data 2021 queries (#2293)

* Add basic SQL queries

* Linting fixes

* Update Structured Data Queries

* Add Microdata Item Types query

* Add RDFa queries

* Fix linting

* Add microformats2 types query

* Add Classic Microformats types query

* Add Dublin Core types query

* Add Twitter types query

* Add Facebook types query

* Add Open Graph types query

* snake_case and remove backticks

* Remove semi-colons

* Split RDFa type ofs by whitespace

* Extract RDFa prefix URIs

* Add JSON-LD Contexts

* Add JSON-LD Types

* Better handle arrays

* JSON-LD sameAs values

* JSON-LD relationships

* Separate by client type

* Add totals, pcts, separate by client, and normalize URLs

* Remove error logs

* JSON-LD Entities & Relationships

* JSON-LD Relationships and their values + max depth in a JSON-LD doc

* Fix linting

* COUNT(0) rather than the values

* Add explanation for how we're normalizing URLs

Co-authored-by: Barry <[email protected]>

* Markup 2021 queries (#2265)

* Updated README.md

* Added markup 2021 SQL queries (WIP)

* Updated summary pages by device to include trends from previous years

* Added queries for wpt_bodies_by_device

* Updated README.md for markup-2021-sql

* Updated README.md for markup-2021-sql

* Linting fixes

* Refactored queries to align with other chapters

* Added markup SQL

* Lint fix

* Added markup attribute SQL

* Added markup meta SQL

* Added button and favicon SQL

* Added forms SQL

* Updated following review feedback

* Resolved lint issues

* Removed headings from wpt_bodies sql

* Updated follow code review

* Lint fixes

Co-authored-by: Barry <[email protected]>

* CMS 2021 queries (#2343)

* Create cms_adoption_2021_compared_to_2020.sql

cms adoption 2021/2020

* Create top_cms_2021.sql

* Create wordpress_plugin_resources_2021.sql

* Create cms_adoption_2021.sql

* Create cms_passing_core_web_vitals

2020 query with 2021 date

* Rename cms_passing_core_web_vitals to cms_passing_core_web_vitals.sql

* Create cms_by_geo.sql

cms by geo

* Create fid_per_cms.sql

edited query to get fid per cms

* Create lcp_per_cms.sql

edited query to find lcp per cms

* Create fid_per_cms_per_geo.sql

edited query to find fid per cms per country

* Create lcp_per_cms_per_geo.sql

edited query to find the lcp per cms per country

* Create cls_per_cms_per_geo.sql

query edited to find the cls per cms per country

* Update cls_per_cms_per_geo.sql

* Create cls_per_cms.sql

edited query to find the cls per cms

* Create lighthouse_category_scores_per_cms.sql

Last year query with date changed. Covers the SEO, Accessibility, and performance score.

* Update sql/2021/cms/cms_adoption_2021.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update sql/2021/cms/cms_adoption_2021_compared_to_2020.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update sql/2021/cms/top_cms_2021.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update sql/2021/cms/top_cms_2021.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update sql/2021/cms/wordpress_plugin_resources_2021.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update sql/2021/cms/wordpress_plugin_resources_2021.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update sql/2021/cms/wordpress_plugin_resources_2021.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update cls_per_cms.sql

* Update fid_per_cms.sql

* Update lcp_per_cms.sql

* Update sql/2021/cms/lighthouse_category_scores_per_cms.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update sql/2021/cms/cms_passing_core_web_vitals.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update sql/2021/cms/cms_passing_core_web_vitals.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update sql/2021/cms/cms_passing_core_web_vitals.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Update lcp_per_cms.sql

indentation changes

* Update cms_passing_core_web_vitals.sql

Co-authored-by: Rick Viscomi <[email protected]>

* Ecommerce 2021 queries (#2300)

* Recycle 2020 ecommerce queries

Updating the 2020 queries to make it ready for 2021

* Fix linting errors

* domains that are marked as payment processors but not ecommerce

* update all the new 2021 files to use 2021_07_01 or 2020_08_01 or 2019_07_01 where needed

* fixing the queries after running the updated linter

* update the readme

* add some new queries; update the readme

* Update all_categories.sql

fix a typo changing from `app` to `category`

* add hreflang queries

* rename file

* update the README

* add ecomm + csp query

* add aug and sep versions of cmp query

* add app links query update

* updated readme

* update readme

* update the top vendors file to use ranks

* fixing the query to use well-known

* Update README.md

Updating list of queries used, lists created for testing and unused items

* remove unused/informational queries

* fix this to use production tables instead of sample data

* fix to not use the ROUND function

* update README

* fix to stop using ROUND

* fixing this query to use UNNEST and remove some redundancy

* fix linter issue

* fix query and fix linting again

* fix the ecomm category matches

* Update sql/2021/ecommerce/core_web_vitals_passingmetrics_byvendor_bydevice.sql

Updating the query as its possible FID could be null

Co-authored-by: Rick Viscomi <[email protected]>

Co-authored-by: Barry <[email protected]>
Co-authored-by: Rick Viscomi <[email protected]>

* Bump sqlfluff from 0.6.9 to 0.7.0 in /src (#2378)

Bumps [sqlfluff](https://github.com/sqlfluff/sqlfluff) from 0.6.9 to 0.7.0.
- [Release notes](https://github.com/sqlfluff/sqlfluff/releases)
- [Changelog](https://github.com/sqlfluff/sqlfluff/blob/main/CHANGELOG.md)
- [Commits](sqlfluff/sqlfluff@0.6.9...0.7.0)

---
updated-dependencies:
- dependency-name: sqlfluff
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Mobile Web 2021 queries (#2310)

* Update 2019 and 2020 queries to use 2021 data

* Add new metrics

* Changes for consistency

* Removed duplicate metric

* Add domain ranked versions of metrics

* Naming change

* Use PARTITION BY 0

* Linting fixes

* Bug fixes

* Bugfixes and new metrics

* Fixed client hints query

* Better comments

* rename sites -> pages

* perc -> pct

* Only count loading=lazy usages

* Rename files to avoid confusion

* Add comments to make it clearer what each data point is

* Remove HAVING to get accurate results

* perc -> pct

* Fix count distinct

* Total inputs detected fixed

Co-authored-by: Barry <[email protected]>

* Performance 2021 queries  (#2316)

* help

* fixes

Co-authored-by: Rick Viscomi <[email protected]>

* Sql linting fixes (#2379)

* Structured Data fixes

* CSS fixes

* Fix CMS queries

* Fix typo

* Add Linting check on push to main

* Revert "Fix CMS queries"

This reverts commit 29b2e3d.

* Fogot to hit save after fixing merge conflict

* CMS 2021 queries (part 2) (#2376)

* rank

* edits

* geo, rank fixes

* cms adoption metrics

* linter

* resources

* cwv by geo and LH

* linter

* fix wp resources

* Fix optional FID queries (#2380)

* page builders

* fix optional fid

* fix optional fid everywhere

* Bump actions/checkout from 2.3.4 to 2.3.5 (#2382)

Bumps [actions/checkout](https://github.com/actions/checkout) from 2.3.4 to 2.3.5.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](actions/checkout@v2.3.4...v2.3.5)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Add client to grouping of popular libs (#2383)

I've noticed there are a few notable discrepancies between desktop/mobile so splitting them up.

* update content_type and webcomponent query

* Fix CMS geo adoption queries (#2385)

* fix adoption by geo queries

* 202105

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Barry Pollard <[email protected]>
Co-authored-by: demianrenzulli <[email protected]>
Co-authored-by: David Fox <[email protected]>
Co-authored-by: Rick Viscomi <[email protected]>
Co-authored-by: Barry <[email protected]>
Co-authored-by: Kanmi Obasa <[email protected]>
Co-authored-by: Kevin Farrugia <[email protected]>
Co-authored-by: Nitin Pasumarthy <[email protected]>
Co-authored-by: Max Ostapenko <[email protected]>
Co-authored-by: Victor Le Pochat <[email protected]>
Co-authored-by: Victor Le Pochat <[email protected]>
Co-authored-by: Paul Calvano <[email protected]>
Co-authored-by: Victor Le Pochat <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: tunetheweb <[email protected]>
Co-authored-by: Nikita Dubko <[email protected]>
Co-authored-by: JR Oakes <[email protected]>
Co-authored-by: Pankaj Parkar <[email protected]>
Co-authored-by: Ingvar Stepanyan <[email protected]>
Co-authored-by: Jess <[email protected]>
Co-authored-by: John Teague <[email protected]>
Co-authored-by: Gertjan Franken <[email protected]>
Co-authored-by: Greg Brimble <[email protected]>
Co-authored-by: TosinArasi <[email protected]>
Co-authored-by: Rajiv Ramnath <[email protected]>
Co-authored-by: Sia <[email protected]>
Co-authored-by: Rick Viscomi <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Progress tracker not updating
1 participant