Code

updated scraper to use new api#1150

Code

Merged

ollibowers merged 10 commits into331-stagingdevsoc-unsw/circles:331-stagingfrom update-scraperdevsoc-unsw/circles:update-scraperCopy head branch name to clipboardSep 5, 2024

+282,422-269,723

Commits

Commits on Aug 2, 2024

• updated scraper to use new api and scrape postgrad items

  

  martanman

  authored and

  ollibowers

  committed
  9d59409

• filter in only undergrad courses

  

  martanman

  authored and

  ollibowers

  committed
  36e6f9d

• remove debug prints

  

  martanman

  authored and

  ollibowers

  committed
  81edc75

• fix pylint, remove old (unused) create_payload function

  

  martanman

  authored and

  ollibowers

  committed
  4411ee0

• fix pylint again

  

  martanman

  authored and

  ollibowers

  committed
  05944c5

• fix pylint fr this time

  

  martanman

  authored and

  ollibowers

  committed
  df6bb7e

• rerun format and process courses

  martanman

  committed
  6b64dc0

Commits on Sep 1, 2024

• scrape only ugrd prgms and spcs

  martanman

  committed
  f0245dc

• re pickle conditions and check certain courses exist before changing condition

  martanman

  committed
  150f902

• fix be tests

  martanman

  committed
  28ece4b