Skip to content

calebcodesgud/data-engineering-challenge

Repository files navigation

How to run

  1. this project was built with python 3.8. run:
pip install -r requirements.txt
  1. Download and install postgresql for windows from here https://get.enterprisedb.com/postgresql/postgresql-14.1-1-windows-x64.exe
username: postgres
password: password
  1. Add the PostgreSQL bin directory path to the PATH environmental variable.

  2. in windows terminal run:

psql -U postgres

and enter your password

  1. in the postgresql command line run
CREATE DATABASE myDatabase WITH ENCODING 'UTF8' LC_COLLATE='English_United States' LC_CTYPE='English_United States';
\quit
  1. in the windows terminal run
pg_ctl -D "<path to postgres data dir>/data" start
  1. run setUpDb.py in the project directory to create the tables

  2. run main.py

  3. in the windows terminal run

pg_ctl -D "<path to postgres data dir>/data" stop

Note: if you run into issues running the webdriver, please install the most recent version of chrome. this requires chrome version 96.*

it's also possible you may have to add the line

host  	all  		all 		0.0.0.0/0 		md5

to the end of data/pg_hba.conf in you postgres install. I was having issues connection from the application and i don't really know if this helped or not...

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages