This project was built at Conuhacks VII. Our web application asks users to upload an image of their diary or type their diary directly into our web app, sends it to the backend, converts the diary image to text with the help of Google Cloud Vision API, analyzes emotions from the diary entry using OpenAI's API, uses Spotify API to get recommended songs based on the analyzed emotions, then sends those information back to the frontend to display.
Diary image -> Text -> Extract emotions -> Get songs based on the emotion keywords -> Display
Technologies used: JavaScript, Python, React, Django, Django REST framework, Google Cloud Vision API, Spotify API, ChatGPT API, Axios, Git, CSS
Check out our project on Devpost:
Team Members: Jaewon Moon, Enna Lee, Benjamin Tan, Kihyeok Kim
Kihyeok Kim: Worked on frontend, built React components and helped connecting to Django backend. Jaewon Moon: Worked on backend using Django Rest Framework and used the AI part with the data sent from frontend. Benjamin Tan: Worked on AI part using Python libraries for NLP and extracting emotion from human face. Helped the other developers use Github to work as a team more efficiently. Enna Lee: Designed the UI, researched on "~", presented our project.
Enna Lee: Designer
- cd into Frontend directory
- Enter
npm installin terminal - Enter
npm startin terminal
cdinto the directory wheremanage.pyis in- Enter
python manage.py makemigrationsin terminal - Enter
python manage.py migrate --run-syncdbin terminal - Enter
python manage.py runserver - Copy the local host url from the terminal
- Open your brower and paste the url
- ctr-C in terminal to stop hosting the local server
python manage.py createsuperuserpython manage.py runserver- press login button in the browser
Current Design
Developed Design