Extract job description content from live posting

[epintozzi]

This will be an iteration on the "Create job application" issue. Ideally, users will eventually not have to copy/paste the job description into a text field, but we could automate that.

Hint: I'd start with a spike to explore the best options for performing the extraction of this data effectively

[kylomite]

Hey Erin! I've been doing research on this idea. I'm excited about what i've learned. I would like to have a discussion to investigate potential solutions in the face of some of the blockers i've encountered.

• There are consequences for web scraping
• There are imperfect solutions for specific websites that can potentially be incorporated
  • Screenshot generator in conjunction with Image to Text OCR
• In my opinion, the safest cleanest, and most consistent way to access the data for automatic population would be to pay for an API service on a specific website.
  • potential LinkedIn API
  • potential Indeed API

I apologize for not communicating more quickly, I would like to have a discussion in order to hone in on a solution that works for us. I will be online tomorrow(12/04/24) as 8AM EST (7AM CT) please reach out to me in this thread or on slack to facilitate this discussion.