LIMITED TIME OFFER: 50% OFF OF PREMIUM WITH OUR ANNUAL PLAN (THAT'S $294 IN SAVINGS).
GET OFFER

Show Dataquest: I built a scraper that automatically checks company career pages for new data jobs

Hey everyone! I originally created this scraper with Python Scrapy to build a remote jobs website called Career Vault to help job seekers during the pandemic. Since I was actually scraping all types of jobs (not just remote) into my database, I thought it might be useful to at least share them in spreadsheet format. The scraper follows ~5,800 companies and runs every 12 hours.

Check out the data jobs spreadsheet here. Let me know if there’s anything I can do to improve it!

1 Like

This is so cool @verussapientia! Great work!!

I’m curious to see how you built it. Can you share your source code online?

Our community loves a passionate personal project like this. :heart: