University Requirement Scraper Used AI

Check out the site! I also added a README if you want to try the scraper out!👩‍💻 https://uni-prereq-scraper.onrender.com/

Got the backend to work too! Time to ship it! ⛵If you are looking into enrolling in the University of Waterloo this would be a very valuable tool 🔧

Made the frontend of the website. 💻Now I just need to connect it to my JSON file to actually have the search button function properly 🔍

I implemented both logging and error handling for every step when scraping each program. 🌴 Both more importantly I scraped and added all programs into a JSON file. 🙌 To top that off I even uploaded it already to Kaggle 📈.

Next up, I plan to make a website for easy access to all the programs and its requirements! 💻

Ok I got the scraper to scrape the requirements 🎢 I am so happy, but I still have to scrape the rest of the 90+ programs💀

So, my next Devlog will be hopefully all programs logged into a json file!

Before scraping the requirements I would like to share that there are no more invalid sites 🥳

Anyways, next update will be scraping for requirements

Who would have guessed the programs I scraped would not be the same as the one's listed on the general page 🙅‍♂️
I built another scraper to validate the sites... Looks like I will need to update 14 sites. Thankfully it is not 102 sites! 😱

Next update will hopefully be a functional app that scrapes for requirements ✅

Since I am going to Grade 12. next year, I need to know the requirements to enroll at a University's programs. 👨‍💻

So far I have built the core of the scraper to grab the title and program list which is stored in a json file. 📁 It will be customizable for user preference like their province, country, and specialty programs they have done.