Refactoring A PDF And Web Scraper Part 2 // CODE ROAST

From the creator

💡 Learn how to design great software in 7 steps: https://arjan.codes/designguide. In part 2 of this PDF and web scraper refactoring, I clean up the ScrapeRequest class and show you a few suggestions for how to deal with configuration settings in a data science/scraper project like this. If you haven't watched part 1 yet, here's the link: https://youtu.be/MXM6VEtf8SE. The code I worked on in this episode is available here: https://github.com/ArjanCodes/2021-coderoast-scrape. 🎓 ArjanCodes Courses: https://www.arjancodes.com/courses/ 🔖 Chapters: 0:00 Intro 1:19 Example recap 3:22 What I'll do in this part of the refactoring 3:32 Cleaning up the FileRequest subclasses 8:56 Cleaning up the ScrapeRequest class hierarchy 12:22 Moving utility functions to a separate file 16:15 Removing the duplication from logging 19:12 Moving configuration settings to a separate file 23:38 Tips for dealing with configuration settings 25:34 Removing hardcoded word lists 28:04 Passing around configuration settings 32:50 Final thoughts #arjancodes #softwaredesign #python

Published 2021-12-10 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.