MusicPages Scraper
- Description
- Web scraper for given pages
- Project type
- Personal — open source / freeware
- Start date
- November of 2020
- End date
- December of 2020
- Project URL
- —
- Skills
About project
Originally the prerequisite for https://kovo.space/projekty/bandzone-player-unofficial - a Spring Boot backend for scraping data from music websites and caching the useful data into an SQL database.
The motivation for this backend:
- Reducing the complexity and the demands of the Android app - the app sends what it wants to find and gets back only the relevant data, so the scraping does not run on a mobile device with limited performance.
- Faster searching - search results and band profiles are gradually cached into the SQL database, so opening a band's profile again or repeating the same search is considerably faster from the user's point of view as well, because scraping every single time is a fairly expensive operation
- Extensibility / generality - the plan for the future was a player browsing several sites, and besides Bandzone.cz support for Freeteknomusic.org has been added, for example