Hello! While developing my conventional search engine, I’ve stumbled across this really neat program called Videoshack. Its a video search engine that gets videos via a webscraper, which I can combine with my search engine to make it more professional, like google.
The only problem is that I can barely understand how it works. Specifically, when it comes to scraping and displaying videos. I’ve asked around other forums, and apparently what I’ve trying to do is so niche that I’ll be unable to find any tutorials on it. Though I did learn a few things about the process.
My issues are as followed:
1.) How can I implement an API with Videoshack for scraping? I’ve been looking at the documentation for Pornhub’s API (lmao), but it looks like the instructions to implement the API are completely different than the way Videoshack does it. Does this mean I’m supposed to combine the two, or what? An example for the API implementation is below.
2.) How does it then display the videos? I’m more used to displaying search topics with a database, but Videoshack doesn’t seem to come with one.
Typically, I stay away from asking question like this, but there’s just no documentation for what I’m trying to do here, so I have no choice.
Here’s some links for the API implementation that I talked about
I believe this is how the PH scraper gets webpages: const utils = require('./utils');const utils_scrap = require('./helpers/utils_ - Pastebin.com
(I don’t know why the link seems weird; I can’t fix it).
And here’s how Video’s hack scrapes for videos: case "vimeo": got("https://vimeo.com/search?q=" + encodeURI - Pastebin.com
Everything seems to be implemented in different ways, and I’m not sure how I’d learn to do it myself. Any ideas?