I’d like to create an index of videos on a YouTube channel, say, https://www.youtube.com/@DevOpsToolkit/videos.
The website scraper runs on the link but it fails in two ways.
First, I want to do this in an organized way from oldest to most current videos.
For that to work, the scraper needs to click on the “Oldest” button, which it can’t do.
Second, to see all the videos on the channel it must scroll the browser window, which is another thing that it can’t do.
Now, obviously, using the YouTube API is the better way to do this so I made a credential, a python script and got the video list I wanted.
Still, this points out a limitation for non-programmers since manipulating the browser is not possible (to my knowledge).
Note that the infinite scrolling nature of the page means that some sort of repeat mechanism is required to obtain the entire page.
Cheers,
André
