Unable to extract list of videos from YouTube channel

I’d like to create an index of videos on a YouTube channel, say, https://www.youtube.com/@DevOpsToolkit/videos.

The website scraper runs on the link but it fails in two ways.

First, I want to do this in an organized way from oldest to most current videos.
For that to work, the scraper needs to click on the “Oldest” button, which it can’t do.

Second, to see all the videos on the channel it must scroll the browser window, which is another thing that it can’t do.

Now, obviously, using the YouTube API is the better way to do this so I made a credential, a python script and got the video list I wanted.

Still, this points out a limitation for non-programmers since manipulating the browser is not possible (to my knowledge).

Note that the infinite scrolling nature of the page means that some sort of repeat mechanism is required to obtain the entire page.

Cheers,
André

Hey @AangelHD! If you’re reporting an issue with a flow or an error in a run, please include the run link and make sure it’s shareable so we can take a look.

  1. Find your run link on the history page. Format: https://www.gumloop.com/pipeline?run_id={{your_run_id}}&workbook_id={{workbook_id}}

  2. Make it shareable by clicking “Share” → ‘Anyone with the link can view’ in the top-left corner of the flow screen.
    GIF guide

  3. Provide details about the issue—more context helps us troubleshoot faster.

You can find your run history here: https://www.gumloop.com/history

Hey @AangelHD ,

Yes, that makes sense. The current scraper node does have its limitations, but we’re planning to add a more advanced YouTube integration using the MCP feature (learn more about MCP workflows) to enable these kinds of use cases.

It’s already in the works: https://www.gumloop.com/mcp

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.