2-tier Web Scraping

Get Help
1

Not sure If I am allowed to metion actual names / websites which I want to scrape.

So, posting my query without it.

There is industrial union website, whose members are small businesses, the directory can be viewed online.
I ish to build a flow that:-

  1. scrapes websites of each small business listed on the industrial union website

  2. goes to each individual website & gathers their email, phone & address from their contact section

I tried to apply for the learning cohort, but no update on it.

I wonder if someone here can help me

2

You can def do a 2 tier web scraping.
Gumloop has the concept of a subflow.
So your 1st tier is to get the full list
Your second tier is the subflow and will to each one and pull out the info and slack it or something.
See an example I threw together
https://www.gumloop.com/pipeline?workbook_id=swqAZAgZt1M93vcggHEhuK

1 Like
3

This topic was solved and automatically closed 4 days after the last reply. New replies are no longer allowed.