Lopp with website scrapper; can't past he orginal URL value in the output file

Hello,

I built a website scraper to extract data from competitors’ sites, and it runs in a loop as I provide a list of URLs to scrape as a starting point for the flow. Working perfectly fine except I want to pass the original URL in the export list (so I need to “attach” the original URL to the rows extracted for each URL scraped).

Gummie was super helpful for the rest of the flow, but couldn’t come up with a working solution for this one. It sounds super easy in theory, but I’ve now spent more time on this part than on the whole flow. Do you have any idea how to achieve this?

https://www.gumloop.com/pipeline?workbook_id=uBUCr7o56txarFxZEXwuvt

Best,
Julien

Hey @blobibblo! If you’re reporting an issue with a flow or an error in a run, please include the run link and make sure it’s shareable so we can take a look.

  1. Find your run link on the history page. Format: https://www.gumloop.com/pipeline?run_id={{your_run_id}}&workbook_id={{workbook_id}}

  2. Make it shareable by clicking “Share” → ‘Anyone with the link can view’ in the top-left corner of the flow screen.
    GIF guide

  3. Provide details about the issue—more context helps us troubleshoot faster.

You can find your run history here: https://www.gumloop.com/history

1 Like

Hey @blobibblo – You can directly connect the Google Sheet Reader node with the Google Sheet Writer node to pass the original URL:

I’d also recommend looking into subflows to make your flow more robust:

Subflow Tutorial: https://vimeo.com/1052111235/cb7e3a446b
Subflow Docs: https://docs.gumloop.com/core-concepts/subflows

Eg setup: https://www.gumloop.com/pipeline?workbook_id=gJvkkzP6A598vFZN5YnvvQ

Let me know if this makes sense and works for you :slightly_smiling_face:

Hi @Wasay-Gumloop, thanks a lot for your answer. Unfortunately, it doesn’t work the way I want it to. The URL value is only written in the export doc for the first element of the list, not for each of them.

I’ll look into the subflow. Thanks for the support!

1 Like

This topic was automatically closed 5 days after the last reply. New replies are no longer allowed.