Process that we are using for 6 months now keep getting stuck

Get Help Bug
, ,
1

Hi, for some reason, this flow is running forever. Every time we run it, we need to contact you guys to expand a specific service to make it finish.

https://www.gumloop.com/pipeline?run_id=QhyA6x9htxwcUk6DvhjFZz&workbook_id=ttY6MHWuFctj6RPYP3ejBK

Can you help us make sure this runs automatically? We need this to run daily, currently last run was a week ago.

2

Hey @Eyal_Bens! If you’re reporting an issue with a flow or an error in a run, please include the run link and make sure it’s shareable so we can take a look.

  1. Find your run link on the history page. Format: https://www.gumloop.com/pipeline?run_id={{your_run_id}}&workbook_id={{workbook_id}}

  2. Make it shareable by clicking “Share” → ‘Anyone with the link can view’ in the top-left corner of the flow screen.
    GIF guide

  3. Provide details about the issue—more context helps us troubleshoot faster.

You can find your run history here: https://www.gumloop.com/history

3

Hey @Eyal_Bens – his might be too much data for a single run at the moment. I’d recommend splitting it into batches of around 1000 rows or so at a time.

That said, the most robust solution here would be to use a Google Sheet Writer node instead of the CSV Writer, and build a subflow that processes a single URL – then loop it over your list of URLs. In your case, the subflow would include everything downstream of the Filter node: the scraping subflow, Combine Text, Extract Data, and finally the Sheet Writer (instead of CSV Writer).

The benefit of this setup is that each subflow run writes data to the sheet individually, so all URLs are processed in parallel and you get data showing up in real time, instead of all at once at the end.

Here’s a quick tutorial for setting that up:
Subflow Tutorial: https://www.gumloop.com/university/lessons/retrieving-information-subflows-loop-mode
Subflow Docs: https://docs.gumloop.com/core-concepts/subflows

Let me know if that works for you. Unfortunately, at this moment such large runs in a single run are likely to get stuck.

4

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.