Creating Daily Forum Monitoring & Summary Agent

[Nick]

Hi Gumloop team,

I’m trying to create an automated workflow to monitor a forum thread and receive daily summaries, but I’m new to automation and could use some guidance on the best approach.

What I’m trying to achieve:

I’m an active member of a finance discussion forum and want to get a daily recap of what was discussed each evening. The forum is very active with dozens of messages per day, and manually reading everything takes too much time.

Specific forum URL: https://forum.hardware.fr/hfr/Discussions/Viepratique/epargne-placements-heureux-sujet_66515_12451.htm

Desired workflow:

1. Daily monitoring (ideally around 8-9 PM each evening)

   • Scrape the forum thread to get new messages

   • The forum has pagination, currently on page 12451+ and growing

2. Extract new content only

   • I only want messages posted since the last check (last 24 hours)

   • Each message contains: username, timestamp, and message content

   • Need to avoid processing the same messages twice

3. AI summarization

   • Send the new messages to an LLM (Claude or GPT)

   • Get a structured summary in French covering:

     • Main topics discussed

     • Important questions or advice

     • Key insights or news mentioned

4. Delivery

   • Receive the summary by email each evening

   • If no new activity, just send “No new messages today”

What I’ve tried so far:

• I created a flow in Gumloop but it’s not returning any forum messages at all : Gumloop | Automation Builder

• The flow runs without errors but produces empty results

Questions:

1. Why might my current flow be returning no messages? Is there a specific way to target forum post elements?

2. Which blocks should I use for this workflow? (Web Scraper? HTTP Request? Browser Automation?)

3. How can I store the “last processed message ID” between runs?

4. Can I schedule this to run automatically every evening ?

I’m willing to learn and experiment, but some guidance on the right direction would be really helpful!

Thanks in advance for your help!

Nick

[Nick]

No one can help?

[Rithen_Gumloop]

Hey Nick,

This is a great use case and definitely achievable in Gumloop. There are two main ways to approach this, depending on what access you have to the forum data.

If the forum provides an API, that would be the cleanest solution. In that case, you could create a Custom Node to fetch posts from the last 24 hours in a structured format (username, timestamp, content). From there, you can send the data to an AI node for summarization and then deliver the result via the Email node. An API-based approach naturally avoids pagination and duplicate processing since timestamps or post IDs are handled directly.

Otherwise you can use web scraping node. The hardware.fr forum uses a predictable pagination pattern where the page number changes in the URL ( Épargne / Placements - TRI de votre résidence principale [POGNON] - Page : 3 - Vie pratique - Discussions - FORUM HardWare.fr – the number before .htm for example), so you can just scrape the most recent two or three pages, adjusting based on how active the forum is generally.

Once the pages are scraped, you can send the content to an AI node and have it summarize only posts from the last 24 hours, since each post includes a timestamp. You can also pass the current date and time into the AI node ( Using our DateTime Node) so it can automatically filter older messages.

And yes you can add a time trigger on this workflow so it can automatically run periodically.

Let me know if this makes sense.