🔧 Optimizing my Reddit Analysis Flow

Flow link: https://www.gumloop.com/pipeline?workbook_id=s6mNdXFqy8Ha5uurqqVUJ6&run_id=AtGN2dkLQEgNAVeJa5DnVF

Current setup:

  • Reddit Scraper set to fetch 25 posts
  • Using GPT-4o model
  • Text Formatter tokens increased for both posts and comments

Issue:
Only getting ~5 post summaries in the final output despite scraping 25 posts. Looking to optimize the prompt to analyze more posts.

Current prompt:
Analyze the scraped data from this subreddit. Your goal is to produce a concise, actionable report that freelance writers can use to identify engaging content ideas. Use the provided post titles, descriptions, and comments to generate insights in the following structured format:

#Post Analysis

##Title: ** {post title}

**URL: ** {post URL} The Reddit post URLs typically start with “subreddits” . Do not include any URL that starts with "https://i.redd.it/

Summary
Concisely summarize each post and explain its primary topic or focus. In the summary include user-submitted tips, tricks, and best practices shared in comments. Also, highlight common challenges or questions from the community and any notable solutions provided.

Content Ideas
Generate 3-5 specific, headline-ready article ideas based on each post analysis. The headlines should be social-first or buzzy to spur the writers into thinking of tangential content ideas. Examples:
“10 Ingenious DIY Fixes Using Household Items Like Scotch Tape”
“The 6 Worst Foods to Buy at Sam’s Club, According to Reddit”

Deliver the report in a concise and structured format, emphasizing actionable takeaways for writers. The tone should be professional yet approachable, making it easy for freelance writers to quickly identify potential topics for content creation.

Questions:

  1. How can I modify the prompt to ensure more posts are analyzed?
  2. Any suggestions for maintaining quality while increasing quantity?
  3. Best practices for handling larger numbers of posts?

Thanks in advance! :pray:

Hey @JenK - Have you tried explicitly mentioning to summarize each post (all 25) in the prompt?

Another thing you can try is to use a cheaper model like GPT-4o-mini or DeepSeek v3/R1 to summarize each post individually (ie. the Ask AI node will run in loop mode for all posts) and then merge the output together to write to a Google doc.

So I have this in the prompt: “Concisely summarize each post and explain its primary topic or focus” and the output does that, but then mysteriously stops after about 5 posts. Gummie advised changing up some models too. Something you just said, sparked an idea though. I am outputting the Ask AI right to the Google Docs Writer and I am thinking I might need to add it to the Combine Text first before sending to Google doc. Thoughts on that? And thanks for the help!

Could you please elaborate a bit on what you mean by using the combine text node before the Google Doc?

I think the best approach here would be to summarize each post in a loop and then merge the output together before writing to the Google Doc.

Figured this out on another Gumloop and applying it here. Thanks for the tip @Wasay-Gumloop

No problem! Closing this topic now :slightly_smiling_face:

This topic was solved and automatically closed 60 minutes after the last reply. New replies are no longer allowed.