Back to Templates

Find, Scrape & Analyze Twitter Posts by Name with Bright Data & Gemini

Created by

Created by: Gleb D || glebd

Gleb D

Last update

Last update 23 days ago

Categories

Share


This n8n workflow template automates the process of collecting and analyzing Twitter (X) posts for any public profile, then generates a clean, AI-powered summary including key metrics, interests, and activity trends.

🚀 What It Does

  • Accepts a user's full name and date range through a public form.
  • Automatically finds the person’s X (formerly Twitter) profile using a Google search.
  • Uses Bright Data to retrieve full post data from the X.com profile.
  • Extracts key post metrics like views, likes, reposts, hashtags, and mentions.
  • Uses Google Gemini (PaLM) to generate a personalized summary: tone, themes, popularity, and sentiments.
  • Stores both raw data and the AI summary into a connected Google Sheet for further review or team collaboration.

🛠️ Step-by-Step Setup

  1. Deploy the public form to collect full name and date range.
  2. Build a Google search query using the name to find their X profile.
  3. Scrape the search results via Bright Data (Web Unlocker zone).
  4. Parse the page content using the HTML node.
  5. Use Gemini AI to extract the correct X profile URL.
  6. Pull full post data via Bright Data dataset snapshot API.
  7. Transform post data into clean structured fields:
    date_posted, description, hashtags, likes, views,
    quoted_post.date_posted, quoted_post.description,
    replies, reposts, quotes, and tagged_users.profile_name.
  8. Analyze all posts using Google Gemini for interest detection and persona generation.
  9. Save results to a Google Sheet: structured post data + AI-written summary.
  10. Show success or fallback messages depending on profile detection or scraping status.

🧠 How It Works: Workflow Overview

  • Trigger: When user submits form
  • Search & Match: Google search → HTML parse → Gemini filters matching X profile
  • Data Gathering: Bright Data → Poll for snapshot completion → Fetch post data
  • Transformation: Extract and restructure key fields via Code node
  • AI Summary: Use Gemini to analyze tone, interests, and trends
  • Export: Save results to Google Sheet
  • Fallback: Display custom error message if no X profile found

📨 Final Output

  • A record in your Google Sheet with:
    • Clean post-level data
    • Profile-level engagement summary
    • An AI-written overview including tone, common topics, and post popularity

🔐 Credentials Used

  • Bright Data account (for search & post scraping)
  • Google Gemini (PaLM) or Gemini Flash via -
    OpenAI/Google Vertex API
  • Google Sheets (OAuth2) account (for result storage)

⚠️Community Node Dependency
This workflow uses a custom community node:
n8n-nodes-brightdata
Install it via UI (Settings → Community Nodes → Install).