Quick Overview
This workflow manually batch-scrapes a list of blog post URLs with Firecrawl, polls until the scrape completes, cleans the returned markdown into plain text, and writes the combined content into a newly created Google Doc.
How it works
- Runs when you manually execute the workflow in n8n.
- Submits a batch scrape job to Firecrawl for a configured list of blog post URLs.
- Waits one minute and repeatedly checks Firecrawl for the batch scrape status until it reports completed or failed.
- Stops the workflow with an error message if Firecrawl returns a failed status.
- Creates a new Google Doc titled with the Firecrawl batch ID once the scrape completes.
- Cleans and combines the scraped markdown by removing navigation/footer sections, links, images, and most markdown formatting while keeping titles and source URLs.
- Inserts the cleaned combined text into the Google Doc.
Setup
- Add a Firecrawl API credential and select it in the Firecrawl batch scrape and status-check steps.
- Add Google Docs OAuth2 credentials and select them in the Google Docs create and update steps.
- Replace the placeholder URL list in the Firecrawl batch scrape step with the blog post URLs you want to scrape.