See llms.txt for all machine-readable content.

Back to Templates

Split web pages into vector-ready chunks with Ragfeed

Created by

Created by: Leif Albrand (Ragfeed) || ragfeed
Leif Albrand (Ragfeed)

Last update

Last update 2 days ago

Categories

Share

Quick Overview

This workflow runs manually to send a webpage URL to the Ragfeed scraping API, which returns the page content split into token-bounded text chunks, then outputs one n8n item per chunk ready for embedding and storage in a vector database.

How it works

  1. Runs when you execute the workflow manually.
  2. Sets the target webpage URL and the maximum chunk size in tokens.
  3. Sends a POST request to the Ragfeed API (/v2/scrape) to scrape the URL and return the content in chunk format.
  4. Splits Ragfeed’s data.chunks array into one item per chunk so each record can be embedded or stored independently.

Setup

  1. Create an n8n Header Auth credential that sends an Authorization: Bearer <your Ragfeed API key> header.
  2. Select that credential in the HTTP request that calls https://api.ragfeed.de/v2/scrape.
  3. Update the URL and maxTokens values to match the page you want to process and your preferred chunk size.