Intelligent Web Query and Semantic Re-Ranking Flow using Brave and Google Gemini

Created by

Mind-Front

Last update

Last update 7 months ago

Workflow Description

This workflow is a powerful, fully automated web query and semantic reranking system that allows users to perform precise, detailed searches, intelligently rank search results and provide high-quality, structured output. Built with AI-powered components, the workflow leverages semantic query generation, result re-ranking, and real-time reporting to deliver actionable insights.

It is particularly well-suited for real-time data retrieval, market research, and any domain requiring automated yet customizable search result processing.

How It Works

Webhook Integration for Input:
- The workflow begins with a Webhook Node that captures the user's search query as input, enabling seamless integration with other systems.
Step 1: Semantic Query Generation (Powered by "Semantic Search - Query Maker"):
- Using AI (Google Gemini), the initial query is refined and transformed into a context-aware, expert-level search query.
- The process ensures that the search engine retrieves the most relevant and precise results.
Step 2: Web Search Execution:
- A free Brave Search API processes the refined query to fetch search results, ensuring speed and cost efficiency.
Step 3: Semantic Re-Ranking of Results (Powered by "Semantic Search - Result Re-Ranker"):
- The workflow reranks the search results based on relevance to the original question, prioritizing the most relevant URLs dynamically.
- Results are passed through AI-powered intelligent reranking to ensure the final output reflects optimal relevance and quality.
Step 4: Structured Output Generation:
- Results are converted into a well-structured, organized JSON format, ranking the top 10 search results with their titles, links, and descriptions.
- Missing ranks (if fewer than 10 results) are handled gracefully with placeholders, ensuring consistency.
Step 5: Real-Time Reporting:
- The reranked search results are sent back to the user or integrated system via the Webhook Node in a JSON-formatted response.
- Reports are highly structured and ready for downstream processing or consumption.

Key Features

AI-Powered Query Refinement:
- Transforms basic queries into detailed, expert-level search terms for optimal results.
Dual-Stage Semantic Search:
- Combines query generation and result reranking for precise, high-relevance outputs.
Top 10 Result Reranking:
- Dynamically ranks and organizes the top 10 results based on semantic relevance to the query.
Customizable Integration:
- Fully modifiable for alternative APIs or integrations, such as other search engines or custom ranking logic.
JSON-Formatted Structured Results:
- Outputs reranked results in a standardized format, ideal for integration into systems requiring machine-readable data.
Webhook-Based Flexibility:
- Works seamlessly with Webhook inputs for easy deployment in diverse workflows.
Cost-Effective API Usage:
- Pre-integrated with the free Brave Search API, minimizing operational costs while delivering accurate search results.

Instructions for API Setup

Brave Search API:
- Visit api.search.brave.com to obtain a free-tier API key for web search.
AI Integration (Google Gemini):
- Visit Google AI Studio and generate an API key for semantic query generation and reranking.
Webhook Configuration:
- Set up the input Webhook to capture search queries and the output Webhook to deliver reranked results.

Why Choose This Workflow?

Precision and Relevance: Combines AI-based query generation with advanced reranking for accurate results.
Fully Customizable: Easily adapt the workflow to alternative APIs, search engines, or ranking logic.
Real-Time Insights: Provides structured, real-time output ready for immediate use.
Scalable and Modular: Ideal for businesses, researchers, and data analysts needing a robust, repeatable solution.