Create and edit Grok Imagine Video clips via natural language chat

The Video Grok Agent is an AI-powered video generation and editing workflow that uses Grok 4.1 Fast (via OpenRouter) and Grok Imagine Video to create and modify videos through natural language.

This workflow enables seamless AI-driven video creation and editing through a conversational interface, with built-in validation, async processing, and secure credential management.

Key Advantages

1. ✅ Unified Video Creation Pipeline

A single workflow supports text-to-video, image-to-video, and video editing, reducing complexity and avoiding duplicated logic across multiple automations.

2. ✅ AI-Guided User Interaction

The conversational agent ensures:

• the correct tool is selected,
• all mandatory parameters are provided,
• errors due to missing inputs are minimized.

This makes the workflow usable even by non-technical users.

3. ✅ Asynchronous & Scalable Execution

The workflow is designed around queued, non-blocking requests:

• wait nodes + status polling
• no execution timeouts
• scalable for multiple concurrent video jobs

4. ✅ Automatic Media Handling

Uploaded images are:

• detected automatically,
• uploaded to external storage,
• converted into usable URLs without manual steps.

This enables smooth image-to-video generation directly from chat uploads.

5. ✅ Clear Separation of Responsibilities

Each step is modular:

• orchestration (agent),
• decision routing (switch),
• media processing (Fal.run APIs),
• status monitoring (HTTP + wait loops).

This makes the workflow easy to maintain, extend, or debug.

6. ✅ Strong Guardrails & Validation

The agent enforces:

• correct tool usage (e.g. video-to-video only for editing),
• duration limits (1–15 seconds),
• mandatory URLs before execution.

This prevents incorrect API calls and wasted compute.

7. ✅ Extensible Architecture

New tools (e.g. different models, resolutions, aspect ratios, or providers) can be added without redesigning the whole system—just plug them into the existing agent + switch logic.

How it works

1. User Interaction

   • The workflow starts with a chat trigger (When chat message received), where users can upload images and submit text prompts.
   • If an image is uploaded, it is automatically stored via FTP (BunnyCDN) and its URL is passed to the AI agent.

2. AI Agent Orchestration

   • The Grok Imagine Video Agent processes the user’s request and determines which action to perform:
     • Text-to-Video: Create a new video from a text prompt. See test result
     • Image-to-Video: Animate an existing image. See test result
     • Video-to-Video: Edit an existing video. See test result
   • The agent follows strict rules to ensure all required parameters (e.g., duration, URLs, prompts) are collected before proceeding.

3. Video Processing via Fal.run API

   • Depending on the selected tool, the workflow calls the corresponding Fal.run endpoint:
     • text-to-video
     • image-to-video
     • edit-video
   • Each request returns a request_id used to poll for completion.

4. Asynchronous Processing & Polling

   • After submission, the workflow enters a polling loop:
     • Waits 10–30 seconds.
     • Checks the request status via Fal.run’s status endpoint.
     • Once the status is COMPLETED, it retrieves the final video URL.

5. Result Delivery

   • The final video URL is returned to the user via the chat interface.
   • The agent does not proceed further once the video is ready.

Set Up Steps

To deploy and use this workflow in n8n:

1. Credentials Configuration

   • Set up the following credentials in n8n:
     • OpenRouter API (for Grok 4.1 Fast)
     • Fal.run API (HTTP Header Auth)
     • FTP/BunnyCDN (for image uploads)

2. Workflow Activation

   • Ensure all nodes are correctly connected as per the connections mapping.
   • Activate the workflow via the Execute Workflow Trigger (Run Text-to-Video1).

3. Chat Interface Setup

   • The workflow is designed to be triggered via a chat message.
   • Configure the When chat message received node to connect to your frontend or chat platform.

4. Parameter Validation

   • The AI agent includes validation rules to ensure:
     • Duration is between 1–15 seconds.
     • Required URLs (image/video) are provided where needed.
     • The correct tool is invoked based on user intent.

5. Testing & Monitoring

   • Test each tool separately (text, image, video) to ensure Fal.run API responses are handled correctly.
   • Monitor the polling loops to avoid timeouts and ensure video URLs are retrieved successfully.

👉 Subscribe to my new YouTube channel. Here I’ll share videos and Shorts with practical tutorials and FREE templates for n8n.

Need help customizing?

Contact me for consulting and support or add me on Linkedin.