Ibm Granite Granite 3.3 8b Instruct Text Generator

Description

Granite-3.3-8B-Instruct is a 8-billion parameter 128K context length language model fine-tuned for improved reasoning and instruction-following capabilities.

Overview

This n8n workflow integrates with the Replicate API to use the ibm-granite/granite-3.3-8b-instruct model. This powerful AI model can generate high-quality text content based on your inputs.

Features

• Easy integration with Replicate API
• Automated status checking and result retrieval
• Support for all model parameters
• Error handling and retry logic
• Clean output formatting

Parameters

Optional Parameters

• seed (integer, default: None): Random seed. Leave blank to randomize the seed.
• top_k (integer, default: 50): The number of highest probability tokens to consider for generating the output. If > 0, only keep the top k tokens with highest probability (top-k filtering).
• top_p (number, default: 0.9): A probability threshold for generating the output. If < 1.0, only keep the top tokens with cumulative probability >= top_p (nucleus filtering). Nucleus filtering is described in Holtzman et al. (http://arxiv.org/abs/1904.09751).
• prompt (string, default: ): User prompt to send to the model.
• max_tokens (integer, default: 512): The maximum number of tokens the model should generate as output.
• min_tokens (integer, default: 0): The minimum number of tokens the model should generate as output.
• temperature (number, default: 0.6): The value used to modulate the next token probabilities.
• chat_template (string, default: None): A template to format the prompt with. If not provided, the default prompt template will be used.
• system_prompt (string, default: None): System prompt to send to the model.The chat template provides a good default.
• stop_sequences (string, default: None): A comma-separated list of sequences to stop generation at. For example, '<end>,<stop>' will stop generation at the first instance of 'end' or '<stop>'.

How to Use

1. Set up your Replicate API key in the workflow
2. Configure the required parameters for your use case
3. Run the workflow to generate text content
4. Access the generated output from the final node

API Reference

• Model: ibm-granite/granite-3.3-8b-instruct
• API Endpoint: https://api.replicate.com/v1/predictions

Requirements

• Replicate API key
• n8n instance
• Basic understanding of text generation parameters