Last Updated: 3/5/2026

Text Completion Inferlet

A simple inferlet for text completion tasks.

Usage

This inferlet accepts a prompt and optional parameters to generate text completions.

Inputs

• prompt: The user message to complete.
• system (optional): System prompt.
• max_tokens (optional): Max tokens to generate.
• temperature (optional): Sampling temperature.
• top_p (optional): Nucleus sampling threshold.

Outputs

• completion: The generated text.