/
Break Apart Text With Prompt

Break Apart Text With Prompt

A special type of prompt that will break apart a given chunk of text into various sections, depending upon the business logic in the provided prompt.

The content template becomes a system prompt. And the input text to be broken apart first gets processed to add wrapping and line numbers, and then the text with line numbers gets fed as a user message. The model then does a structured output to define the various sections of the output.

Options

text_to_split

The text that should be formatted and broken apart by the model.

model_name

The name of the model that will be used to process the prompt.

temperature

Temperature to use with the model. The exact mathematical definition of temperature can vary depending on the model provider.

max_tokens

The maximum number of tokens to be included in the completion from the LLM provider.

cache_variants

The number of different variations to keep in the cache for this prompt. When the input data to the LLM is exactly the same, the prompt can be ‘cached’. By default only 1 variant is kept. But if your prompt is meant to do something like creative story writing or brainstorming, then you may want to increase the number of variants to say 100 or 10,000, effectively eliminating the cache system.

Output

texts

The a list of strings containing the text for each section.

line_numbers

The raw line numbers that were selected by the model.

Properties

type

LLM

needs conversation

false

uses content template

true

uses options template

true

customizable output schema

false