Flows

Flows are sets of prompt templates which are versioned together and can have an 'active version' per environment.

  1. Prompt templates can replace [[tokens]] with parameters provided in the API call. A [[token]] can also reference another template in the same flow, and works recursively. Values provided in the API call have precedence.

  2. It allows to insert C/C++ style comments (i.e, // ... and /* ... */) which will be removed by the parser before sending a request to the LLM

  3. Template sets are versioned to enable change-tracking. Versions are chosen by

    1. an explicit version id

    2. an "active version" that can be set in the UI per-environment (e.g, prod points to version 5 and testing to version 6, etc.)

Tokens that have no value provided will be replaced by an empty string. Self-references, i.e. a template called 'test' that includes the token [[test]] will not run into an infinite loop

Last updated