Ollama

Ollama is a lightweight, open-source framework that allows users to run large language models (LLMs) locally on their machines.

The Ollama Agent allows you to interact with a local instance of Ollama: passing the supplied structure input and returning its generated text to include in your Data Stream.

Details of an example and the configuration can be found in the How to Use section.

Pre-requisites

The following is required to use the Agent:

  • An instance of Ollama accessible from the system where the Stream Host is installed

  • JSON file containing the structure of the input

  • Python is installed on the system where the Stream Host is installed (refer to the Python Agent for further details on the install options)

Current Version

Ollama Release Notes

v1.04, 20 May 2024

  • Support single quotes in the input text (by escaping them)

v1.0, 10 May 2024

  • Initial Release

NextExample

Last updated