Skip to content

Ollama (local models)

Install

$pip install aiguard-safety
$ollama pull llama3.1

Code

python
import aiguard

response = aiguard.chat(
    model="ollama/llama3.1",
    api_base="http://localhost:11434",
    messages=[{"role": "user", "content": "Hello"}],
)
print(response.choices[0].message.content)