https://github.com/ollama/ollama/blob/main/docs/faq.md 

curl -fsSL https://ollama.com/install.sh | sh

升级就是重新跑一遍整个安装过程就行

 https://ollama.com/library/mistral:7b-instruct-v0.3-q5_K_M 

按照经验,是可以跑Q5的

ollama run mistral:7b-instruct-v0.3-q5_K_M

Function calling

Mistral 0.3 supports function calling with Ollama’s raw mode.

Example raw prompt

[AVAILABLE_TOOLS] [{"type": "function", "function": {"name": "get_current_weather", 
"description": "Get the current weather", "parameters": {"type": "object", 
"properties": {"location": {"type": "string", "description": "The city and state, e.g. San Francisco, CA"}, 
"format": {"type": "string", "enum": ["celsius", "fahrenheit"], 
"description": "The temperature unit to use. Infer this from the users location."}}, 
"required": ["location", "format"]}}}][/AVAILABLE_TOOLS][INST] What is the weather 
like today in San Francisco [/INST]

Example response

[TOOL_CALLS] [{"name": "get_current_weather", 
"arguments": {"location": "San Francisco, CA", "format": "celsius"}}]

 https://github.com/ollama/ollama/blob/main/docs/api.md#request-raw-mode 

主要就是测试一下Function Calling


Request (Raw Mode)

In some cases, you may wish to bypass the templating system and provide a full prompt. 
In this case, you can use the raw parameter to disable templating. 
Also note that raw mode will not return a context.

Request
curl http://localhost:11434/api/generate -d '{
  "model": "mistral",
  "prompt": "[INST] why is the sky blue? [/INST]",
  "raw": true,
  "stream": false
}'

Ollama现在支持发一个Raw的request