{"id":28545,"date":"2025-03-13T23:17:33","date_gmt":"2025-03-13T15:17:33","guid":{"rendered":"https:\/\/www.aisharenet.com\/?p=28545"},"modified":"2025-03-13T23:22:34","modified_gmt":"2025-03-13T15:22:34","slug":"zai-python-zhongshiyong","status":"publish","type":"post","link":"https:\/\/www.kdjingpai.com\/de\/zai-python-zhongshiyong\/","title":{"rendered":"\u5728 Python \u4e2d\u4f7f\u7528 Ollama API"},"content":{"rendered":"<p>\u5728\u672c\u6587\u4e2d\uff0c\u6211\u4eec\u5c06\u7b80\u5355\u4ecb\u7ecd\u5982\u4f55\u5728 Python \u4e2d\u4f7f\u7528 <a href=\"https:\/\/www.kdjingpai.com\/ollama\/\">Ollama<\/a> API\u3002\u65e0\u8bba\u4f60\u662f\u60f3\u8fdb\u884c\u7b80\u5355\u7684\u804a\u5929\u5bf9\u8bdd\u3001\u4f7f\u7528\u6d41\u5f0f\u54cd\u5e94\u5904\u7406\u5927\u6570\u636e\u3001\u8fd8\u662f\u5e0c\u671b\u5728\u672c\u5730\u8fdb\u884c\u6a21\u578b\u7684\u521b\u5efa\u3001\u590d\u5236\u3001\u5220\u9664\u7b49\u64cd\u4f5c\uff0c\u672c\u6587\u90fd\u53ef\u4ee5\u4e3a\u4f60\u63d0\u4f9b\u6307\u5bfc\u3002\u6b64\u5916\uff0c\u6211\u4eec\u8fd8\u5c55\u793a\u4e86\u5982\u4f55\u4f7f\u7528\u81ea\u5b9a\u4e49\u5ba2\u6237\u7aef\u548c\u5f02\u6b65\u7f16\u7a0b\u6765\u4f18\u5316\u4f60\u7684\u5e94\u7528\u7a0b\u5e8f\u6027\u80fd\uff0c\u65e0\u8bba\u4f60\u662f Ollama \u7684\u65b0\u624b\u8fd8\u662f\u7ecf\u9a8c\u4e30\u5bcc\u7684\u5f00\u53d1\u8005\uff0c\u672c\u6587\u90fd\u80fd\u5e2e\u52a9\u4f60\u5728 Python \u4e2d\u66f4\u9ad8\u6548\u5730\u4f7f\u7528 Ollama API\u3002<\/p>\n<blockquote><p>\u672c\u6559\u7a0b\u8fd8\u4e3a\u5927\u5bb6\u63d0\u4f9b\u4e86\u4e00\u4e2a\u00a0<a href=\"https:\/\/github.com\/datawhalechina\/handy-ollama\/blob\/main\/notebook\/C4\/%E5%9C%A8%20Python%20%E4%B8%AD%E4%BD%BF%E7%94%A8%20Ollama%20API.ipynb\">Jupyter Notebook<\/a>\u00a0\u793a\u4f8b\uff0c\u6765\u8ba9\u5927\u5bb6\u66f4\u597d\u7684\u5b66\u4e60\u3002<\/p><\/blockquote>\n<p>&nbsp;<\/p>\n<h2>\u73af\u5883\u51c6\u5907<\/h2>\n<p>\u5728\u5f00\u59cb\u4f7f\u7528 Python \u4e0e Ollama API \u4ea4\u4e92\u4e4b\u524d\uff0c\u8bf7\u786e\u4fdd\u60a8\u7684\u5f00\u53d1\u73af\u5883\u6ee1\u8db3\u4ee5\u4e0b\u6761\u4ef6\uff1a<\/p>\n<ul>\n<li>Python: \u5b89\u88c5 Python 3.8 \u6216\u66f4\u9ad8\u7248\u672c\u3002<\/li>\n<li>pip: \u786e\u4fdd\u5df2\u5b89\u88c5 pip\uff0cPython \u7684\u5305\u7ba1\u7406\u5de5\u5177\u3002<\/li>\n<li>ollama \u5e93: \u7528\u4e8e\u66f4\u65b9\u4fbf\u5730\u4e0e Ollama API \u4ea4\u4e92\u3002\u5b89\u88c5\u547d\u4ee4\u5982\u4e0b\uff1a<\/li>\n<\/ul>\n<pre><code>pip install ollama\r\n<\/code><\/pre>\n<p>&nbsp;<\/p>\n<h2>\u4f7f\u7528\u65b9\u6cd5<\/h2>\n<pre><code>from ollama import chat\r\nfrom ollama import ChatResponse\r\nresponse: ChatResponse = chat(model='llama3.1', messages=[\r\n{\r\n'role': 'user',\r\n'content': '\u4e3a\u4ec0\u4e48\u5929\u7a7a\u662f\u84dd\u8272\u7684\uff1f',\r\n},\r\n])\r\nprint(response['message']['content'])\r\nprint(response.message.content)\r\n<\/code><\/pre>\n<p>&nbsp;<\/p>\n<h2>\u6d41\u5f0f\u54cd\u5e94<\/h2>\n<p>\u53ef\u4ee5\u901a\u8fc7\u8bbe\u7f6e\u00a0<code>stream=True<\/code>\u00a0\u542f\u7528\u54cd\u5e94\u6d41\uff0c\u4f7f\u51fd\u6570\u8c03\u7528\u8fd4\u56de\u4e00\u4e2a Python \u751f\u6210\u5668\uff0c\u5176\u4e2d\u6bcf\u4e2a\u90e8\u5206\u90fd\u662f\u6d41\u4e2d\u7684\u4e00\u4e2a\u5bf9\u8c61\u3002<\/p>\n<pre><code>from ollama import chat\r\nstream = chat(\r\nmodel='llama3.1',\r\nmessages=[{'role': 'user', 'content': '\u4e3a\u4ec0\u4e48\u5929\u7a7a\u662f\u84dd\u8272\u7684\uff1f'}],\r\nstream=True,\r\n)\r\nfor chunk in stream:\r\nprint(chunk['message']['content'], end='', flush=True)\r\n<\/code><\/pre>\n<p>&nbsp;<\/p>\n<h2>\u7ed3\u6784\u5316\u8f93\u51fa<\/h2>\n<ul>\n<li>\u666e\u901a\u8f93\u51fa\uff08Unstructured Output\uff09\n<ul>\n<li>\u76f4\u63a5\u751f\u6210\u81ea\u7136\u8bed\u8a00\u6587\u672c\u3002<\/li>\n<li>\u9002\u5408\u4eba\u7c7b\u9605\u8bfb\uff0c\u4f46\u4e0d\u4fbf\u4e8e\u7a0b\u5e8f\u89e3\u6790\u6216\u81ea\u52a8\u5316\u5904\u7406\u3002<\/li>\n<li>\u4f8b\u5982\uff1a\n<pre><code>\u8fd9\u662f\u4e00\u53ea\u9ed1\u8272\u7684\u5c0f\u732b\uff0c\u5b83\u6b63\u5728\u8349\u5730\u4e0a\u73a9\u800d\u3002\r\n<\/code><\/pre>\n<\/li>\n<\/ul>\n<\/li>\n<li>\u7ed3\u6784\u5316\u8f93\u51fa\uff08Structured Output\uff09\n<ul>\n<li>\u4ee5 JSON \u3001 YAML \u3001 XML \u6216\u5176\u4ed6\u683c\u5f0f\u8fd4\u56de\u6570\u636e\uff0c\u4f7f\u5176\u66f4\u5bb9\u6613\u88ab\u673a\u5668\u89e3\u6790\u548c\u4f7f\u7528\u3002<\/li>\n<li>\u9002\u5408 API \u3001\u81ea\u52a8\u5316\u5de5\u4f5c\u6d41\u548c\u6570\u636e\u5b58\u50a8\u3002<\/li>\n<li>\u4f8b\u5982\uff1a\n<pre><code>{\r\n\"description\": \"\u8fd9\u662f\u4e00\u53ea\u9ed1\u8272\u7684\u5c0f\u732b\",\r\n\"activity\": \"\u6b63\u5728\u8349\u5730\u4e0a\u73a9\u800d\"\r\n}\r\n<\/code><\/pre>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h3>\u7ed3\u6784\u5316\u8f93\u51fa\u7684\u4f18\u52bf<\/h3>\n<h4>\uff081\uff09\u4fbf\u4e8e\u5904\u7406<\/h4>\n<ul>\n<li>\u673a\u5668\u53ef\u4ee5\u8f7b\u677e\u63d0\u53d6\u7279\u5b9a\u5b57\u6bb5\uff0c\u5982\u00a0<code>description<\/code>\u00a0\u6216\u00a0<code>activity<\/code>\u00a0\uff0c\u800c\u65e0\u9700 NLP \u89e3\u6790\u666e\u901a\u6587\u672c\u3002<\/li>\n<\/ul>\n<h4>\uff082\uff09\u63d0\u9ad8\u53ef\u63a7\u6027<\/h4>\n<ul>\n<li>\u7ed3\u6784\u5316\u683c\u5f0f\u8ba9\u5f00\u53d1\u8005\u53ef\u4ee5\u7cbe\u786e\u63a7\u5236\u6a21\u578b\u8f93\u51fa\uff0c\u907f\u514d\u5197\u957f\u6216\u4e0d\u53ef\u9884\u6d4b\u7684\u56de\u7b54\u3002<\/li>\n<li>\u4f8b\u5982\uff0c\u5728 AI \u751f\u6210\u4ee3\u7801\u65f6\uff1a\n<pre><code>{\r\n\"language\": \"Python\",\r\n\"code\": \"print('Hello, World!')\"\r\n}\r\n<\/code><\/pre>\n<\/li>\n<\/ul>\n<h4>\uff083\uff09\u4fbf\u4e8e\u5b58\u50a8\u4e0e\u5206\u6790<\/h4>\n<ul>\n<li>\u7ed3\u6784\u5316\u6570\u636e\u66f4\u9002\u5408\u5b58\u50a8\u5230\u6570\u636e\u5e93\u4e2d\uff0c\u65b9\u4fbf\u67e5\u8be2\u548c\u5206\u6790\u3002<\/li>\n<li>\u4f8b\u5982\uff1a\n<pre><code>{\r\n\"date\": \"2025-01-20\",\r\n\"summary\": \"\u4eca\u5929\u7684\u9500\u552e\u989d\u589e\u957f\u4e8610%\u3002\"\r\n}\r\n<\/code><\/pre>\n<\/li>\n<\/ul>\n<pre><code>from pydantic import BaseModel, Field\r\nfrom ollama import chat\r\nimport json\r\nclass CountryInfo(BaseModel):\r\ncapital: str = Field(..., alias=\"\u9996\u90fd\")\r\nnumber: str = Field(..., alias=\"\u4eba\u53e3\")\r\narea: str = Field(..., alias=\"\u5360\u5730\u9762\u79ef\")  \r\nresponse = chat(\r\nmodel='llama3.1',\r\nmessages=[{\r\n'role': 'user',\r\n'content': \"\u8bf7\u4ecb\u7ecd\u7f8e\u56fd\u7684\u9996\u90fd\u3001\u4eba\u53e3\u3001\u5360\u5730\u9762\u79ef\u4fe1\u606f\uff0c\u5e76\u4ee5 JSON \u683c\u5f0f\u8fd4\u56de\u3002\"\r\n}],\r\nformat=\"json\",  \r\noptions={'temperature': 0}, \r\n)\r\nresponse_content = response[\"message\"][\"content\"]\r\nif not response_content:\r\nraise ValueError(\"Ollama \u8fd4\u56de\u7684 JSON \u4e3a\u7a7a\")\r\njson_response = json.loads(response_content)  \r\nprint(json_response)\r\nfriends_response = CountryInfo.model_validate(json_response)  \r\nprint(friends_response)\r\n<\/code><\/pre>\n<p>&nbsp;<\/p>\n<h2>API<\/h2>\n<p>Ollama Python \u5e93\u63d0\u4f9b\u4e86\u4e30\u5bcc\u7684\u63a5\u53e3\uff0c\u7b80\u5316\u4e86\u4e0e Ollama \u7684\u4ea4\u4e92\u3002\u8fd9\u4e9b\u63a5\u53e3\u8bbe\u8ba1\u76f4\u89c2\uff0c\u6613\u4e8e\u96c6\u6210\uff0c\u65e8\u5728\u5e2e\u52a9\u5f00\u53d1\u8005\u66f4\u4fbf\u6377\u5730\u8c03\u7528\u548c\u7ba1\u7406\u6a21\u578b\u3002\u5982\u679c\u4f60\u60f3\u4e86\u89e3\u66f4\u8be6\u7ec6\u7684\u5e95\u5c42\u5b9e\u73b0\u548c\u5b8c\u6574\u7684 API \u7aef\u70b9\u4fe1\u606f\uff0c\u5efa\u8bae\u53c2\u8003\u00a0<a href=\"https:\/\/www.kdjingpai.com\/ollama-api-shiyongzhi\/\">Ollama API \u4f7f\u7528\u6307\u5357<\/a>\u3002<\/p>\n<h3>\u804a\u5929<\/h3>\n<pre><code>ollama.chat(model='llama3.1', messages=[{'role': 'user', 'content': '\u4e3a\u4ec0\u4e48\u5929\u7a7a\u662f\u84dd\u8272\u7684\uff1f'}])\r\n<\/code><\/pre>\n<h3>\u751f\u6210<\/h3>\n<pre><code>ollama.generate(model='llama3.1', prompt='\u4e3a\u4ec0\u4e48\u5929\u7a7a\u662f\u84dd\u8272\u7684\uff1f')\r\n<\/code><\/pre>\n<h3>\u672c\u5730\u6a21\u578b\u5217\u8868<\/h3>\n<pre><code>ollama.list()\r\n<\/code><\/pre>\n<h3>\u663e\u793a\u6a21\u578b\u4fe1\u606f<\/h3>\n<pre><code>ollama.show('llama3.1')\r\n<\/code><\/pre>\n<h3>\u521b\u5efa\u6a21\u578b<\/h3>\n<pre><code>modelfile='''\r\nFROM llama3.1\r\nSYSTEM \u4f60\u662f\u8d85\u7ea7\u9a6c\u91cc\u5965\u5144\u5f1f\u4e2d\u7684\u9a6c\u91cc\u5965\u3002\r\n'''\r\nollama.create(model='example', modelfile=modelfile)\r\n<\/code><\/pre>\n<h3>\u590d\u5236\u6a21\u578b<\/h3>\n<pre><code>ollama.copy('llama3.1', 'user\/llama3.1')\r\n<\/code><\/pre>\n<h3>\u5220\u9664\u6a21\u578b<\/h3>\n<pre><code>ollama.delete('llama3.1')\r\n<\/code><\/pre>\n<h3>\u62c9\u53d6\u6a21\u578b<\/h3>\n<pre><code>ollama.pull('llama3.1')\r\n<\/code><\/pre>\n<h3>\u63a8\u9001\u6a21\u578b<\/h3>\n<pre><code>ollama.push('user\/llama3.1')\r\n<\/code><\/pre>\n<h3>\u751f\u6210\u5d4c\u5165<\/h3>\n<pre><code>ollama.embeddings(model='llama3.1', prompt='\u5929\u7a7a\u662f\u84dd\u8272\u7684\u56e0\u4e3a\u745e\u5229\u6563\u5c04')\r\n<\/code><\/pre>\n<pre><code># \u6279\u91cf\u751f\u6210embedding\r\nollama.embed(model='llama3.1', input=['\u5929\u7a7a\u662f\u84dd\u8272\u7684', '\u8349\u662f\u7eff\u8272\u7684'])\r\n<\/code><\/pre>\n<h3>\u8fdb\u7a0b<\/h3>\n<pre><code>ollama.ps()\r\n<\/code><\/pre>\n<p>&nbsp;<\/p>\n<h2>\u81ea\u5b9a\u4e49\u5ba2\u6237\u7aef<\/h2>\n<p>\u53ef\u4ee5\u901a\u8fc7\u901a\u8fc7\u00a0<code>ollama<\/code>\u00a0\u5b9e\u4f8b\u5316\u00a0<code>Client<\/code>\u00a0\u6216\u00a0<code>AsyncClient<\/code>\u00a0\u6765\u521b\u5efa\u81ea\u5b9a\u4e49\u5ba2\u6237\u7aef\u3002<\/p>\n<p>\u53ef\u4ee5\u4f7f\u7528\u4ee5\u4e0b\u5b57\u6bb5\u521b\u5efa\u81ea\u5b9a\u4e49\u5ba2\u6237\u7aef\uff1a<\/p>\n<ul>\n<li><code>host<\/code>: \u8981\u8fde\u63a5\u7684 Ollama \u4e3b\u673a<\/li>\n<li><code>timeout<\/code>: \u8bf7\u6c42\u8d85\u65f6\u65f6\u95f4<\/li>\n<\/ul>\n<p>\u6240\u6709\u5173\u952e\u5b57\u53c2\u6570\u53c2\u89c1<a href=\"https:\/\/www.python-httpx.org\/api\/#client\"><code>httpx.Client<\/code><\/a>.<\/p>\n<h3>\u540c\u6b65\u5ba2\u6237\u7aef<\/h3>\n<p>\u4f7f\u7528\u7684\u662f\u540c\u6b65\u5ba2\u6237\u7aef\u00a0<code>(Client)<\/code>\u00a0\u610f\u5473\u7740\u5f53\u4f60\u8c03\u7528\u00a0<code>client.chat()<\/code>\u00a0\u65b9\u6cd5\u65f6\uff0c\u7a0b\u5e8f\u4f1a\u7b49\u5f85\u8be5\u8bf7\u6c42\u5b8c\u6210\u5e76\u8fd4\u56de\u7ed3\u679c\u540e\u624d\u4f1a\u7ee7\u7eed\u6267\u884c\u540e\u7eed\u4ee3\u7801\u3002\u8fd9\u79cd\u65b9\u5f0f\u66f4\u76f4\u89c2\u3001\u7b80\u5355\uff0c\u9002\u5408\u4e8e\u7f16\u5199\u6d41\u7a0b\u8f83\u4e3a\u7ebf\u6027\u3001\u4e0d\u9700\u8981\u5904\u7406\u5927\u91cf\u5e76\u53d1\u4efb\u52a1\u7684\u5e94\u7528\u3002<\/p>\n<pre><code>from ollama import Client\r\nclient = Client(\r\nhost='http:\/\/localhost:11434',\r\nheaders={'x-some-header': 'some-value'}\r\n)\r\nresponse = client.chat(model='llama3.1', messages=[\r\n{\r\n'role': 'user',\r\n'content': '\u4e3a\u4ec0\u4e48\u5929\u7a7a\u662f\u84dd\u8272\u7684\uff1f',\r\n},\r\n])\r\nprint(response)\r\n<\/code><\/pre>\n<h3>\u5f02\u6b65\u5ba2\u6237\u7aef<\/h3>\n<p>\u8fd9\u6bb5\u4ee3\u7801\u4f7f\u7528\u4e86\u5f02\u6b65\u5ba2\u6237\u7aef\u00a0<code>(AsyncClient)<\/code>\u00a0\uff0c\u5e76\u4e14\u5b9a\u4e49\u4e86\u4e00\u4e2a\u5f02\u6b65\u51fd\u6570\u00a0<code>chat()<\/code>\u00a0\u3002\u901a\u8fc7await\u5173\u952e\u5b57\uff0c\u53ef\u4ee5\u6682\u505c\u8be5\u51fd\u6570\u7684\u6267\u884c\u76f4\u5230\u00a0<code>AsyncClient().chat()<\/code>\u00a0\u8bf7\u6c42\u5b8c\u6210\uff0c\u4f46\u5728\u6b64\u671f\u95f4\u4e0d\u4f1a\u963b\u585e\u5176\u4ed6\u64cd\u4f5c\u3002\u8fd9\u5bf9\u4e8e\u9700\u8981\u9ad8\u6548\u7387\u5904\u7406\u00a0<code>I\/O<\/code>\u00a0\u64cd\u4f5c\uff08\u5982\u7f51\u7edc\u8bf7\u6c42\uff09\u6216\u5e0c\u671b\u540c\u65f6\u6267\u884c\u591a\u4e2a\u4efb\u52a1\u7684\u5e94\u7528\u6765\u8bf4\u975e\u5e38\u6709\u7528\u3002\u6b64\u5916\uff0c\u4f7f\u7528\u00a0<code>asyncio.run(chat())<\/code>\u00a0\u6765\u8fd0\u884c\u8fd9\u4e2a\u5f02\u6b65\u51fd\u6570\u3002<\/p>\n<pre><code>import asyncio\r\nfrom ollama import AsyncClient\r\nimport nest_asyncio\r\nnest_asyncio.apply()\r\nasync def chat():\r\nmessage = {'role': 'user', 'content': '\u4e3a\u4ec0\u4e48\u5929\u7a7a\u662f\u84dd\u8272\u7684\uff1f'}\r\nresponse = await AsyncClient().chat(model='llama3.1', messages=[message])\r\nprint(response)\r\nasyncio.run(chat())\r\n<\/code><\/pre>\n<p>\u8bbe\u7f6e\u00a0<code>stream=True<\/code>\u00a0\u4fee\u6539\u51fd\u6570\u4ee5\u8fd4\u56de Python \u5f02\u6b65\u751f\u6210\u5668\uff1a<\/p>\n<pre><code>import asyncio\r\nfrom ollama import AsyncClient\r\nimport nest_asyncio\r\nnest_asyncio.apply()\r\nasync def chat():\r\nmessage = {'role': 'user', 'content': '\u4e3a\u4ec0\u4e48\u5929\u7a7a\u662f\u84dd\u8272\u7684\uff1f'}\r\nasync for part in await AsyncClient().chat(model='llama3.1', messages=[message], stream=True):\r\nprint(part['message']['content'], end='', flush=True)\r\nasyncio.run(chat())\r\n<\/code><\/pre>\n<h3>\u540c\u6b65 &amp; \u5f02\u6b65\u5ba2\u6237\u7aef\u4e0d\u540c\u8c03\u7528\u6b21\u6570\u8017\u65f6\u5bf9\u6bd4\u6d4b\u8bd5<\/h3>\n<p>\u4e0b\u9762\u7684\u8fd9\u6bb5\u4ee3\u7801\u5206\u522b\u8c03\u7528\u540c\u6b65\u548c\u5f02\u6b65\u5ba2\u6237\u7aef\u91cd\u590d\u00a0<code>test_num<\/code>\u00a0\u6b21\u95ee\u7b54\u8fc7\u7a0b\uff0c\u5bf9\u6bd4\u6240\u9700\u8981\u7684\u603b\u65f6\u95f4\u548c\u5355\u6b21\u65f6\u95f4\uff0c\u7528\u6237\u53ef\u4ee5\u66f4\u6539\u4ee5\u4e0b\u7684\u53c2\u6570\u8fdb\u884c\u6d4b\u8bd5\uff1a<\/p>\n<ul>\n<li>test_messages: \u6d4b\u8bd5\u6570\u636e<\/li>\n<li>test_num: \u6d4b\u8bd5\u6b21\u6570<\/li>\n<li>model_name: \u6d4b\u8bd5\u6a21\u578b<\/li>\n<\/ul>\n<pre><code>import time\r\nimport asyncio\r\nfrom ollama import Client, AsyncClient\r\nimport nest_asyncio\r\n# \u5e94\u7528nest_asyncio\u4ee5\u652f\u6301Jupyter\u4e2d\u7684\u5f02\u6b65\u64cd\u4f5c\r\nnest_asyncio.apply()\r\n# \u521d\u59cb\u5316\u5ba2\u6237\u7aef\r\nclient = Client(host='http:\/\/localhost:11434')\r\nasync_client = AsyncClient(host='http:\/\/localhost:11434')\r\n# \u540c\u6b65\u8bf7\u6c42\u5904\u7406\u51fd\u6570\r\ndef request_example(client, model_name, messages):\r\nstart_time = time.time()\r\ntry:\r\n# \u540c\u6b65\u8bf7\u6c42\u8fd4\u56de\r\nresponse = client.chat(model=model_name, messages=messages)\r\nexcept Exception as e:\r\nprint(f\"\u540c\u6b65\u8bf7\u6c42\u5931\u8d25: {e}\")\r\nresponse = None\r\nend_time = time.time()\r\nduration = end_time - start_time\r\nprint(f\"\u540c\u6b65\u8bf7\u6c42\u65f6\u95f4: {duration}\")\r\nreturn response, duration\r\n# \u5f02\u6b65\u8bf7\u6c42\u5904\u7406\u51fd\u6570\r\nasync def async_request_example(client, model_name, messages):\r\nstart_time = time.time()\r\ntry:\r\n# \u5f02\u6b65\u8bf7\u6c42\u8fd4\u56de\r\nresponse = await client.chat(model=model_name, messages=messages)\r\nexcept Exception as e:\r\nprint(f\"\u5f02\u6b65\u8bf7\u6c42\u5931\u8d25: {e}\")\r\nresponse = None\r\nend_time = time.time()\r\nduration = end_time - start_time\r\nprint(f\"\u5f02\u6b65\u8bf7\u6c42\u65f6\u95f4: {duration}\")\r\nreturn response, duration\r\n# \u5f02\u6b65\u8bf7\u6c42\u6d4b\u8bd5\u51fd\u6570\r\nasync def async_client_test(test_num, model_name, messages):\r\ntasks = [asyncio.create_task(async_request_example(async_client, model_name, messages)) \r\nfor _ in range(test_num)]\r\nresults= await asyncio.gather(*tasks)\r\nreturn results\r\n# \u8fd0\u884c\u540c\u6b65\u6d4b\u8bd5\r\ndef sync_test(model_name, messages, test_num):\r\ntotal_time = 0\r\nfor i in range(test_num):\r\n_, duration = request_example(client, model_name, messages)\r\ntotal_time += duration\r\nreturn total_time \/ test_num\r\n# \u8fd0\u884c\u5f02\u6b65\u6d4b\u8bd5\r\nasync def async_test(model_name, messages, test_num):\r\nstart_time = time.time()\r\nawait async_client_test(test_num, model_name, messages)\r\nend_time = time.time()\r\nreturn (end_time - start_time) \/ test_num\r\n# \u51c6\u5907\u6d4b\u8bd5\u6570\u636e\r\ntest_messages = [{'role': 'user', 'content': '\u4e3a\u4ec0\u4e48\u5929\u7a7a\u662f\u84dd\u8272\u7684\uff1f'}]\r\ntest_num = 10\r\nmodel_name = 'llama3.1'\r\n# \u8fd0\u884c\u540c\u6b65\u6d4b\u8bd5\u5e76\u8f93\u51fa\u7ed3\u679c\r\nprint(\"\u8fd0\u884c\u540c\u6b65\u6d4b\u8bd5\")\r\nsync_avg_time = sync_test(model_name, test_messages, test_num)\r\nprint(f\"\u540c\u6b65\u6d4b\u8bd5\u5e73\u5747\u65f6\u95f4: {sync_avg_time:.2f} \u79d2\")\r\n# \u8fd0\u884c\u5f02\u6b65\u6d4b\u8bd5\u5e76\u8f93\u51fa\u7ed3\u679c\r\nprint(\"\u8fd0\u884c\u5f02\u6b65\u6d4b\u8bd5\")\r\nasync_avg_time = asyncio.run(async_test(model_name, test_messages, test_num))\r\nprint(f\"\u5f02\u6b65\u6d4b\u8bd5\u5e73\u5747\u65f6\u95f4: {async_avg_time:.2f} \u79d2\")\r\n<\/code><\/pre>\n<p>&nbsp;<\/p>\n<h2>\u9519\u8bef<\/h2>\n<p>\u5982\u679c\u8bf7\u6c42\u8fd4\u56de\u9519\u8bef\u72b6\u6001\u6216\u5728\u6d41\u5f0f\u4f20\u8f93\u65f6\u68c0\u6d4b\u5230\u9519\u8bef\uff0c\u5219\u4f1a\u5f15\u53d1\u9519\u8bef\u3002<\/p>\n<pre><code>import ollama\r\nmodel = 'does-not-yet-exist'\r\ntry:\r\nollama.chat(model)\r\nexcept ollama.ResponseError as e:\r\nprint('\u9519\u8bef:', e.error)\r\nif e.status_code == 404:\r\nollama.pull(model)\r\n<\/code><\/pre>\n<p>&nbsp;<\/p>\n<p>\u53c2\u8003\u6587\u6863\uff1a<a href=\"https:\/\/github.com\/ollama\/ollama-python\">Ollama python<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u5728\u672c\u6587\u4e2d\uff0c\u6211\u4eec\u5c06\u7b80\u5355\u4ecb\u7ecd\u5982\u4f55\u5728 Python \u4e2d\u4f7f\u7528 Ollama API\u3002\u65e0\u8bba\u4f60\u662f\u60f3\u8fdb\u884c\u7b80\u5355\u7684\u804a\u5929\u5bf9\u8bdd\u3001\u4f7f\u7528\u6d41\u5f0f\u54cd\u5e94\u5904\u7406\u5927\u6570\u636e\u3001\u8fd8\u662f\u5e0c\u671b\u5728\u672c\u5730\u8fdb\u884c\u6a21\u578b\u7684\u521b\u5efa\u3001\u590d\u5236\u3001\u5220\u9664\u7b49\u64cd\u4f5c\uff0c\u672c\u6587\u90fd\u53ef\u4ee5\u4e3a\u4f60\u63d0\u4f9b\u6307\u5bfc\u3002\u6b64\u5916\uff0c\u6211\u4eec\u8fd8\u5c55\u793a\u4e86\u5982\u4f55\u4f7f\u7528\u81ea\u5b9a\u4e49\u5ba2\u6237\u7aef&#8230;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[182],"tags":[],"class_list":["post-28545","post","type-post","status-publish","format-standard","hentry","category-shicao"],"_links":{"self":[{"href":"https:\/\/www.kdjingpai.com\/de\/wp-json\/wp\/v2\/posts\/28545","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.kdjingpai.com\/de\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.kdjingpai.com\/de\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.kdjingpai.com\/de\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.kdjingpai.com\/de\/wp-json\/wp\/v2\/comments?post=28545"}],"version-history":[{"count":0,"href":"https:\/\/www.kdjingpai.com\/de\/wp-json\/wp\/v2\/posts\/28545\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.kdjingpai.com\/de\/wp-json\/wp\/v2\/media?parent=28545"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.kdjingpai.com\/de\/wp-json\/wp\/v2\/categories?post=28545"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.kdjingpai.com\/de\/wp-json\/wp\/v2\/tags?post=28545"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}