{"id":1418,"date":"2024-05-10T19:32:27","date_gmt":"2024-05-10T19:32:27","guid":{"rendered":"https:\/\/www.nicekj.com\/?p=1418"},"modified":"2024-05-10T19:32:27","modified_gmt":"2024-05-10T19:32:27","slug":"langchainzhongdechat-modelsjieshaoheshiyong","status":"publish","type":"post","link":"https:\/\/www.nicekj.com\/langchainzhongdechat-modelsjieshaoheshiyong.html","title":{"rendered":"langchain\u4e2d\u7684chat models\u4ecb\u7ecd\u548c\u4f7f\u7528"},"content":{"rendered":"

\u7b80\u4ecb<\/h1>\n

\u4e4b\u524d\u6211\u4eec\u4ecb\u7ecd\u4e86LLM\u6a21\u5f0f\uff0c\u8fd9\u79cd\u6a21\u5f0f\u662f\u5c31\u662f\u6587\u672c\u8f93\u5165\uff0c\u7136\u540e\u6587\u672c\u8f93\u51fa\u3002<\/p>\n

chat models\u662f\u57fa\u4e8eLLM\u6a21\u5f0f\u7684\u66f4\u52a0\u9ad8\u7ea7\u7684\u6a21\u5f0f\u3002\u4ed6\u7684\u8f93\u5165\u548c\u8f93\u51fa\u662f\u683c\u5f0f\u5316\u7684chat messages\u3002<\/p>\n

\u4e00\u8d77\u6765\u770b\u770b\u5982\u4f55\u5728langchain\u4e2d\u4f7f\u7528caht models\u5427\u3002<\/p>\n

chat models\u7684\u4f7f\u7528<\/h1>\n

\u9996\u5148langchain\u5bf9chat models\u4e0b\u652f\u6301\u7684\u6a21\u578b\u5c31\u5c11\u5f88\u591a\u4e86\u3002\u4e00\u65b9\u9762\u662f\u53ef\u80fd\u6709\u4e9b\u8bed\u8a00\u6a21\u578b\u672c\u8eab\u662f\u4e0d\u652f\u6301chat models\u7684\u3002\u53e6\u5916\u4e00\u65b9\u9762langchain\u4e5f\u8fd8\u662f\u5728\u4e00\u4e2a\u53d1\u5c55\u4e2d\u7684\u8fc7\u7a0b\uff0c\u6240\u4ee5\u6709\u4e9b\u6a21\u578b\u8fd8\u9700\u8981\u9002\u914d\u3002<\/p>\n

\u76ee\u524d\u770b\u6765langchain\u652f\u6301\u7684chat models\u6709\uff1aChatAnthropic,AzureChatOpenAI,ChatVertexAI,JinaChat,ChatOpenAI\u548cPromptLayerChatOpenAI\u8fd9\u51e0\u79cd\u3002<\/p>\n

langchain\u628achat\u6d88\u606f\u5206\u6210\u4e86\u8fd9\u51e0\u79cd\uff1aAIMessage, HumanMessage, SystemMessage \u548c ChatMessage\u3002<\/p>\n

HumanMessage\u5c31\u662f\u7528\u6237\u8f93\u5165\u7684\u6d88\u606f\uff0cAIMessage\u662f\u5927\u8bed\u8a00\u6a21\u578b\u7684\u6d88\u606f\uff0cSystemMessage\u662f\u7cfb\u7edf\u7684\u6d88\u606f\u3002ChatMessage\u662f\u4e00\u79cd\u53ef\u4ee5\u81ea\u5b9a\u4e49\u7c7b\u578b\u7684\u6d88\u606f\u3002<\/p>\n

\u5728\u4f7f\u7528\u7684\u65f6\u5019\uff0c\u53ea\u9700\u8981\u5728chat\u4e2d\u4f20\u5165\u5bf9\u5e94\u7684\u6d88\u606f\u5373\u53ef\uff1a<\/p>\n

<\/div>
scss<\/span>
\u590d\u5236\u4ee3\u7801<\/div><\/div><\/div>from langchain.chat_models<\/span> import ChatOpenAI<\/span>\n<\/span>\nchat = ChatOpenAI<\/span>()<\/span>\n<\/span>\nmessages = [    SystemMessage(content=\"\u4f60\u662f\u4e00\u4e2a\u5c0f\u8bf4\u5bb6\"<\/span>),    HumanMessage(content=\"\u5e2e\u6211\u5199\u7bc7\u5c0f\u8bf4\"<\/span>)]<\/span><\/span>\nchat<\/span>(messages)<\/span>\n<\/code><\/pre>\n
\u5f53\u7136\u548cLLM\u4e00\u6837\uff0c\u4f60\u4e5f\u53ef\u4ee5\u4f7f\u7528\u6279\u91cf\u6a21\u5f0f\u5982\u4e0b\uff1a<\/p>\n
<\/div>
ini<\/span>
\u590d\u5236\u4ee3\u7801<\/div><\/div><\/div>batch_messages<\/span> = [<\/span>\n    [<\/span>\n        SystemMessage(content=\"\u4f60\u662f\u4e00\u4e2a\u5c0f\u8bf4\u5bb6\"<\/span>),<\/span>\n        HumanMessage(content=\"\u5e2e\u6211\u5199\u7bc7\u5c0f\u8bf4\"<\/span>)<\/span>\n    ],<\/span>\n    [<\/span>\n        SystemMessage(content=\"\u4f60\u662f\u4e00\u4e2a\u8bd7\u4eba\"<\/span>),<\/span>\n        HumanMessage(content=\"\u5e2e\u6211\u5199\u9996\u8bd7\"<\/span>)<\/span>\n    ],<\/span>\n]<\/span>\nresult<\/span> = chat.generate(batch_messages)<\/span>\nresult<\/span>\n<\/code><\/pre>\n
chat models\u7684\u9ad8\u7ea7\u529f\u80fd<\/h1>\n
\u5176\u5b9e\u548cLLM\u7c7b\u4f3c\uff0c\u57fa\u672c\u4e0aLLM\u6709\u7684\u9ad8\u7ea7\u529f\u80fdchat models\u90fd\u6709\u3002<\/p>\n
\u6bd4\u5982\u6709\u7528\u7684\u6bd4\u5982\u7f13\u5b58\u529f\u80fd\uff0c\u53ef\u4ee5\u7f13\u5b58\u4e4b\u524d\u7684\u8f93\u5165\u548c\u8f93\u51fa\uff0c\u907f\u514d\u6bcf\u6b21\u90fd\u8c03\u7528LLM\uff0c\u4ece\u800c\u53ef\u4ee5\u51cf\u5c11token\u7684\u5f00\u9500\u3002<\/p>\n
\u4ee5InMemoryCache\u4e3a\u4f8b\u5b50\uff1a<\/p>\n
<\/div>
python<\/span>
\u590d\u5236\u4ee3\u7801<\/div><\/div><\/div>from<\/span> langchain.cache import<\/span> InMemoryCache<\/span>\nlangchain.llm_cache = InMemoryCache()<\/span>\n<\/span>\n# \u7b2c\u4e00\u6b21\u8c03\u7528\uff0c\u4e0d\u662f\u7528cache<\/span><\/span>\nllm.predict(\"Tell me a joke\"<\/span>)<\/span>\n<\/span>\n# \u7b2c\u4e8c\u6b21\u8c03\u7528\uff0c\u4f7f\u7528cache<\/span><\/span>\nllm.predict(\"Tell me a joke\"<\/span>)<\/span>\n<\/code><\/pre>\n
\u9664\u4e86InMemoryCache,langchain\u8fd8\u652f\u6301FullLLMCache,SQLAlchemyCache,SQLiteCache\u548cRedisCache\u7b49\u7b49\u3002<\/p>\n
\u540c\u6837\u7684\uff0cchat models\u4e5f\u662f\u652f\u6301\u6d41\u6a21\u5f0f\u7684\uff1a<\/p>\n
<\/div>
python<\/span>
\u590d\u5236\u4ee3\u7801<\/div><\/div><\/div>from<\/span> langchain.chat_models import<\/span> ChatOpenAI<\/span>\nfrom<\/span> langchain.schema import<\/span> (<\/span>\n    HumanMessage,<\/span>\n)<\/span>\n<\/span>\nfrom<\/span> langchain.callbacks.streaming_stdout import<\/span> StreamingStdOutCallbackHandler<\/span>\nchat = ChatOpenAI(streaming=True<\/span>, callbacks=[StreamingStdOutCallbackHandler()], temperature=0<\/span>)<\/span>\nresp = chat([HumanMessage(content=\"\u5e2e\u5fd9\u6211\u5199\u9996\u8bd7\"<\/span>)])<\/span>\n<\/code><\/pre>\n
\u53ea\u9700\u8981\u5728\u6784\u5efaChatOpenAI\u7684\u65f6\u5019\uff0c\u628aStreamingStdOutCallbackHandler\u4f20\u5165callbacks\u5373\u53ef\u3002<\/p>\n
\u5982\u679c\u8981\u5728chat models\u4e2d\u4f7f\u7528PromptTemplate\uff0c\u56e0\u4e3achat models\u7684\u6d88\u606f\u683c\u5f0f\u8ddfLLM\u662f\u4e0d\u4e00\u6837\u7684\uff0c\u6240\u4ee5\u5bf9\u5e94\u7684PromptTemplate\u4e5f\u662f\u4e0d\u4e00\u6837\u7684\u3002<\/p>\n
\u548c\u5bf9\u5e94\u7684chat models\u6d88\u606f\u5bf9\u5e94\u7684PromptTemplate\u662fChatPromptTemplate,SystemMessagePromptTemplate,
\nAIMessagePromptTemplate\u548cHumanMessagePromptTemplate\u3002<\/p>\n
\u6211\u4eec\u770b\u4e0b\u662f\u5982\u4f55\u4f7f\u7528prompt template\u6765\u6784\u5efaprompt:<\/p>\n
<\/div>
ini<\/span>
\u590d\u5236\u4ee3\u7801<\/div><\/div><\/div>from langchain import PromptTemplate<\/span>\nfrom langchain.prompts.chat import (<\/span>\n    ChatPromptTemplate,<\/span>\n    SystemMessagePromptTemplate,<\/span>\n    AIMessagePromptTemplate,<\/span>\n    HumanMessagePromptTemplate,<\/span>\n)<\/span>\n<\/span>\n# \u6784\u5efa\u5404\u79cdprompt<\/span><\/span>\ntemplate<\/span>=\"You are a helpful assistant that translates {input_language} to {output_language}.\"<\/span><\/span>\nsystem_message_prompt<\/span> = SystemMessagePromptTemplate.from_template(template)<\/span>\nhuman_template<\/span>=\"{text}\"<\/span><\/span>\nhuman_message_prompt<\/span> = HumanMessagePromptTemplate.from_template(human_template)<\/span>\n<\/span>\nchat_prompt<\/span> = ChatPromptTemplate.from_messages([system_message_prompt, human_message_prompt])<\/span>\n<\/span>\n# \u4f7f\u7528format_prompt\u628aprompt\u4f20\u7ed9chat<\/span><\/span>\nchat(chat_prompt.format_prompt(input_language<\/span>=\"English\"<\/span>, output_language=\"French\"<\/span>, text=\"I love programming.\"<\/span>).to_messages())<\/span>\n<\/code><\/pre>\n
chat models\u4e0b\u6d88\u606f\u6784\u5efa\u786e\u5b9e\u6bd4\u76f4\u63a5\u4f7f\u7528LLM\u8981\u590d\u6742\u70b9\uff0c\u5927\u5bb6\u5728\u4f7f\u7528\u7684\u65f6\u5019\u9700\u8981\u6ce8\u610f\u3002<\/p>\n
\u603b\u7ed3<\/h1>\n
chat models\u662fLLM\u7684\u9ad8\u9636\u8868\u73b0\u5f62\u5f0f\u3002\u5982\u679c\u6211\u4eec\u9700\u8981\u8fdb\u884c\u5bf9\u8bdd\u6a21\u578b\u7684\u8bdd\uff0c\u5c31\u53ef\u4ee5\u8003\u8651\u4f7f\u7528\u8fd9\u4e2a\u3002<\/p>\n
\n
\u66f4\u591a\u5185\u5bb9\u8bf7\u53c2\u8003 www.flydean.com<\/a><\/p>\n
\u6700\u901a\u4fd7\u7684\u89e3\u8bfb\uff0c\u6700\u6df1\u523b\u7684\u5e72\u8d27\uff0c\u6700\u7b80\u6d01\u7684\u6559\u7a0b\uff0c\u4f17\u591a\u4f60\u4e0d\u77e5\u9053\u7684\u5c0f\u6280\u5de7\u7b49\u4f60\u6765\u53d1\u73b0\uff01<\/p>\n
\u6b22\u8fce\u5173\u6ce8\u6211\u7684\u516c\u4f17\u53f7:\u300c\u7a0b\u5e8f\u90a3\u4e9b\u4e8b\u300d,\u61c2\u6280\u672f\uff0c\u66f4\u61c2\u4f60\uff01<\/p>\n<\/blockquote>\n","protected":false},"excerpt":{"rendered":"
\u4e4b\u524d\u6211\u4eec\u4ecb\u7ecd\u4e86LLM\u6a21\u5f0f\uff0c\u8fd9\u79cd\u6a21\u5f0f\u662f\u5c31\u662f\u6587\u672c\u8f93\u5165\uff0c\u7136\u540e\u6587\u672c\u8f93\u51fa\u3002 chat models\u662f\u57fa\u4e8eLLM\u6a21\u5f0f\u7684\u66f4\u52a0\u9ad8\u7ea7\u7684\u6a21\u5f0f\u3002\u4ed6\u7684\u8f93\u5165\u548c\u8f93\u51fa\u662f\u683c\u5f0f\u5316\u7684chat messages\u3002 \u4e00\u8d77\u6765\u770b\u770b\u5982\u4f55\u5728l<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"rank_math_title":"","rank_math_description":"","rank_math_focus_keyword":"","views":"1","footnotes":""},"categories":[3],"tags":[126,127,128,129,136],"collection":[],"class_list":["post-1418","post","type-post","status-publish","format-standard","hentry","category-fenlei2","tag-gpt","tag-ai","tag-128","tag-129","tag-136"],"acf":[],"_links":{"self":[{"href":"https:\/\/www.nicekj.com\/nicekj2024\/wp\/v2\/posts\/1418","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nicekj.com\/nicekj2024\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.nicekj.com\/nicekj2024\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.nicekj.com\/nicekj2024\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.nicekj.com\/nicekj2024\/wp\/v2\/comments?post=1418"}],"version-history":[{"count":0,"href":"https:\/\/www.nicekj.com\/nicekj2024\/wp\/v2\/posts\/1418\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.nicekj.com\/nicekj2024\/wp\/v2\/media?parent=1418"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nicekj.com\/nicekj2024\/wp\/v2\/categories?post=1418"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.nicekj.com\/nicekj2024\/wp\/v2\/tags?post=1418"},{"taxonomy":"collection","embeddable":true,"href":"https:\/\/www.nicekj.com\/nicekj2024\/wp\/v2\/collection?post=1418"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}