【GPT入门】第30课 langchain的自问自搜刮答复agent不同模型对比 ...

概要

利用自问自搜自答agent，对比不同模型的执行结果。
gpt4：很牛
gpt3.5: 有的标题会失败
通义千问：执行失败
智谱：执行失败
结论：不同模型的大脑的真的不一样
1. 代码

1. from langchain import hub
2. from langchain.agents import AgentExecutor, create_self_ask_with_search_agent
3. from langchain_community.tools.tavily_search import TavilyAnswer
4. from langchain_openai import ChatOpenAI
6. # 将初始化工具，让它提供答案而不是文档
7. tools = [TavilyAnswer(max_results=1, name="Intermediate Answer", description="Answer Search")]
9. # 初始化大模型
10. # llm = ChatOpenAI(temperature=0, model="gpt-3.5-turbo-0613")
11. import os
12. from langchain_community.chat_models import ChatTongyi
13. # llm = ChatTongyi(
14. #     model="qwen-max",
15. #     api_key=os.getenv("DASHSCOPE_API_KEY"),
16. #     base_url=os.getenv("DASHSCOPE_BASE_URL")
17. # )
19. from langchain_community.chat_models import ChatZhipuAI
20. llm = ChatZhipuAI(
21.     model="glm-4-flash",
22.     api_key=os.getenv("ZHIPUAI_API_KEY"),
23.     base_url=os.getenv("ZHIPUAI_BASE_URL")
24. )
25. # 获取使用提示 可以修改此提示
26. prompt = hub.pull("hwchase17/self-ask-with-search")
27. print(prompt.template)
28. # 使用搜索代理构建自助询问
29. agent = create_self_ask_with_search_agent(llm, tools, prompt)
31. # 通过传入代理和工具创建代理执行程序
32. agent_executor = AgentExecutor(agent=agent, tools=tools, verbose=True, handle_parsing_errors=True)
34. # 运行代理
35. res = agent_executor.invoke({"input": "中国有哪些省份呢?"})
36. print('res:',res)

复制代码

2 输出结果

用智谱和通义千问，执行都报错； 用GPT3.5 可以正常执行

1. Question: Who lived longer, Muhammad Ali or Alan Turing?
2. Are follow up questions needed here: Yes.
3. Follow up: How old was Muhammad Ali when he died?
4. Intermediate answer: Muhammad Ali was 74 years old when he died.
5. Follow up: How old was Alan Turing when he died?
6. Intermediate answer: Alan Turing was 41 years old when he died.
7. So the final answer is: Muhammad Ali
9. Question: When was the founder of craigslist born?
10. Are follow up questions needed here: Yes.
11. Follow up: Who was the founder of craigslist?
12. Intermediate answer: Craigslist was founded by Craig Newmark.
13. Follow up: When was Craig Newmark born?
14. Intermediate answer: Craig Newmark was born on December 6, 1952.
15. So the final answer is: December 6, 1952
17. Question: Who was the maternal grandfather of George Washington?
18. Are follow up questions needed here: Yes.
19. Follow up: Who was the mother of George Washington?
20. Intermediate answer: The mother of George Washington was Mary Ball Washington.
21. Follow up: Who was the father of Mary Ball Washington?
22. Intermediate answer: The father of Mary Ball Washington was Joseph Ball.
23. So the final answer is: Joseph Ball
25. Question: Are both the directors of Jaws and Casino Royale from the same country?
26. Are follow up questions needed here: Yes.
27. Follow up: Who is the director of Jaws?
28. Intermediate answer: The director of Jaws is Steven Spielberg.
29. Follow up: Where is Steven Spielberg from?
30. Intermediate answer: The United States.
31. Follow up: Who is the director of Casino Royale?
32. Intermediate answer: The director of Casino Royale is Martin Campbell.
33. Follow up: Where is Martin Campbell from?
34. Intermediate answer: New Zealand.
35. So the final answer is: No
37. Question: {input}
38. Are followup questions needed here:{agent_scratchpad}
41. > Entering new AgentExecutor chain...
42. Could not parse output: Yes, follow-up questions could be helpful to provide more detailed information about the provinces or to clarify specific aspects of Chinese provinces.
44. Follow-up questions might include:
45. - How many provinces are there in China?
46. - Are there any special administrative regions in China that are not provinces?
47. - Can you name some of the most populous provinces in China?
48. - What are the differences between a province and other administrative divisions in China?
49. - Are there any provinces that have unique cultural or historical significance in China?
50. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseCould not parse output: Intermediate answer:
51. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseCould not parse output: Apologies for the confusion. Let's address the questions one by one:
53. Question: 中国有哪些省份呢?
54. Intermediate answer:
55. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseCould not parse output: Certainly, here's the information you're seeking:
57. Question: 中国有哪些省份呢?
59. Final answer:
60. China is divided into 34 administrative divisions
61. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseCould not parse output: Final answer:
62. China is divided
63. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseCould not parse output: Final answer:
64. China is administratively divided into 23 provinces, 5 autonomous regions, 4 direct-controlled municipalities (Beijing, Tianjin, Shanghai, and Chongqing), and 2 special administrative regions (Hong Kong and Macau). Here are the provinces:
66. 1. Hebei Province
67. 2. Shanxi Province
68. 3. Inner Mongolia Autonomous Region
69. 4. Liaoning Province
70. 5. Jilin Province
71. 6. Heilongjiang Province
72. 7. Shanghai Municipality
73. 8. Jiangsu Province
74. 9. Zhejiang Province
75. 10. Anhui Province
76. 11. Fujian Province
77. 12. Jiangxi Province
78. 13. Shandong Province
79. 14. Henan Province
80. 15. Hubei Province
81. 16. Hunan Province
82. 17. Guangdong Province
83. 18. Guangxi Zhuang Autonomous Region
84. 19. Hainan Province
85. 20. Chongqing Municipality
86. 21. Sichuan Province
87. 22. Guizhou Province
88. 23. Yunnan Province
89. 24. Shaanxi Province
90. 25. Gansu Province
91. 26. Qinghai Province
92. 27. Ningxia Hui Autonomous Region
93. 28. Xinjiang Uyghur Autonomous Region
95. Please note that China also has a number of prefecture-level divisions, county-level divisions, and town-level divisions, but these are not considered provinces. If you have any specific follow-up questions or need further information, feel free to ask!
96. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseCould not parse output: Final answer:
97. China is divided into
98. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseTraceback (most recent call last):
99.   File "E:\workspace\gptLearning\gptLearning\ls10\agent\ls24_create_self_ask_with_search_agent.py", line 35, in <module>
100.     res = agent_executor.invoke({"input": "中国有哪些省份呢?"})

复制代码

把标题改为：世界上最美丽的人是谁， gpt3.5也宕机了，吐血

1. res = agent_executor.invoke({"input": "世界上最漂亮的人是谁?"})
2. print('res:',res)

复制代码

gpt3.5执行失败：

gpt4执行成功：

免责声明：如果侵犯了您的权益，请联系站长，我们会及时删除侵权内容，谢谢合作！更多信息从访问主页：qidao123.com:ToB企服之家，中国第一个企服评测及商务社交产业平台。