IT评测·应用市场-qidao123.com技术社区

标题: 【GPT入门】第30课 langchain的自问自搜刮答复agent不同模型对比 [打印本页]
作者: 小小小幸运    时间: 2025-4-4 04:07
标题: 【GPT入门】第30课 langchain的自问自搜刮答复agent不同模型对比
概要

利用自问自搜自答agent，对比不同模型的执行结果。
gpt4：很牛
gpt3.5: 有的标题会失败
通义千问：执行失败
智谱：执行失败
结论：不同模型的大脑的真的不一样
1. 代码

  1. from langchain import hub
  2. from langchain.agents import AgentExecutor, create_self_ask_with_search_agent
  3. from langchain_community.tools.tavily_search import TavilyAnswer
  4. from langchain_openai import ChatOpenAI
  6. # 将初始化工具，让它提供答案而不是文档
  7. tools = [TavilyAnswer(max_results=1, name="Intermediate Answer", description="Answer Search")]
  9. # 初始化大模型
  10. # llm = ChatOpenAI(temperature=0, model="gpt-3.5-turbo-0613")
  11. import os
  12. from langchain_community.chat_models import ChatTongyi
  13. # llm = ChatTongyi(
  14. #     model="qwen-max",
  15. #     api_key=os.getenv("DASHSCOPE_API_KEY"),
  16. #     base_url=os.getenv("DASHSCOPE_BASE_URL")
  17. # )
  19. from langchain_community.chat_models import ChatZhipuAI
  20. llm = ChatZhipuAI(
  21.     model="glm-4-flash",
  22.     api_key=os.getenv("ZHIPUAI_API_KEY"),
  23.     base_url=os.getenv("ZHIPUAI_BASE_URL")
  24. )
  25. # 获取使用提示 可以修改此提示
  26. prompt = hub.pull("hwchase17/self-ask-with-search")
  27. print(prompt.template)
  28. # 使用搜索代理构建自助询问
  29. agent = create_self_ask_with_search_agent(llm, tools, prompt)
  31. # 通过传入代理和工具创建代理执行程序
  32. agent_executor = AgentExecutor(agent=agent, tools=tools, verbose=True, handle_parsing_errors=True)
  34. # 运行代理
  35. res = agent_executor.invoke({"input": "中国有哪些省份呢?"})
  36. print('res:',res)
复制代码
2 输出结果

用智谱和通义千问，执行都报错； 用GPT3.5 可以正常执行
  1. Question: Who lived longer, Muhammad Ali or Alan Turing?
  2. Are follow up questions needed here: Yes.
  3. Follow up: How old was Muhammad Ali when he died?
  4. Intermediate answer: Muhammad Ali was 74 years old when he died.
  5. Follow up: How old was Alan Turing when he died?
  6. Intermediate answer: Alan Turing was 41 years old when he died.
  7. So the final answer is: Muhammad Ali
  9. Question: When was the founder of craigslist born?
  10. Are follow up questions needed here: Yes.
  11. Follow up: Who was the founder of craigslist?
  12. Intermediate answer: Craigslist was founded by Craig Newmark.
  13. Follow up: When was Craig Newmark born?
  14. Intermediate answer: Craig Newmark was born on December 6, 1952.
  15. So the final answer is: December 6, 1952
  17. Question: Who was the maternal grandfather of George Washington?
  18. Are follow up questions needed here: Yes.
  19. Follow up: Who was the mother of George Washington?
  20. Intermediate answer: The mother of George Washington was Mary Ball Washington.
  21. Follow up: Who was the father of Mary Ball Washington?
  22. Intermediate answer: The father of Mary Ball Washington was Joseph Ball.
  23. So the final answer is: Joseph Ball
  25. Question: Are both the directors of Jaws and Casino Royale from the same country?
  26. Are follow up questions needed here: Yes.
  27. Follow up: Who is the director of Jaws?
  28. Intermediate answer: The director of Jaws is Steven Spielberg.
  29. Follow up: Where is Steven Spielberg from?
  30. Intermediate answer: The United States.
  31. Follow up: Who is the director of Casino Royale?
  32. Intermediate answer: The director of Casino Royale is Martin Campbell.
  33. Follow up: Where is Martin Campbell from?
  34. Intermediate answer: New Zealand.
  35. So the final answer is: No
  37. Question: {input}
  38. Are followup questions needed here:{agent_scratchpad}
  41. > Entering new AgentExecutor chain...
  42. Could not parse output: Yes, follow-up questions could be helpful to provide more detailed information about the provinces or to clarify specific aspects of Chinese provinces.
  44. Follow-up questions might include:
  45. - How many provinces are there in China?
  46. - Are there any special administrative regions in China that are not provinces?
  47. - Can you name some of the most populous provinces in China?
  48. - What are the differences between a province and other administrative divisions in China?
  49. - Are there any provinces that have unique cultural or historical significance in China?
  50. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseCould not parse output: Intermediate answer:
  51. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseCould not parse output: Apologies for the confusion. Let's address the questions one by one:
  53. Question: 中国有哪些省份呢?
  54. Intermediate answer:
  55. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseCould not parse output: Certainly, here's the information you're seeking:
  57. Question: 中国有哪些省份呢?
  59. Final answer:
  60. China is divided into 34 administrative divisions
  61. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseCould not parse output: Final answer:
  62. China is divided
  63. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseCould not parse output: Final answer:
  64. China is administratively divided into 23 provinces, 5 autonomous regions, 4 direct-controlled municipalities (Beijing, Tianjin, Shanghai, and Chongqing), and 2 special administrative regions (Hong Kong and Macau). Here are the provinces:
  66. 1. Hebei Province
  67. 2. Shanxi Province
  68. 3. Inner Mongolia Autonomous Region
  69. 4. Liaoning Province
  70. 5. Jilin Province
  71. 6. Heilongjiang Province
  72. 7. Shanghai Municipality
  73. 8. Jiangsu Province
  74. 9. Zhejiang Province
  75. 10. Anhui Province
  76. 11. Fujian Province
  77. 12. Jiangxi Province
  78. 13. Shandong Province
  79. 14. Henan Province
  80. 15. Hubei Province
  81. 16. Hunan Province
  82. 17. Guangdong Province
  83. 18. Guangxi Zhuang Autonomous Region
  84. 19. Hainan Province
  85. 20. Chongqing Municipality
  86. 21. Sichuan Province
  87. 22. Guizhou Province
  88. 23. Yunnan Province
  89. 24. Shaanxi Province
  90. 25. Gansu Province
  91. 26. Qinghai Province
  92. 27. Ningxia Hui Autonomous Region
  93. 28. Xinjiang Uyghur Autonomous Region
  95. Please note that China also has a number of prefecture-level divisions, county-level divisions, and town-level divisions, but these are not considered provinces. If you have any specific follow-up questions or need further information, feel free to ask!
  96. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseCould not parse output: Final answer:
  97. China is divided into
  98. For troubleshooting, visit: https://python.langchain.com/docs/troubleshooting/errors/OUTPUT_PARSING_FAILURE Invalid or incomplete responseTraceback (most recent call last):
  99.   File "E:\workspace\gptLearning\gptLearning\ls10\agent\ls24_create_self_ask_with_search_agent.py", line 35, in <module>
  100.     res = agent_executor.invoke({"input": "中国有哪些省份呢?"})
复制代码
把标题改为：世界上最美丽的人是谁， gpt3.5也宕机了，吐血
  1. res = agent_executor.invoke({"input": "世界上最漂亮的人是谁?"})
  2. print('res:',res)
复制代码
gpt3.5执行失败：

gpt4执行成功：


免责声明：如果侵犯了您的权益，请联系站长，我们会及时删除侵权内容，谢谢合作！更多信息从访问主页：qidao123.com:ToB企服之家，中国第一个企服评测及商务社交产业平台。



欢迎光临 IT评测·应用市场-qidao123.com技术社区 (https://dis.qidao123.com/) Powered by Discuz! X3.4