ToB企服应用市场:ToB评测及商务社交产业平台

标题: Open WebUI – 当地化摆设大模子仿照 ChatGPT用户界面 [打印本页]
作者: 北冰洋以北    时间: 2024-12-25 07:36
标题: Open WebUI – 当地化摆设大模子仿照 ChatGPT用户界面
Open WebUI介绍：

Open WebUI 是一个仿照 ChatGPT 界面，为当地大语言模子提供图形化界面的开源项目，可以非常方便的调试、调用当地模子。你能用它毗连你在当地的大语言模子（包括 Ollama 和 OpenAI 兼容的 API），也支持远程服务器。Docker 摆设简单，功能非常丰富，包括代码高亮、数学公式、网页浏览、预设提示词、当地 RAG 集成、对话标记、下载模子、谈天记录、语音支持等。
官网地址：https://openwebui.com
GitHub：GitHub - open-webui/open-webui: User-friendly WebUI for LLMs (Formerly Ollama WebUI)

功能：
?? 直观界面：我们的谈天界面深受ChatGPT启发，旨在确保用户获得友爱易用的体验。
?? 相应式计划：无论是在桌面电脑还是移动设备上，都能享受一致而流畅的用户体验。
迅捷相应速度：畅享快速且高效的相应性能。
?? 轻松启动：接纳Docker或Kubernetes（通过kubectl、kustomize或helm工具）实现无缝安装，带给您无烦恼的初始化体验。
代码语法高亮显示：得益于我们的语法高亮功能，您可以享受到更为清晰易读的代码展示效果。
数字化写作 全面支持Markdown和LaTeX：借助全面集成的Markdown和LaTeX功能，全面提拔您的LLM互动体验。
?? 当地RAG集成：步入未来谈天交互的新篇章，我们内建了Retrieval Augmented Generation（RAG）支持，让您可以或许将文档操作无缝融合进谈天流程。只需简单地将文档载入谈天或添加文件至文档库，然后通过#命令即可轻松访问文档内容。此功能如今尚处于alpha测试阶段，我们正不停改进和完满，以确保其稳定性和性能体现到达最优。
总结一下，重点理解为如下三点：

Q：关于Open WebUI的安全性，尤其是第一次使用还需要注册，注册信息到哪里去了？
open-webui是一个用于构建Web用户界面的开源库，它通常不直接处置处罚数据传输，而是作为前端框架与后端服务器之间的中介。
第一次使用注册信息，是要求您注册成为管理员用户。这确保了如果Open WebUI被外部访问，您的数据仍然是安全的。
需要留意的是，所有东西都是当地的。我们不网络您的数据。当您注册时，所有信息都会留在您的服务器中，永远不会脱离您的设备。
您的隐私和安全是我们的重要任务，确保您的数据始终处于您的控制之下。
参考：?? FAQ | Open WebUI
Q: Why am I asked to sign up Where are my data being sent to
A: We require you to sign up to become the admin user for enhanced security. This ensures that if the Open WebUI is ever exposed to external access, your data remains secure. It’s important to note that everything is kept local. We do not collect your data. When you sign up, all information stays within your server and never leaves your device. Your privacy and security are our top priorities, ensuring that your data remains under your control at all times.

Open WebUI安装：

如今我只在linux环境下，做了安装实践， 在安装过程中，我重点参考了csdn上的这篇文章：
linux环境安装参考： ollama+open-webui，当地摆设本身的大模子
操作步骤很具体，包括安装过程中遇到的报错标题，基本上都可以按照文章中的步骤，逐步执行办理。
还有一篇文章，写的也很具体，如果是windows下安装，建议参考下：
windows环境安装参考：本机摆设大语言模子：Ollama和OpenWebUI实现各大模子的人工智能自由
另外，我使用的centos系统，在安装过程中遇到如下错误：
(open-webui) [root@master open-webui]# npm i
node: /lib64/libm.so.6: version `GLIBC_2.27’ not found (required by node)
node: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.20’ not found (required by node)
node: /lib64/libstdc++.so.6: version `CXXABI_1.3.9’ not found (required by node)
node: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.21’ not found (required by node)
node: /lib64/libc.so.6: version `GLIBC_2.28’ not found (required by node)
node: /lib64/libc.so.6: version `GLIBC_2.25’ not found (required by node)
办理办法：node: /lib64/libm.so.6: version `GLIBC_2.27‘ not found标题办理方案_libm.so.6 glibc2.27-CSDN博客
另外，open-webui安装过程中，需要毗连’https://huggingface.co’ 网站，会报错无法毗连。
我通过简单设置环境变量办理：export HF_ENDPOINT=HF-Mirror
下面给出了我在conda假造环境创建完后，并且npm也安装ok后，open-webui的安装执行过程快照，仅供参考：
  1. (base) [root@master backend]# conda activate open-webui
  2. (open-webui) [root@master backend]# bash start.sh
  3. No WEBUI_SECRET_KEY provided
  4. Loading WEBUI_SECRET_KEY from .webui_secret_key
  5. USER_AGENT environment variable not set, consider setting it to identify your requests.
  6. No sentence-transformers model found with name sentence-transformers/all-MiniLM-L6-v2. Creating a new one with mean pooling.
  7. Traceback (most recent call last):
  8.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connection.py", line 196, in _new_conn
  9.     sock = connection.create_connection(
  10.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/util/connection.py", line 85, in create_connection
  11.     raise err
  12.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/util/connection.py", line 73, in create_connection
  13.     sock.connect(sa)
  14. OSError: [Errno 101] Network is unreachable
  16. The above exception was the direct cause of the following exception:
  18. Traceback (most recent call last):
  19.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connectionpool.py", line 789, in urlopen
  20.     response = self._make_request(
  21.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connectionpool.py", line 490, in _make_request
  22.     raise new_e
  23.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connectionpool.py", line 466, in _make_request
  24.     self._validate_conn(conn)
  25.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connectionpool.py", line 1095, in _validate_conn
  26.     conn.connect()
  27.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connection.py", line 615, in connect
  28.     self.sock = sock = self._new_conn()
  29.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connection.py", line 211, in _new_conn
  30.     raise NewConnectionError(
  31. urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f8572048eb0>: Failed to establish a new connection: [Errno 101] Network is unreachable
  33. The above exception was the direct cause of the following exception:
  35. Traceback (most recent call last):
  36.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/requests/adapters.py", line 667, in send
  37.     resp = conn.urlopen(
  38.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connectionpool.py", line 843, in urlopen
  39.     retries = retries.increment(
  40.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/util/retry.py", line 519, in increment
  41.     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
  42. urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /sentence-transformers/all-MiniLM-L6-v2/resolve/main/config.json (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f8572048eb0>: Failed to establish a new connection: [Errno 101] Network is unreachable'))
  44. During handling of the above exception, another exception occurred:
  46. Traceback (most recent call last):
  47.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 1722, in _get_metadata_or_catch_error
  48.     metadata = get_hf_file_metadata(url=url, proxies=proxies, timeout=etag_timeout, headers=headers)
  49.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
  50.     return fn(*args, **kwargs)
  51.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 1645, in get_hf_file_metadata
  52.     r = _request_wrapper(
  53.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 372, in _request_wrapper
  54.     response = _request_wrapper(
  55.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 395, in _request_wrapper
  56.     response = get_session().request(method=method, url=url, **params)
  57.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/requests/sessions.py", line 589, in request
  58.     resp = self.send(prep, **send_kwargs)
  59.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/requests/sessions.py", line 703, in send
  60.     r = adapter.send(request, **kwargs)
  61.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/utils/_http.py", line 66, in send
  62.     return super().send(request, *args, **kwargs)
  63.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/requests/adapters.py", line 700, in send
  64.     raise ConnectionError(e, request=request)
  65. requests.exceptions.ConnectionError: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /sentence-transformers/all-MiniLM-L6-v2/resolve/main/config.json (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f8572048eb0>: Failed to establish a new connection: [Errno 101] Network is unreachable'))"), '(Request ID: 430abcfa-0ffb-419d-a853-40caed43b5c8)')
  67. The above exception was the direct cause of the following exception:
  69. Traceback (most recent call last):
  70.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/transformers/utils/hub.py", line 399, in cached_file
  71.     resolved_file = hf_hub_download(
  72.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
  73.     return fn(*args, **kwargs)
  74.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 1221, in hf_hub_download
  75.     return _hf_hub_download_to_cache_dir(
  76.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 1325, in _hf_hub_download_to_cache_dir
  77.     _raise_on_head_call_error(head_call_error, force_download, local_files_only)
  78.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 1826, in _raise_on_head_call_error
  79.     raise LocalEntryNotFoundError(
  80. huggingface_hub.utils._errors.LocalEntryNotFoundError: An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.
  82. The above exception was the direct cause of the following exception:
  84. Traceback (most recent call last):
  85.   File "/root/miniconda3/envs/open-webui/bin/uvicorn", line 8, in <module>
  86.     sys.exit(main())
  87.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/click/core.py", line 1157, in __call__
  88.     return self.main(*args, **kwargs)
  89.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/click/core.py", line 1078, in main
  90.     rv = self.invoke(ctx)
  91.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/click/core.py", line 1434, in invoke
  92.     return ctx.invoke(self.callback, **ctx.params)
  93.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/click/core.py", line 783, in invoke
  94.     return __callback(*args, **kwargs)
  95.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/main.py", line 410, in main
  96.     run(
  97.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/main.py", line 577, in run
  98.     server.run()
  99.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/server.py", line 65, in run
  100.     return asyncio.run(self.serve(sockets=sockets))
  101.   File "/root/miniconda3/envs/open-webui/lib/python3.8/asyncio/runners.py", line 44, in run
  102.     return loop.run_until_complete(main)
  103.   File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
  104.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/server.py", line 69, in serve
  105.     await self._serve(sockets)
  106.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/server.py", line 76, in _serve
  107.     config.load()
  108.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/config.py", line 434, in load
  109.     self.loaded_app = import_from_string(self.app)
  110.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/importer.py", line 19, in import_from_string
  111.     module = importlib.import_module(module_str)
  112.   File "/root/miniconda3/envs/open-webui/lib/python3.8/importlib/__init__.py", line 127, in import_module
  113.     return _bootstrap._gcd_import(name[level:], package, level)
  114.   File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
  115.   File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  116.   File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
  117.   File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
  118.   File "<frozen importlib._bootstrap_external>", line 843, in exec_module
  119.   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  120.   File "/root/open-webui/backend/main.py", line 25, in <module>
  121.     from apps.rag.main import app as rag_app
  122.   File "/root/open-webui/backend/apps/rag/main.py", line 85, in <module>
  123.     embedding_functions.SentenceTransformerEmbeddingFunction(
  124.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/chromadb/utils/embedding_functions.py", line 83, in __init__
  125.     self.models[model_name] = SentenceTransformer(
  126.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/sentence_transformers/SentenceTransformer.py", line 299, in __init__
  127.     modules = self._load_auto_model(
  128.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/sentence_transformers/SentenceTransformer.py", line 1324, in _load_auto_model
  129.     transformer_model = Transformer(
  130.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/sentence_transformers/models/Transformer.py", line 53, in __init__
  131.     config = AutoConfig.from_pretrained(model_name_or_path, **config_args, cache_dir=cache_dir)
  132.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/transformers/models/auto/configuration_auto.py", line 934, in from_pretrained
  133.     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
  134.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/transformers/configuration_utils.py", line 632, in get_config_dict
  135.     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
  136.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/transformers/configuration_utils.py", line 689, in _get_config_dict
  137.     resolved_config_file = cached_file(
  138.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/transformers/utils/hub.py", line 442, in cached_file
  139.     raise EnvironmentError(
  140. OSError: We couldn't connect to 'https://huggingface.co' to load this file, couldn't find it in the cached files and it looks like sentence-transformers/all-MiniLM-L6-v2 is not the path to a directory containing a file named config.json.
  141. Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/transformers/installation#offline-mode'.
  143. (open-webui) [root@master backend]# export HF_ENDPOINT=https://hf-mirror.com
  144. (open-webui) [root@master backend]# bash start.sh
  145. No WEBUI_SECRET_KEY provided
  146. Loading WEBUI_SECRET_KEY from .webui_secret_key
  147. USER_AGENT environment variable not set, consider setting it to identify your requests.
  148. modules.json: 100%|██████████████████████████████████████████████████████████████████████████████████████| 349/349 [00:00<00:00, 95.8kB/s]
  149. config_sentence_transformers.json: 100%|█████████████████████████████████████████████████████████████████| 116/116 [00:00<00:00, 25.3kB/s]
  150. README.md: 10.7kB [00:00, 19.1MB/s]
  151. sentence_bert_config.json: 100%|███████████████████████████████████████████████████████████████████████| 53.0/53.0 [00:00<00:00, 25.2kB/s]
  152. config.json: 612B [00:00, 283kB/s]                                                                                                        
  153. model.safetensors: 100%|█████████████████████████████████████████████████████████████████████████████| 90.9M/90.9M [00:16<00:00, 5.67MB/s]
  154. tokenizer_config.json: 100%|█████████████████████████████████████████████████████████████████████████████| 350/350 [00:00<00:00, 71.3kB/s]
  155. vocab.txt: 210kB [00:17, 30.4kB/s]Error while downloading from https://hf-mirror.com/sentence-transformers/all-MiniLM-L6-v2/resolve/main/vocab.txt: HTTPSConnectionPool(host='hf-mirror.com', port=443): Read timed out.
  156. Trying to resume download...
  157. vocab.txt: 232kB [00:00, 24.2MB/s]
  158. vocab.txt: 214kB [00:29, 7.34kB/s]
  159. tokenizer.json: 466kB [00:03, 155kB/s]
  160. special_tokens_map.json: 100%|███████████████████████████████████████████████████████████████████████████| 112/112 [00:00<00:00, 50.8kB/s]
  161. 1_Pooling/config.json: 100%|█████████████████████████████████████████████████████████████████████████████| 190/190 [00:00<00:00, 32.2kB/s]
  162. INFO:     Started server process [71959]
  163. INFO:     Waiting for application startup.
  164. Intialized router with Routing strategy: simple-shuffle
  166. Routing fallbacks: None
  168. Routing context window fallbacks: None
  170. Router Redis Caching=None
  172. #------------------------------------------------------------#
  173. #                                                            #
  174. #           'It would help me if you could add...'            #
  175. #        https://github.com/BerriAI/litellm/issues/new        #
  176. #                                                            #
  177. #------------------------------------------------------------#
  179. Thank you for using LiteLLM! - Krrish & Ishaan
  183. Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
  186. Intialized router with Routing strategy: simple-shuffle
  188. Routing fallbacks: None
  190. Routing context window fallbacks: None
  192. Router Redis Caching=None
  193. INFO:     Application startup complete.
  194. INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
复制代码
免责声明：如果侵犯了您的权益，请联系站长，我们会及时删除侵权内容，谢谢合作！更多信息从访问主页：qidao123.com:ToB企服之家，中国第一个企服评测及商务社交产业平台。



欢迎光临 ToB企服应用市场:ToB评测及商务社交产业平台 (https://dis.qidao123.com/) Powered by Discuz! X3.4