Open WebUI – 当地化摆设大模子仿照 ChatGPT用户界面

Open WebUI介绍：

Open WebUI 是一个仿照 ChatGPT 界面，为当地大语言模子提供图形化界面的开源项目，可以非常方便的调试、调用当地模子。你能用它毗连你在当地的大语言模子（包括 Ollama 和 OpenAI 兼容的 API），也支持远程服务器。Docker 摆设简单，功能非常丰富，包括代码高亮、数学公式、网页浏览、预设提示词、当地 RAG 集成、对话标记、下载模子、谈天记录、语音支持等。
官网地址：https://openwebui.com
GitHub：GitHub - open-webui/open-webui: User-friendly WebUI for LLMs (Formerly Ollama WebUI)

功能：
?? 直观界面：我们的谈天界面深受ChatGPT启发，旨在确保用户获得友爱易用的体验。
?? 相应式计划：无论是在桌面电脑还是移动设备上，都能享受一致而流畅的用户体验。
迅捷相应速度：畅享快速且高效的相应性能。
?? 轻松启动：接纳Docker或Kubernetes（通过kubectl、kustomize或helm工具）实现无缝安装，带给您无烦恼的初始化体验。
代码语法高亮显示：得益于我们的语法高亮功能，您可以享受到更为清晰易读的代码展示效果。
数字化写作 全面支持Markdown和LaTeX：借助全面集成的Markdown和LaTeX功能，全面提拔您的LLM互动体验。
?? 当地RAG集成：步入未来谈天交互的新篇章，我们内建了Retrieval Augmented Generation（RAG）支持，让您可以或许将文档操作无缝融合进谈天流程。只需简单地将文档载入谈天或添加文件至文档库，然后通过#命令即可轻松访问文档内容。此功能如今尚处于alpha测试阶段，我们正不停改进和完满，以确保其稳定性和性能体现到达最优。
总结一下，重点理解为如下三点：

• Open WebUI 是一个多功能且直观的开源用户界面，与 ollama 共同使用，它作为一个webui，为用户提供了一个私有化的 ChatGPT 体验。
  
• Open WebUI 集成了 Retrieval Augmented Generation（RAG）技术，允许用户将文档、网站和视频等作为上下文信息，供 AI 在回答标题时参考，以提供更准确的信息。
  
• 通过调解 Top K 值和改进 RAG 模板提示词来进步基于文档的问答系统的准确性。
  

Q：关于Open WebUI的安全性，尤其是第一次使用还需要注册，注册信息到哪里去了？
open-webui是一个用于构建Web用户界面的开源库，它通常不直接处置处罚数据传输，而是作为前端框架与后端服务器之间的中介。
第一次使用注册信息，是要求您注册成为管理员用户。这确保了如果Open WebUI被外部访问，您的数据仍然是安全的。
需要留意的是，所有东西都是当地的。我们不网络您的数据。当您注册时，所有信息都会留在您的服务器中，永远不会脱离您的设备。
您的隐私和安全是我们的重要任务，确保您的数据始终处于您的控制之下。
参考：?? FAQ | Open WebUI
Q: Why am I asked to sign up Where are my data being sent to
A: We require you to sign up to become the admin user for enhanced security. This ensures that if the Open WebUI is ever exposed to external access, your data remains secure. It’s important to note that everything is kept local. We do not collect your data. When you sign up, all information stays within your server and never leaves your device. Your privacy and security are our top priorities, ensuring that your data remains under your control at all times.

Open WebUI安装：

如今我只在linux环境下，做了安装实践， 在安装过程中，我重点参考了csdn上的这篇文章：
linux环境安装参考： ollama+open-webui，当地摆设本身的大模子
操作步骤很具体，包括安装过程中遇到的报错标题，基本上都可以按照文章中的步骤，逐步执行办理。
还有一篇文章，写的也很具体，如果是windows下安装，建议参考下：
windows环境安装参考：本机摆设大语言模子：Ollama和OpenWebUI实现各大模子的人工智能自由
另外，我使用的centos系统，在安装过程中遇到如下错误：
(open-webui) [root@master open-webui]# npm i
node: /lib64/libm.so.6: version `GLIBC_2.27’ not found (required by node)
node: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.20’ not found (required by node)
node: /lib64/libstdc++.so.6: version `CXXABI_1.3.9’ not found (required by node)
node: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.21’ not found (required by node)
node: /lib64/libc.so.6: version `GLIBC_2.28’ not found (required by node)
node: /lib64/libc.so.6: version `GLIBC_2.25’ not found (required by node)
办理办法：node: /lib64/libm.so.6: version `GLIBC_2.27‘ not found标题办理方案_libm.so.6 glibc2.27-CSDN博客
另外，open-webui安装过程中，需要毗连’https://huggingface.co’ 网站，会报错无法毗连。
我通过简单设置环境变量办理：export HF_ENDPOINT=HF-Mirror
下面给出了我在conda假造环境创建完后，并且npm也安装ok后，open-webui的安装执行过程快照，仅供参考：

1. (base) [root@master backend]# conda activate open-webui
2. (open-webui) [root@master backend]# bash start.sh
3. No WEBUI_SECRET_KEY provided
4. Loading WEBUI_SECRET_KEY from .webui_secret_key
5. USER_AGENT environment variable not set, consider setting it to identify your requests.
6. No sentence-transformers model found with name sentence-transformers/all-MiniLM-L6-v2. Creating a new one with mean pooling.
7. Traceback (most recent call last):
8.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connection.py", line 196, in _new_conn
9.     sock = connection.create_connection(
10.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/util/connection.py", line 85, in create_connection
11.     raise err
12.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/util/connection.py", line 73, in create_connection
13.     sock.connect(sa)
14. OSError: [Errno 101] Network is unreachable
16. The above exception was the direct cause of the following exception:
18. Traceback (most recent call last):
19.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connectionpool.py", line 789, in urlopen
20.     response = self._make_request(
21.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connectionpool.py", line 490, in _make_request
22.     raise new_e
23.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connectionpool.py", line 466, in _make_request
24.     self._validate_conn(conn)
25.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connectionpool.py", line 1095, in _validate_conn
26.     conn.connect()
27.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connection.py", line 615, in connect
28.     self.sock = sock = self._new_conn()
29.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connection.py", line 211, in _new_conn
30.     raise NewConnectionError(
31. urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f8572048eb0>: Failed to establish a new connection: [Errno 101] Network is unreachable
33. The above exception was the direct cause of the following exception:
35. Traceback (most recent call last):
36.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/requests/adapters.py", line 667, in send
37.     resp = conn.urlopen(
38.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/connectionpool.py", line 843, in urlopen
39.     retries = retries.increment(
40.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/urllib3/util/retry.py", line 519, in increment
41.     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
42. urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /sentence-transformers/all-MiniLM-L6-v2/resolve/main/config.json (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f8572048eb0>: Failed to establish a new connection: [Errno 101] Network is unreachable'))
44. During handling of the above exception, another exception occurred:
46. Traceback (most recent call last):
47.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 1722, in _get_metadata_or_catch_error
48.     metadata = get_hf_file_metadata(url=url, proxies=proxies, timeout=etag_timeout, headers=headers)
49.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
50.     return fn(*args, **kwargs)
51.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 1645, in get_hf_file_metadata
52.     r = _request_wrapper(
53.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 372, in _request_wrapper
54.     response = _request_wrapper(
55.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 395, in _request_wrapper
56.     response = get_session().request(method=method, url=url, **params)
57.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/requests/sessions.py", line 589, in request
58.     resp = self.send(prep, **send_kwargs)
59.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/requests/sessions.py", line 703, in send
60.     r = adapter.send(request, **kwargs)
61.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/utils/_http.py", line 66, in send
62.     return super().send(request, *args, **kwargs)
63.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/requests/adapters.py", line 700, in send
64.     raise ConnectionError(e, request=request)
65. requests.exceptions.ConnectionError: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /sentence-transformers/all-MiniLM-L6-v2/resolve/main/config.json (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f8572048eb0>: Failed to establish a new connection: [Errno 101] Network is unreachable'))"), '(Request ID: 430abcfa-0ffb-419d-a853-40caed43b5c8)')
67. The above exception was the direct cause of the following exception:
69. Traceback (most recent call last):
70.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/transformers/utils/hub.py", line 399, in cached_file
71.     resolved_file = hf_hub_download(
72.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
73.     return fn(*args, **kwargs)
74.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 1221, in hf_hub_download
75.     return _hf_hub_download_to_cache_dir(
76.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 1325, in _hf_hub_download_to_cache_dir
77.     _raise_on_head_call_error(head_call_error, force_download, local_files_only)
78.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/huggingface_hub/file_download.py", line 1826, in _raise_on_head_call_error
79.     raise LocalEntryNotFoundError(
80. huggingface_hub.utils._errors.LocalEntryNotFoundError: An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.
82. The above exception was the direct cause of the following exception:
84. Traceback (most recent call last):
85.   File "/root/miniconda3/envs/open-webui/bin/uvicorn", line 8, in <module>
86.     sys.exit(main())
87.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/click/core.py", line 1157, in __call__
88.     return self.main(*args, **kwargs)
89.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/click/core.py", line 1078, in main
90.     rv = self.invoke(ctx)
91.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/click/core.py", line 1434, in invoke
92.     return ctx.invoke(self.callback, **ctx.params)
93.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/click/core.py", line 783, in invoke
94.     return __callback(*args, **kwargs)
95.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/main.py", line 410, in main
96.     run(
97.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/main.py", line 577, in run
98.     server.run()
99.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/server.py", line 65, in run
100.     return asyncio.run(self.serve(sockets=sockets))
101.   File "/root/miniconda3/envs/open-webui/lib/python3.8/asyncio/runners.py", line 44, in run
102.     return loop.run_until_complete(main)
103.   File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
104.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/server.py", line 69, in serve
105.     await self._serve(sockets)
106.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/server.py", line 76, in _serve
107.     config.load()
108.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/config.py", line 434, in load
109.     self.loaded_app = import_from_string(self.app)
110.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/uvicorn/importer.py", line 19, in import_from_string
111.     module = importlib.import_module(module_str)
112.   File "/root/miniconda3/envs/open-webui/lib/python3.8/importlib/__init__.py", line 127, in import_module
113.     return _bootstrap._gcd_import(name[level:], package, level)
114.   File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
115.   File "<frozen importlib._bootstrap>", line 991, in _find_and_load
116.   File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
117.   File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
118.   File "<frozen importlib._bootstrap_external>", line 843, in exec_module
119.   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
120.   File "/root/open-webui/backend/main.py", line 25, in <module>
121.     from apps.rag.main import app as rag_app
122.   File "/root/open-webui/backend/apps/rag/main.py", line 85, in <module>
123.     embedding_functions.SentenceTransformerEmbeddingFunction(
124.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/chromadb/utils/embedding_functions.py", line 83, in __init__
125.     self.models[model_name] = SentenceTransformer(
126.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/sentence_transformers/SentenceTransformer.py", line 299, in __init__
127.     modules = self._load_auto_model(
128.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/sentence_transformers/SentenceTransformer.py", line 1324, in _load_auto_model
129.     transformer_model = Transformer(
130.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/sentence_transformers/models/Transformer.py", line 53, in __init__
131.     config = AutoConfig.from_pretrained(model_name_or_path, **config_args, cache_dir=cache_dir)
132.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/transformers/models/auto/configuration_auto.py", line 934, in from_pretrained
133.     config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
134.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/transformers/configuration_utils.py", line 632, in get_config_dict
135.     config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
136.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/transformers/configuration_utils.py", line 689, in _get_config_dict
137.     resolved_config_file = cached_file(
138.   File "/root/miniconda3/envs/open-webui/lib/python3.8/site-packages/transformers/utils/hub.py", line 442, in cached_file
139.     raise EnvironmentError(
140. OSError: We couldn't connect to 'https://huggingface.co' to load this file, couldn't find it in the cached files and it looks like sentence-transformers/all-MiniLM-L6-v2 is not the path to a directory containing a file named config.json.
141. Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/transformers/installation#offline-mode'.
143. (open-webui) [root@master backend]# export HF_ENDPOINT=https://hf-mirror.com
144. (open-webui) [root@master backend]# bash start.sh
145. No WEBUI_SECRET_KEY provided
146. Loading WEBUI_SECRET_KEY from .webui_secret_key
147. USER_AGENT environment variable not set, consider setting it to identify your requests.
148. modules.json: 100%|██████████████████████████████████████████████████████████████████████████████████████| 349/349 [00:00<00:00, 95.8kB/s]
149. config_sentence_transformers.json: 100%|█████████████████████████████████████████████████████████████████| 116/116 [00:00<00:00, 25.3kB/s]
150. README.md: 10.7kB [00:00, 19.1MB/s]
151. sentence_bert_config.json: 100%|███████████████████████████████████████████████████████████████████████| 53.0/53.0 [00:00<00:00, 25.2kB/s]
152. config.json: 612B [00:00, 283kB/s]                                                                                                        
153. model.safetensors: 100%|█████████████████████████████████████████████████████████████████████████████| 90.9M/90.9M [00:16<00:00, 5.67MB/s]
154. tokenizer_config.json: 100%|█████████████████████████████████████████████████████████████████████████████| 350/350 [00:00<00:00, 71.3kB/s]
155. vocab.txt: 210kB [00:17, 30.4kB/s]Error while downloading from https://hf-mirror.com/sentence-transformers/all-MiniLM-L6-v2/resolve/main/vocab.txt: HTTPSConnectionPool(host='hf-mirror.com', port=443): Read timed out.
156. Trying to resume download...
157. vocab.txt: 232kB [00:00, 24.2MB/s]
158. vocab.txt: 214kB [00:29, 7.34kB/s]
159. tokenizer.json: 466kB [00:03, 155kB/s]
160. special_tokens_map.json: 100%|███████████████████████████████████████████████████████████████████████████| 112/112 [00:00<00:00, 50.8kB/s]
161. 1_Pooling/config.json: 100%|█████████████████████████████████████████████████████████████████████████████| 190/190 [00:00<00:00, 32.2kB/s]
162. INFO:     Started server process [71959]
163. INFO:     Waiting for application startup.
164. Intialized router with Routing strategy: simple-shuffle
166. Routing fallbacks: None
168. Routing context window fallbacks: None
170. Router Redis Caching=None
172. #------------------------------------------------------------#
173. #                                                            #
174. #           'It would help me if you could add...'            #
175. #        https://github.com/BerriAI/litellm/issues/new        #
176. #                                                            #
177. #------------------------------------------------------------#
179. Thank you for using LiteLLM! - Krrish & Ishaan
183. Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
186. Intialized router with Routing strategy: simple-shuffle
188. Routing fallbacks: None
190. Routing context window fallbacks: None
192. Router Redis Caching=None
193. INFO:     Application startup complete.
194. INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)

复制代码

免责声明：如果侵犯了您的权益，请联系站长，我们会及时删除侵权内容，谢谢合作！更多信息从访问主页：qidao123.com:ToB企服之家，中国第一个企服评测及商务社交产业平台。