Ungoogled Chromium127编译指南 Windows篇 - Rust标准库查找问题修复（十一 ...

种地  金牌会员 | 2024-12-15 11:35:08 | 显示全部楼层 | 阅读模式
打印 上一主题 下一主题
楼主

主题 924|帖子 924|积分 2772


1. 引言

在修复Python路径问题后，我们遇到的下一个技术挑衅是Rust标准库的查找问题。在编译过程中，find_std_rlibs.py脚本无法精确处理惩罚Windows环境下的Rust工具链路径，导致编译失败。本文将详细介绍如何解决这个问题。
2. 问题分析

2.1 错误表现

编译过程中会遇到如下错误：
  1. ninja: Entering directory `out\Default'
  2. [19/62261] ACTION //build/rust/std:find_stdlib(//build/toolchain/win:win_clang_x64)
  3. FAILED: obj/build/rust/std/libstd.rlib obj/build/rust/std/liballoc.rlib obj/build/rust/std/libcfg_if.rlib obj/build/rust/std/libcompiler_builtins.rlib obj/build/rust/std/libcore.rlib obj/build/rust/std/libgetopts.rlib obj/build/rust/std/libhashbrown.rlib obj/build/rust/std/liblibc.rlib obj/build/rust/std/libpanic_abort.rlib obj/build/rust/std/libpanic_unwind.rlib obj/build/rust/std/librustc_demangle.rlib obj/build/rust/std/libstd_detect.rlib obj/build/rust/std/libtest.rlib obj/build/rust/std/libunicode_width.rlib obj/build/rust/std/libunwind.rlib obj/build/rust/std/libprofiler_builtins.rlib obj/build/rust/std/librustc_std_workspace_alloc.rlib obj/build/rust/std/librustc_std_workspace_core.rlib obj/build/rust/std/librustc_std_workspace_std.rlib
  4. C:/Users/ym/AppData/Local/Programs/Python/Python310/python.exe ../../build/rust/std/find_std_rlibs.py --rust-bin-dir ../../third_party/rust-toolchain/bin --output obj/build/rust/std --depfile obj/build/rust/std/stdlib.d --depfile-target std --rustc-revision "rustc 1.80.0-nightly (faefc618c 2024-05-07)" --target x86_64-pc-windows-msvc
  5. Traceback (most recent call last):
  6.   File "C:\ungoogled-chromium-windows\build\src\build\rust\std\find_std_rlibs.py", line 132, in <module>
  7.     sys.exit(main())
  8.   File "C:\ungoogled-chromium-windows\build\src\build\rust\std\find_std_rlibs.py", line 53, in main
  9.     rustlib_dir = subprocess.check_output(rustc_args).rstrip().decode()
  10.   File "C:\Users\ym\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 420, in check_output
  11.     return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  12.   File "C:\Users\ym\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 501, in run
  13.     with Popen(*popenargs, **kwargs) as process:
  14.   File "C:\Users\ym\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 966, in __init__
  15.     self._execute_child(args, executable, preexec_fn, close_fds,
  16.   File "C:\Users\ym\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1435, in _execute_child
  17.     hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
  18. OSError: [WinError 193] %1 is not a valid Win32 application
  19. [24/62261] CXX obj/base/third_party/double_conversion/double_conversion/bignum.obj
  20. ninja: build stopped: subcommand failed.
  22. C:\ungoogled-chromium-windows\build\src>exit
  23. Traceback (most recent call last):
  24.   File "C:\ungoogled-chromium-windows\build.py", line 325, in <module>
  25.     main()
  26.   File "C:\ungoogled-chromium-windows\build.py", line 321, in main
  27.     _run_build_process('third_party\\ninja\\ninja.exe', '-C', 'out\\Default', 'chrome',
  28.   File "C:\ungoogled-chromium-windows\build.py", line 67, in _run_build_process
  29.     subprocess.run(('cmd.exe', '/k'),
  30.   File "C:\Users\ym\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 524, in run
  31.     raise CalledProcessError(retcode, process.args,
  32. subprocess.CalledProcessError: Command '('cmd.exe', '/k')' returned non-zero exit status 1.
复制代码
2.2 错误缘故原由



  • find_std_rlibs.py脚本未精确处理惩罚Windows可实行文件后缀
  • rustc命令调用缺少.exe后缀
  • 工具链路径剖析不适配Windows环境
3. 修复方案

3.1 修改find_std_rlibs.py

打开build/rust/std/find_std_rlibs.py文件，定位到rustc命令构造部门：
修改前：
  1. rustc = os.path.join(args.rust_bin_dir, "rustc")
复制代码
修改后：
  1. rustc = os.path.join(args.rust_bin_dir, "rustc.exe")
复制代码
3.2 完备脚本

  1. #!/usr/bin/env/python3
  3. # Copyright 2021 The Chromium Authors
  4. # Use of this source code is governed by a BSD-style license that can be
  5. # found in the LICENSE file.
  7. # See BUILD.gn in this directory for an explanation of what this script is for.
  9. import argparse
  10. import os
  11. import stat
  12. import sys
  13. import shutil
  14. import subprocess
  15. import re
  17. from collections import defaultdict
  19. EXPECTED_STDLIB_INPUT_REGEX = re.compile(r"([0-9a-z_]+)(?:-([0-9]+))?$")
  20. RLIB_NAME_REGEX = re.compile(r"lib([0-9a-z_]+)-([0-9a-f]+)\.rlib$")
  23. def main():
  24.   parser = argparse.ArgumentParser("find_std_rlibs.py")
  25.   parser.add_argument("--rust-bin-dir",
  26.                       help="Path to Rust binaries",
  27.                       required=True),
  28.   parser.add_argument("--target", help="Rust target triple", required=False),
  29.   parser.add_argument("--output",
  30.                       help="Path to rlibs without suffixes",
  31.                       required=True)
  32.   parser.add_argument("--depfile", help="Path to write depfile", required=True)
  33.   parser.add_argument("--depfile-target",
  34.                       help="Target to key depfile around",
  35.                       required=True)
  36.   parser.add_argument("--extra-libs",
  37.                       help="List of extra non-libstd sysroot libraries")
  38.   parser.add_argument("--rustc-revision",
  39.                       help="Not used, just passed from GN to add a dependency"
  40.                       " on the rustc version.")
  41.   args = parser.parse_args()
  43.   extra_libs = set()
  44.   if args.extra_libs:
  45.     for lib in args.extra_libs.split(','):
  46.       extra_libs.add(lib)
  48.   # Ask rustc where to find the stdlib for this target.
  49.   rustc = os.path.join(args.rust_bin_dir, "rustc.exe")
  50.   rustc_args = [rustc, "--print", "target-libdir"]
  51.   if args.target:
  52.     rustc_args.extend(["--target", args.target])
  53.   rustlib_dir = subprocess.check_output(rustc_args).rstrip().decode()
  55.   # Copy the rlibs to a predictable location. Whilst we're doing so,
  56.   # also write a .d file so that ninja knows it doesn't need to do this
  57.   # again unless the source rlibs change.
  58.   # Format:
  59.   # <output path to>/lib<lib name.rlib>: <path to each Rust stlib rlib>
  60.   with open(args.depfile, 'w') as depfile:
  61.     # Ninja isn't versatile at understanding depfiles. We have to say that a
  62.     # single output depends on all the inputs. We choose any one of the
  63.     # output rlibs for that purpose. If any of the input rlibs change, ninja
  64.     # will run this script again and we'll copy them all afresh.
  65.     depfile.write(
  66.         "%s:" % (os.path.join(args.output, "lib%s.rlib" % args.depfile_target)))
  68.     def copy_file(infile, outfile):
  69.       depfile.write(f" {infile}")
  70.       if (not os.path.exists(outfile)
  71.           or os.stat(infile).st_mtime != os.stat(outfile).st_mtime):
  72.         if os.path.exists(outfile):
  73.           st = os.stat(outfile)
  74.           os.chmod(outfile, st.st_mode | stat.S_IWUSR)
  75.         shutil.copy(infile, outfile)
  77.     # Each rlib is named "lib<crate_name>-<metadata>.rlib". The metadata
  78.     # disambiguates multiple crates of the same name. We want to throw away the
  79.     # metadata and use stable names. To do so, we replace the metadata bit with
  80.     # a simple number 1, 2, etc. It doesn't matter how we assign these numbers
  81.     # as long as it's consistent for a particular set of rlibs.
  83.     # The rlib names present in the Rust distribution, including metadata. We
  84.     # sort this list so crates of the same name are ordered by metadata. Also
  85.     # filter out names that aren't rlibs.
  86.     rlibs_present = [
  87.         name for name in os.listdir(rustlib_dir) if name.endswith('.rlib')
  88.     ]
  89.     rlibs_present.sort()
  91.     # Keep a count of the instances a crate name, so we can disambiguate the
  92.     # rlibs with an incrementing number at the end.
  93.     rlibs_seen = defaultdict(lambda: 0)
  95.     for f in rlibs_present:
  96.       # As standard Rust includes a hash on the end of each filename
  97.       # representing certain metadata, to ensure that clients will link
  98.       # against the correct version. As gn will be manually passing
  99.       # the correct file path to our linker invocations, we don't need
  100.       # that, and it would prevent us having the predictable filenames
  101.       # which we need for statically computable gn dependency rules.
  102.       (crate_name, metadata) = RLIB_NAME_REGEX.match(f).group(1, 2)
  104.       # Use the number of times we've seen this name to disambiguate the output
  105.       # filenames. Since we sort the input filenames including the metadata,
  106.       # this will be the same every time.
  107.       #
  108.       # Only append the times seen if it is greater than 1. This allows the
  109.       # BUILD.gn file to avoid adding '-1' to every name if there's only one
  110.       # version of a particular one.
  111.       rlibs_seen[crate_name] += 1
  112.       if rlibs_seen[crate_name] == 1:
  113.         concise_name = crate_name
  114.       else:
  115.         concise_name = "%s-%d" % (crate_name, rlibs_seen[crate_name])
  117.       output_filename = f"lib{concise_name}.rlib"
  119.       infile = os.path.join(rustlib_dir, f)
  120.       outfile = os.path.join(args.output, output_filename)
  121.       copy_file(infile, outfile)
  123.     for f in extra_libs:
  124.       infile = os.path.join(rustlib_dir, f)
  125.       outfile = os.path.join(args.output, f)
  126.       copy_file(infile, outfile)
  128.     depfile.write("\n")
  131. if __name__ == '__main__':
  132.   sys.exit(main())
复制代码
4. 验证修复

4.1 测试修改

修改完成后，运行下面的命令继续进行编译即可
  1. python build.py --tarball
复制代码
4.2 检查输出



  • 确认脚本能精确找到Rust标准库
  • 验证天生的库文件路径
  • 检查权限和访问问题
5. 大概遇到的问题

5.1 路径权限



  • 确保对Rust工具链目次有读取权限
  • 验证输出目次的写入权限
  • 检查暂时文件的访问权限
5.2 工具链完备性



  • 验证Rust工具链安装完备
  • 确认所有必要组件存在
  • 检查版本匹配性
6. 结语

通过本文的指导，我们乐成解决了Ungoogled Chromium编译过程中的Rust标准库查找问题。这个修复是确保Rust组件精确编译的关键步调之一。
在下一篇文章《Ungoogled Chromium127编译指南 Windows篇 - Rust编译器包装器修复（十二）》中，我们将继续处理惩罚rustc_wrapper.py的相关问题，以完成Rust工具链的完备设置。请确保按本文的步调精确修复find_std_rlibs的问题，为后续的编译工作创造良好条件。
1. 引言

在修复Python路径问题后，我们遇到的下一个技术挑衅是Rust标准库的查找问题。在编译过程中，find_std_rlibs.py脚本无法精确处理惩罚Windows环境下的Rust工具链路径，导致编译失败。本文将详细介绍如何解决这个问题。
2. 问题分析

2.1 错误表现

编译过程中会遇到如下错误：
  1. ninja: Entering directory `out\Default'
  2. [19/62261] ACTION //build/rust/std:find_stdlib(//build/toolchain/win:win_clang_x64)
  3. FAILED: obj/build/rust/std/libstd.rlib obj/build/rust/std/liballoc.rlib obj/build/rust/std/libcfg_if.rlib obj/build/rust/std/libcompiler_builtins.rlib obj/build/rust/std/libcore.rlib obj/build/rust/std/libgetopts.rlib obj/build/rust/std/libhashbrown.rlib obj/build/rust/std/liblibc.rlib obj/build/rust/std/libpanic_abort.rlib obj/build/rust/std/libpanic_unwind.rlib obj/build/rust/std/librustc_demangle.rlib obj/build/rust/std/libstd_detect.rlib obj/build/rust/std/libtest.rlib obj/build/rust/std/libunicode_width.rlib obj/build/rust/std/libunwind.rlib obj/build/rust/std/libprofiler_builtins.rlib obj/build/rust/std/librustc_std_workspace_alloc.rlib obj/build/rust/std/librustc_std_workspace_core.rlib obj/build/rust/std/librustc_std_workspace_std.rlib
  4. C:/Users/ym/AppData/Local/Programs/Python/Python310/python.exe ../../build/rust/std/find_std_rlibs.py --rust-bin-dir ../../third_party/rust-toolchain/bin --output obj/build/rust/std --depfile obj/build/rust/std/stdlib.d --depfile-target std --rustc-revision "rustc 1.80.0-nightly (faefc618c 2024-05-07)" --target x86_64-pc-windows-msvc
  5. Traceback (most recent call last):
  6.   File "C:\ungoogled-chromium-windows\build\src\build\rust\std\find_std_rlibs.py", line 132, in <module>
  7.     sys.exit(main())
  8.   File "C:\ungoogled-chromium-windows\build\src\build\rust\std\find_std_rlibs.py", line 53, in main
  9.     rustlib_dir = subprocess.check_output(rustc_args).rstrip().decode()
  10.   File "C:\Users\ym\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 420, in check_output
  11.     return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  12.   File "C:\Users\ym\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 501, in run
  13.     with Popen(*popenargs, **kwargs) as process:
  14.   File "C:\Users\ym\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 966, in __init__
  15.     self._execute_child(args, executable, preexec_fn, close_fds,
  16.   File "C:\Users\ym\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1435, in _execute_child
  17.     hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
  18. OSError: [WinError 193] %1 is not a valid Win32 application
  19. [24/62261] CXX obj/base/third_party/double_conversion/double_conversion/bignum.obj
  20. ninja: build stopped: subcommand failed.
  22. C:\ungoogled-chromium-windows\build\src>exit
  23. Traceback (most recent call last):
  24.   File "C:\ungoogled-chromium-windows\build.py", line 325, in <module>
  25.     main()
  26.   File "C:\ungoogled-chromium-windows\build.py", line 321, in main
  27.     _run_build_process('third_party\\ninja\\ninja.exe', '-C', 'out\\Default', 'chrome',
  28.   File "C:\ungoogled-chromium-windows\build.py", line 67, in _run_build_process
  29.     subprocess.run(('cmd.exe', '/k'),
  30.   File "C:\Users\ym\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 524, in run
  31.     raise CalledProcessError(retcode, process.args,
  32. subprocess.CalledProcessError: Command '('cmd.exe', '/k')' returned non-zero exit status 1.
复制代码
2.2 错误缘故原由



  • find_std_rlibs.py脚本未精确处理惩罚Windows可实行文件后缀
  • rustc命令调用缺少.exe后缀
  • 工具链路径剖析不适配Windows环境
3. 修复方案

3.1 修改find_std_rlibs.py

打开build/rust/std/find_std_rlibs.py文件，定位到rustc命令构造部门：
修改前：
  1. rustc = os.path.join(args.rust_bin_dir, "rustc")
复制代码
修改后：
  1. rustc = os.path.join(args.rust_bin_dir, "rustc.exe")
复制代码
3.2 完备脚本

  1. #!/usr/bin/env/python3
  3. # Copyright 2021 The Chromium Authors
  4. # Use of this source code is governed by a BSD-style license that can be
  5. # found in the LICENSE file.
  7. # See BUILD.gn in this directory for an explanation of what this script is for.
  9. import argparse
  10. import os
  11. import stat
  12. import sys
  13. import shutil
  14. import subprocess
  15. import re
  17. from collections import defaultdict
  19. EXPECTED_STDLIB_INPUT_REGEX = re.compile(r"([0-9a-z_]+)(?:-([0-9]+))?$")
  20. RLIB_NAME_REGEX = re.compile(r"lib([0-9a-z_]+)-([0-9a-f]+)\.rlib$")
  23. def main():
  24.   parser = argparse.ArgumentParser("find_std_rlibs.py")
  25.   parser.add_argument("--rust-bin-dir",
  26.                       help="Path to Rust binaries",
  27.                       required=True),
  28.   parser.add_argument("--target", help="Rust target triple", required=False),
  29.   parser.add_argument("--output",
  30.                       help="Path to rlibs without suffixes",
  31.                       required=True)
  32.   parser.add_argument("--depfile", help="Path to write depfile", required=True)
  33.   parser.add_argument("--depfile-target",
  34.                       help="Target to key depfile around",
  35.                       required=True)
  36.   parser.add_argument("--extra-libs",
  37.                       help="List of extra non-libstd sysroot libraries")
  38.   parser.add_argument("--rustc-revision",
  39.                       help="Not used, just passed from GN to add a dependency"
  40.                       " on the rustc version.")
  41.   args = parser.parse_args()
  43.   extra_libs = set()
  44.   if args.extra_libs:
  45.     for lib in args.extra_libs.split(','):
  46.       extra_libs.add(lib)
  48.   # Ask rustc where to find the stdlib for this target.
  49.   rustc = os.path.join(args.rust_bin_dir, "rustc.exe")
  50.   rustc_args = [rustc, "--print", "target-libdir"]
  51.   if args.target:
  52.     rustc_args.extend(["--target", args.target])
  53.   rustlib_dir = subprocess.check_output(rustc_args).rstrip().decode()
  55.   # Copy the rlibs to a predictable location. Whilst we're doing so,
  56.   # also write a .d file so that ninja knows it doesn't need to do this
  57.   # again unless the source rlibs change.
  58.   # Format:
  59.   # <output path to>/lib<lib name.rlib>: <path to each Rust stlib rlib>
  60.   with open(args.depfile, 'w') as depfile:
  61.     # Ninja isn't versatile at understanding depfiles. We have to say that a
  62.     # single output depends on all the inputs. We choose any one of the
  63.     # output rlibs for that purpose. If any of the input rlibs change, ninja
  64.     # will run this script again and we'll copy them all afresh.
  65.     depfile.write(
  66.         "%s:" % (os.path.join(args.output, "lib%s.rlib" % args.depfile_target)))
  68.     def copy_file(infile, outfile):
  69.       depfile.write(f" {infile}")
  70.       if (not os.path.exists(outfile)
  71.           or os.stat(infile).st_mtime != os.stat(outfile).st_mtime):
  72.         if os.path.exists(outfile):
  73.           st = os.stat(outfile)
  74.           os.chmod(outfile, st.st_mode | stat.S_IWUSR)
  75.         shutil.copy(infile, outfile)
  77.     # Each rlib is named "lib<crate_name>-<metadata>.rlib". The metadata
  78.     # disambiguates multiple crates of the same name. We want to throw away the
  79.     # metadata and use stable names. To do so, we replace the metadata bit with
  80.     # a simple number 1, 2, etc. It doesn't matter how we assign these numbers
  81.     # as long as it's consistent for a particular set of rlibs.
  83.     # The rlib names present in the Rust distribution, including metadata. We
  84.     # sort this list so crates of the same name are ordered by metadata. Also
  85.     # filter out names that aren't rlibs.
  86.     rlibs_present = [
  87.         name for name in os.listdir(rustlib_dir) if name.endswith('.rlib')
  88.     ]
  89.     rlibs_present.sort()
  91.     # Keep a count of the instances a crate name, so we can disambiguate the
  92.     # rlibs with an incrementing number at the end.
  93.     rlibs_seen = defaultdict(lambda: 0)
  95.     for f in rlibs_present:
  96.       # As standard Rust includes a hash on the end of each filename
  97.       # representing certain metadata, to ensure that clients will link
  98.       # against the correct version. As gn will be manually passing
  99.       # the correct file path to our linker invocations, we don't need
  100.       # that, and it would prevent us having the predictable filenames
  101.       # which we need for statically computable gn dependency rules.
  102.       (crate_name, metadata) = RLIB_NAME_REGEX.match(f).group(1, 2)
  104.       # Use the number of times we've seen this name to disambiguate the output
  105.       # filenames. Since we sort the input filenames including the metadata,
  106.       # this will be the same every time.
  107.       #
  108.       # Only append the times seen if it is greater than 1. This allows the
  109.       # BUILD.gn file to avoid adding '-1' to every name if there's only one
  110.       # version of a particular one.
  111.       rlibs_seen[crate_name] += 1
  112.       if rlibs_seen[crate_name] == 1:
  113.         concise_name = crate_name
  114.       else:
  115.         concise_name = "%s-%d" % (crate_name, rlibs_seen[crate_name])
  117.       output_filename = f"lib{concise_name}.rlib"
  119.       infile = os.path.join(rustlib_dir, f)
  120.       outfile = os.path.join(args.output, output_filename)
  121.       copy_file(infile, outfile)
  123.     for f in extra_libs:
  124.       infile = os.path.join(rustlib_dir, f)
  125.       outfile = os.path.join(args.output, f)
  126.       copy_file(infile, outfile)
  128.     depfile.write("\n")
  131. if __name__ == '__main__':
  132.   sys.exit(main())
复制代码
4. 验证修复

4.1 测试修改

修改完成后，运行下面的命令继续进行编译即可
  1. python build.py --tarball
复制代码
4.2 检查输出



  • 确认脚本能精确找到Rust标准库
  • 验证天生的库文件路径
  • 检查权限和访问问题
5. 大概遇到的问题

5.1 路径权限



  • 确保对Rust工具链目次有读取权限
  • 验证输出目次的写入权限
  • 检查暂时文件的访问权限
5.2 工具链完备性



  • 验证Rust工具链安装完备
  • 确认所有必要组件存在
  • 检查版本匹配性
6. 结语

通过本文的指导，我们乐成解决了Ungoogled Chromium编译过程中的Rust标准库查找问题。这个修复是确保Rust组件精确编译的关键步调之一。
在下一篇文章《Ungoogled Chromium127编译指南 Windows篇 - Rust编译器包装器修复（十二）》中，我们将继续处理惩罚rustc_wrapper.py的相关问题，以完成Rust工具链的完备设置。请确保按本文的步调精确修复find_std_rlibs的问题，为后续的编译工作创造良好条件。

免责声明：如果侵犯了您的权益，请联系站长，我们会及时删除侵权内容，谢谢合作！更多信息从访问主页：qidao123.com:ToB企服之家，中国第一个企服评测及商务社交产业平台。
回复

使用道具 举报

0 个回复

倒序浏览
返回列表

快速回复

高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 or 立即注册

本版积分规则

种地

金牌会员
这个人很懒什么都没写!

楼主热帖

标签云

存储 挺好的 服务器
微信订阅号
微信服务号
微信客服
小程序
H5
关于我们 商务合作 网站地图
©Copyright 2022-2024 杭州祥升科技有限公司 版权所有 浙ICP备20004199号
快速回复 返回顶部 返回列表