ToB企服应用市场:ToB评测及商务社交产业平台

标题: Hadoop解决yarn报错Container exited with a non-zero exit code 1. Error [打印本页]
作者: 慢吞云雾缓吐愁    时间: 2024-11-5 04:05
标题: Hadoop解决yarn报错Container exited with a non-zero exit code 1. Error
当我们使用Hadoop的MapReduce框架来运行一个示例步伐的时候，比方：
 hadoop jar hadoop-mapreduce-examples-3.4.0.jar grep input output 'dfs[a-z.]+'
报出以下错误：
一开始还以为是电脑的设置不太行，然后找了许多东西，发现只需要在yarn-site.xml文件中加入以下设置：
起首你通过hadoop classpath获取到这个位置

然后将这个位置复制，写入yarn-site.xml中
  1. <property>
  2.         <name>yarn.application.classpath</name>
  3.         <value>/opt/hadoop-3.4.0/etc/hadoop:/opt/hadoop-3.4.0/share/hadoop/common/lib/*:/opt/hadoop-3.4.0/share/hadoop/common/*:/opt/hadoop-3.4.0/share/hadoop/hdfs:/opt/hadoop-3.4.0/share/hadoop/hdfs/lib/*:/opt/hadoop-3.4.0/share/hadoop/hdfs/*:/opt/hadoop-3.4.0/share/hadoop/mapreduce/*:/opt/hadoop-3.4.0/share/hadoop/yarn:/opt/hadoop-3.4.0/share/hadoop/yarn/lib/*:/opt/hadoop-3.4.0/share/hadoop/yarn/*
  4. </value>
  5.     </property>
复制代码
同时yarn-site.xml文件中要对外袒露端口，我完备的yarn-site.xml文件如下：
  1. <configuration>    <property>        <name>yarn.nodemanager.aux-services</name>        <value>mapreduce_shuffle</value>    </property>    <property>        <name>yarn.nodemanager.env-whitelist</name>        <value>JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_HOME,PATH,LANG,TZ,HADOOP_MAPRED_HOME</value>    </property>    <property>        <name>yarn.resourcemanager.address</name>        <value>node1:8032</value>    </property>    <property>        <name>yarn.resourcemanager.scheduler.address</name>        <value>node1:8030</value>    </property>    <property>        <name>yarn.resourcemanager.resource-tracker.address</name>        <value>node1:8031</value>    </property>    <property>        <name>yarn.nodemanager.memory-mb</name>        <value>4GB</value>    </property>    <property><name>yarn.nodemanager.cpu-vcores</name>        <value>4</value>    </property>   <property>
  2.         <name>yarn.application.classpath</name>
  3.         <value>/opt/hadoop-3.4.0/etc/hadoop:/opt/hadoop-3.4.0/share/hadoop/common/lib/*:/opt/hadoop-3.4.0/share/hadoop/common/*:/opt/hadoop-3.4.0/share/hadoop/hdfs:/opt/hadoop-3.4.0/share/hadoop/hdfs/lib/*:/opt/hadoop-3.4.0/share/hadoop/hdfs/*:/opt/hadoop-3.4.0/share/hadoop/mapreduce/*:/opt/hadoop-3.4.0/share/hadoop/yarn:/opt/hadoop-3.4.0/share/hadoop/yarn/lib/*:/opt/hadoop-3.4.0/share/hadoop/yarn/*
  4. </value>
  5.     </property></configuration>
复制代码
提供参考
重新start-yarn.sh
效果如下，发现乐成了：

然后访问自己的   ip地点+8088端口

发现没有问题
然后查看Browse Directory查看是否天生output文件

同时通过命令：hdfs dfs -cat /user/root/output/part-r-00000查看运行后的内容

至此，问题解决

免责声明：如果侵犯了您的权益，请联系站长，我们会及时删除侵权内容，谢谢合作！更多信息从访问主页：qidao123.com:ToB企服之家，中国第一个企服评测及商务社交产业平台。



欢迎光临 ToB企服应用市场:ToB评测及商务社交产业平台 (https://dis.qidao123.com/) Powered by Discuz! X3.4