基于docker搭建hadoop集群环境中遇到的一些问题

最新推荐文章于 2025-03-19 16:53:45 发布

rznice

最新推荐文章于 2025-03-19 16:53:45 发布

阅读量3.2k

点赞数 1

分类专栏： docker

本文链接：https://blog.csdn.net/rznice/article/details/52219909

版权

本文详述了使用Docker构建Hadoop集群过程中遇到的挑战，包括网络配置、数据持久化和跨容器通信等问题，并提供了解决方案。通过实践，总结了在Docker环境下设置Hadoop集群的关键步骤，帮助读者理解和规避潜在问题。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

   hadoop的参数环境配置完毕后，运行hadoop出现下图的提示：

[root@hadoop0 hadoop]# hadoop
/usr/app/hadoop/bin/hadoop: line 20: which: command not found
dirname: missing operand
Try 'dirname --help' for more information.
/usr/app/hadoop/bin/hadoop: line 27: /usr/app/hadoop/../libexec/hadoop-config.sh: No such file or directory
Usage: hadoop [--config confdir] [COMMAND | CLASSNAME]
  CLASSNAME            run the class named CLASSNAME
 or
  where COMMAND is one of:
  fs                   run a generic filesystem user client
  version              print the version
  jar <jar>            run a jar file
                       note: please use "yarn jar" to launch
                             YARN applications, not this command.
  checknative [-a|-h]  check native hadoop and compression libraries availability
  distcp <srcurl> <desturl> copy file or directories recursively
  archive -archiveName NAME -p <parent path> <src>* <dest> create a hadoop archive
  classpath            prints the class path needed to get the
  credential           interact with credential providers
                       Hadoop jar and the required libraries
  daemonlog            get/set the log level for each daemon
  trace                view and modify Hadoop tracing settings

Most commands print help when invoked w/o parameters.

 出现which命令无法识别，那么安装一下which就可以；

[root@hadoop0 bin]# yum install which
[root@hadoop0 bin]# hadoop
Usage: hadoop [--config confdir] [COMMAND | CLASSNAME]
  CLASSNAME            run the class named CLASSNAME
 or
  where COMMAND is one of:
  fs                   run a generic filesystem user client
  version              print the version
  jar <jar>            run a jar file
                       note: please use "yarn jar" to launch
                             YARN applications, not this command.
  checknative [-a|-h]  check native hadoop and compression libraries availability
  distcp <srcurl> <desturl> copy file or directories recursively
  archive -archiveName NAME -p <parent path> <src>* <dest> create a hadoop archive
  classpath            prints the class path needed to get the
  credential           interact with credential providers
                       Hadoop jar and the required libraries
  daemonlog            get/set the log level for each daemon
  trace                view and modify Hadoop tracing settings

Most commands print help when invoked w/o parameters.

 查看docker中容器的IP地址

[root@localhost Desktop]# docker inspect --format='{
   {.N

最低0.47元/天解锁文章