sq331335144 发表于 2013-10-25 10:44:03

hdfs存储

怎么查看hdfsblock大小、个数以及存储情况吗?吗?
images/smilies/default/smile.gif

kaif22 发表于 2013-10-25 10:44:03

hdfs 的 block 块是自己配置hadoop的时候设定的
~/hadoop/conf/hdfs-site.xml
比如:
      dfs.block.size
      134217728

datong838 发表于 2013-10-25 10:44:03

强烈建议 “怎么查看hdfsblock大小、个数以及存储情况吗?吗?” 应该作为标题

lxs_huntingjob 发表于 2013-10-25 10:44:03

看Hadoop提供的手册
$ hadoop fsck
Usage: DFSck[-move | -delete | -openforwrite] [-files [-blocks [-locations | -racks]]]
          start checking from this path
      -move   move corrupted files to /lost+found
      -delete delete corrupted files
      -filesprint out files being checked
      -openforwrite   print out files opened for write
      -blocks print out block report
      -locations      print out locations for every block
      -racksprint out network topology for data-node locations
                By default fsck ignores files opened for write, use -openforwrite to report such files. They are usuallytagged CORRUPT or HEALTHY depending on their block allocation status
Generic options supported are
-conf      specify an application configuration file
-D             use value for given property
-fs       specify a namenode
-jt   specify a job tracker
-files   specify comma separated files to be copied to the map reduce cluster
-libjars   specify comma separated jar files to include in the classpath.
-archives   specify comma separated archives to be unarchived on the compute machines.
The general command line syntax is
bin/hadoop command

mexiang 发表于 2013-10-25 10:44:03

可以通过:http://namenode:50070            (你自己的namenode)
然后点击livenode——选择某一个node——user——....最后可以看到你上传的文件,就可以看到备份信息,还有块大小信息
页: [1]
查看完整版本: hdfs存储