hdfs存储
怎么查看hdfsblock大小、个数以及存储情况吗?吗?images/smilies/default/smile.gif
hdfs 的 block 块是自己配置hadoop的时候设定的
~/hadoop/conf/hdfs-site.xml
比如:
dfs.block.size
134217728
强烈建议 “怎么查看hdfsblock大小、个数以及存储情况吗?吗?” 应该作为标题 看Hadoop提供的手册
$ hadoop fsck
Usage: DFSck[-move | -delete | -openforwrite] [-files [-blocks [-locations | -racks]]]
start checking from this path
-move move corrupted files to /lost+found
-delete delete corrupted files
-filesprint out files being checked
-openforwrite print out files opened for write
-blocks print out block report
-locations print out locations for every block
-racksprint out network topology for data-node locations
By default fsck ignores files opened for write, use -openforwrite to report such files. They are usuallytagged CORRUPT or HEALTHY depending on their block allocation status
Generic options supported are
-conf specify an application configuration file
-D use value for given property
-fs specify a namenode
-jt specify a job tracker
-files specify comma separated files to be copied to the map reduce cluster
-libjars specify comma separated jar files to include in the classpath.
-archives specify comma separated archives to be unarchived on the compute machines.
The general command line syntax is
bin/hadoop command 可以通过:http://namenode:50070 (你自己的namenode)
然后点击livenode——选择某一个node——user——....最后可以看到你上传的文件,就可以看到备份信息,还有块大小信息
页:
[1]