hive执行命令卡住，求解

本帖最后由 Smile鹏鹏于 2017-4-28 09:00 编辑

QQ图片20170428084943.png

大神们帮忙看一下，我这个执行select count(*) from XX 之后就卡在这里不动了，我也按照网上各种方法改xml文件了，但是还是卡在这里，hadoop那里也是，但是在eclipse里run as application或者run as hadoop 都是可以出结果的，只要在虚拟机中直接命令都会卡住，hadoop的卡在job什么的那里linux在虚拟机上，eclipse在物理机上日志中没有相关的ERROR信息

arsenduan · 发表于 2017-4-28 09:20:26

本帖最后由 arsenduan 于 2017-4-28 09:23 编辑

在shell中执行，卡住肯定有错误日志的。
是不是内存不够了

tanxl · 发表于 2017-4-28 09:21:17

启动hive 不是得启动zookeeper 嘛你好像没启动zookeeper

Smile鹏鹏 · 发表于 2017-4-28 09:44:04

arsenduan 发表于 2017-4-28 09:20
在shell中执行，卡住肯定有错误日志的。
是不是内存不够了

内存应该是够得，物理机8G master给分了2G 3个slave都是512m

Smile鹏鹏 · 发表于 2017-4-28 09:44:39

tanxl 发表于 2017-4-28 09:21
启动hive 不是得启动zookeeper 嘛你好像没启动zookeeper

我是跟着教程走的，我看教程里并没有启动

Smile鹏鹏 · 发表于 2017-4-28 09:47:18

2017-04-28 09:29:24,744 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: there are no corrupt file blocks.
2017-04-28 09:29:24,747 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command delete is: 0
2017-04-28 09:29:24,747 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command create is: 0
2017-04-28 09:29:24,747 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command setPermission is: 0
2017-04-28 09:29:24,748 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command * is: 0
2017-04-28 09:29:24,748 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command getEZForPath is: 0
2017-04-28 09:29:24,748 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command mkdirs is: 0
2017-04-28 09:29:24,748 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command setReplication is: 0
2017-04-28 09:29:24,748 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command listStatus is: 0
2017-04-28 09:29:24,748 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command getfileinfo is: 0
2017-04-28 09:29:24,750 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command delete is: 1
2017-04-28 09:29:24,751 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command create is: 0
2017-04-28 09:29:24,751 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command setPermission is: 0
2017-04-28 09:29:24,751 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command * is: 1
2017-04-28 09:29:24,751 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command getEZForPath is: 0
2017-04-28 09:29:24,751 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command mkdirs is: 0
2017-04-28 09:29:24,751 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command setReplication is: 0
2017-04-28 09:29:24,751 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command listStatus is: 0
2017-04-28 09:29:24,752 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command getfileinfo is: 1
2017-04-28 09:29:24,752 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command delete is: 0
2017-04-28 09:29:24,752 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command create is: 0
2017-04-28 09:29:24,752 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command setPermission is: 0
2017-04-28 09:29:24,752 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command * is: 0
2017-04-28 09:29:24,752 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command getEZForPath is: 0
2017-04-28 09:29:24,752 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command mkdirs is: 0
2017-04-28 09:29:24,752 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command setReplication is: 0
2017-04-28 09:29:24,752 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command listStatus is: 0
2017-04-28 09:29:24,752 INFO org.apache.hadoop.hdfs.server.namenode.top.window.RollingWindowManager: topN size for command getfileinfo is: 0
2017-04-28 09:32:21,981 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2 Total time for transactions(ms): 0 Number of transactions batched in Syncs: 0 Number of syncs: 2 SyncTimes(ms): 59
2017-04-28 09:32:38,164 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* allocate blk_1073741920_1096{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} for /tmp/hive/root/1b960d81-e0d6-4ac1-9804-5802e6a84b23/hive_2017-04-28_09-32-34_823_7284094685542205896-1/-mr-10005/b64b600b-d77d-4d0b-9c08-868b84c5dcda/map.xml
2017-04-28 09:32:39,304 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.22:50010 is added to blk_1073741920_1096{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:39,327 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.23:50010 is added to blk_1073741920_1096{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:39,354 INFO org.apache.hadoop.hdfs.StateChange: DIR* completeFile: /tmp/hive/root/1b960d81-e0d6-4ac1-9804-5802e6a84b23/hive_2017-04-28_09-32-34_823_7284094685542205896-1/-mr-10005/b64b600b-d77d-4d0b-9c08-868b84c5dcda/map.xml is closed by DFSClient_NONMAPREDUCE_-1642700333_1
2017-04-28 09:32:39,376 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Increasing replication from 2 to 10 for /tmp/hive/root/1b960d81-e0d6-4ac1-9804-5802e6a84b23/hive_2017-04-28_09-32-34_823_7284094685542205896-1/-mr-10005/b64b600b-d77d-4d0b-9c08-868b84c5dcda/map.xml
2017-04-28 09:32:39,432 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* allocate blk_1073741921_1097{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} for /tmp/hive/root/1b960d81-e0d6-4ac1-9804-5802e6a84b23/hive_2017-04-28_09-32-34_823_7284094685542205896-1/-mr-10005/b64b600b-d77d-4d0b-9c08-868b84c5dcda/reduce.xml
2017-04-28 09:32:39,475 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.22:50010 is added to blk_1073741921_1097{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:39,482 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.23:50010 is added to blk_1073741921_1097{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:39,486 INFO org.apache.hadoop.hdfs.StateChange: DIR* completeFile: /tmp/hive/root/1b960d81-e0d6-4ac1-9804-5802e6a84b23/hive_2017-04-28_09-32-34_823_7284094685542205896-1/-mr-10005/b64b600b-d77d-4d0b-9c08-868b84c5dcda/reduce.xml is closed by DFSClient_NONMAPREDUCE_-1642700333_1
2017-04-28 09:32:39,490 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Increasing replication from 2 to 10 for /tmp/hive/root/1b960d81-e0d6-4ac1-9804-5802e6a84b23/hive_2017-04-28_09-32-34_823_7284094685542205896-1/-mr-10005/b64b600b-d77d-4d0b-9c08-868b84c5dcda/reduce.xml
2017-04-28 09:32:40,523 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* allocate blk_1073741922_1098{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} for /tmp/hadoop-yarn/staging/root/.staging/job_1493339600208_0002/job.jar
2017-04-28 09:32:43,321 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.22:50010 is added to blk_1073741922_1098{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:43,325 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.23:50010 is added to blk_1073741922_1098{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:43,329 INFO org.apache.hadoop.hdfs.StateChange: DIR* completeFile: /tmp/hadoop-yarn/staging/root/.staging/job_1493339600208_0002/job.jar is closed by DFSClient_NONMAPREDUCE_-1642700333_1
2017-04-28 09:32:43,332 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Increasing replication from 2 to 10 for /tmp/hadoop-yarn/staging/root/.staging/job_1493339600208_0002/job.jar
2017-04-28 09:32:43,419 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: Increasing replication from 2 to 10 for /tmp/hadoop-yarn/staging/root/.staging/job_1493339600208_0002/job.split
2017-04-28 09:32:43,424 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* allocate blk_1073741923_1099{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7907a5e4-c0f2-41a0-be7d-2b804e8445fc:NORMAL:192.168.22.21:50010|RBW], ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} for /tmp/hadoop-yarn/staging/root/.staging/job_1493339600208_0002/job.split
2017-04-28 09:32:43,503 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.22:50010 is added to blk_1073741923_1099{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7907a5e4-c0f2-41a0-be7d-2b804e8445fc:NORMAL:192.168.22.21:50010|RBW], ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:43,503 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.23:50010 is added to blk_1073741923_1099{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7907a5e4-c0f2-41a0-be7d-2b804e8445fc:NORMAL:192.168.22.21:50010|RBW], ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:43,504 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.21:50010 is added to blk_1073741923_1099{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7907a5e4-c0f2-41a0-be7d-2b804e8445fc:NORMAL:192.168.22.21:50010|RBW], ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:43,511 INFO org.apache.hadoop.hdfs.StateChange: DIR* completeFile: /tmp/hadoop-yarn/staging/root/.staging/job_1493339600208_0002/job.split is closed by DFSClient_NONMAPREDUCE_-1642700333_1
2017-04-28 09:32:43,524 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* allocate blk_1073741924_1100{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7907a5e4-c0f2-41a0-be7d-2b804e8445fc:NORMAL:192.168.22.21:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} for /tmp/hadoop-yarn/staging/root/.staging/job_1493339600208_0002/job.splitmetainfo
2017-04-28 09:32:43,551 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.22:50010 is added to blk_1073741924_1100{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7907a5e4-c0f2-41a0-be7d-2b804e8445fc:NORMAL:192.168.22.21:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:43,552 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.21:50010 is added to blk_1073741924_1100{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7907a5e4-c0f2-41a0-be7d-2b804e8445fc:NORMAL:192.168.22.21:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:43,556 INFO org.apache.hadoop.hdfs.StateChange: DIR* completeFile: /tmp/hadoop-yarn/staging/root/.staging/job_1493339600208_0002/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_-1642700333_1
2017-04-28 09:32:43,648 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* allocate blk_1073741925_1101{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} for /tmp/hadoop-yarn/staging/root/.staging/job_1493339600208_0002/job.xml
2017-04-28 09:32:43,720 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.22:50010 is added to blk_1073741925_1101{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:43,722 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.23:50010 is added to blk_1073741925_1101{UCState=UNDER_CONSTRUCTION, truncateBlock=null, primaryNodeIndex=-1, replicas=[ReplicaUC[[DISK]DS-7d6bcd55-bfab-40b7-a571-a1466df433ac:NORMAL:192.168.22.23:50010|RBW], ReplicaUC[[DISK]DS-df7aa8ca-8d54-4310-bc12-50dc94039607:NORMAL:192.168.22.22:50010|RBW]]} size 0
2017-04-28 09:32:43,727 INFO org.apache.hadoop.hdfs.StateChange: DIR* completeFile: /tmp/hadoop-yarn/staging/root/.staging/job_1493339600208_0002/job.xml is closed by DFSClient_NONMAPREDUCE_-1642700333_1
2017-04-28 09:32:46,573 INFO BlockStateChange: BLOCK* ask 192.168.22.22:50010 to replicate blk_1073741920_1096 to datanode(s) 192.168.22.21:50010
2017-04-28 09:32:46,574 INFO BlockStateChange: BLOCK* ask 192.168.22.23:50010 to replicate blk_1073741921_1097 to datanode(s) 192.168.22.21:50010
2017-04-28 09:32:46,574 INFO BlockStateChange: BLOCK* ask 192.168.22.23:50010 to replicate blk_1073741922_1098 to datanode(s) 192.168.22.21:50010
2017-04-28 09:32:47,097 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.21:50010 is added to blk_1073741921_1097 size 3904
2017-04-28 09:32:47,221 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.21:50010 is added to blk_1073741920_1096 size 3630
2017-04-28 09:32:49,303 INFO BlockStateChange: BLOCK* addStoredBlock: blockMap updated: 192.168.22.21:50010 is added to blk_1073741922_1098 size 32441258
----------------------------------------------------------------------------------------------------------------------
2017-04-28 09:22:13,989 INFO org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Image has changed. Downloading updated image from NN.
2017-04-28 09:22:14,265 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Opening connection to http://master:50070/imagetransfer?getimage=1&txid=941&storageInfo=-63:1216314252:0:CID-38271d67-810b-4903-9993-58414cc2db74
2017-04-28 09:22:14,318 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Image Transfer timeout configured to 60000 milliseconds
2017-04-28 09:22:14,604 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Transfer took 0.01s at 1166.67 KB/s
2017-04-28 09:22:14,605 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Downloaded file fsimage.ckpt_0000000000000000941 size 8180 bytes.
2017-04-28 09:22:14,613 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Opening connection to http://master:50070/imagetransfer?getedit=1&startTxId=942&endTxId=1000&storageInfo=-63:1216314252:0:CID-38271d67-810b-4903-9993-58414cc2db74
2017-04-28 09:22:14,620 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Transfer took 0.00s at 3500.00 KB/s
2017-04-28 09:22:14,620 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Downloaded file edits_tmp_0000000000000000942-0000000000000001000_0000000000003628124 size 0 bytes.
2017-04-28 09:22:14,700 INFO org.apache.hadoop.hdfs.server.namenode.FSImageFormatPBINode: Loading 113 INodes.
2017-04-28 09:22:14,787 INFO org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf: Loaded FSImage in 0 seconds.
2017-04-28 09:22:14,787 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Loaded image for txid 941 from /var/hadoop/dfs/namesecondary/current/fsimage_0000000000000000941
2017-04-28 09:22:14,787 INFO org.apache.hadoop.hdfs.server.namenode.NameCache: initialized with 0 entries 0 lookups
2017-04-28 09:22:14,795 INFO org.apache.hadoop.hdfs.server.namenode.Checkpointer: Checkpointer about to load edits from 1 stream(s).
2017-04-28 09:22:14,800 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading /var/hadoop/dfs/namesecondary/current/edits_0000000000000000942-0000000000000001000 expecting start txid #942
2017-04-28 09:22:14,800 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file /var/hadoop/dfs/namesecondary/current/edits_0000000000000000942-0000000000000001000
2017-04-28 09:22:14,877 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file /var/hadoop/dfs/namesecondary/current/edits_0000000000000000942-0000000000000001000 of size 8072 edits # 59 loaded in 0 seconds
2017-04-28 09:22:14,939 INFO org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Going to retain 2 images with txid >= 941
2017-04-28 09:22:14,939 INFO org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Purging old image FSImageFile(file=/var/hadoop/dfs/namesecondary/current/fsimage_0000000000000000885, cpktTxId=0000000000000000885)
2017-04-28 09:22:14,939 INFO org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Purging old image FSImageFile(file=/var/hadoop/dfs/namesecondary/current/fsimage_0000000000000000755, cpktTxId=0000000000000000755)
2017-04-28 09:22:15,000 INFO org.apache.hadoop.hdfs.server.namenode.TransferFsImage: Uploaded image with txid 1000 to namenode at http://master:50070 in 0.039 seconds
2017-04-28 09:22:15,000 WARN org.apache.hadoop.hdfs.server.namenode.SecondaryNameNode: Checkpoint done. New Image Size: 8543
------------------------------------------------------------------
2017-04-28 09:32:40,203 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 2
2017-04-28 09:32:43,995 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 2 submitted by user root
2017-04-28 09:32:43,995 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=root IP=192.168.22.20 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1493339600208_0002
2017-04-28 09:32:43,995 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1493339600208_0002
2017-04-28 09:32:43,996 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1493339600208_0002 State change from NEW to NEW_SAVING
2017-04-28 09:32:43,996 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1493339600208_0002
2017-04-28 09:32:43,996 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1493339600208_0002 State change from NEW_SAVING to SUBMITTED
2017-04-28 09:32:43,997 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_1493339600208_0002 user: root leaf-queue of parent: root #applications: 1
2017-04-28 09:32:43,997 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_1493339600208_0002 from user: root, in queue: default
2017-04-28 09:32:44,000 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1493339600208_0002 State change from SUBMITTED to ACCEPTED
2017-04-28 09:32:44,000 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_1493339600208_0002_000001
2017-04-28 09:32:44,001 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1493339600208_0002_000001 State change from NEW to SUBMITTED
2017-04-28 09:32:44,001 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start
2017-04-28 09:32:44,001 WARN org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start
2017-04-28 09:32:44,001 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1493339600208_0002 from user: root activated in queue: default
2017-04-28 09:32:44,001 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application added - appId: application_1493339600208_0002 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@9cfeab4, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2017-04-28 09:32:44,001 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Added Application Attempt appattempt_1493339600208_0002_000001 to scheduler from user root in queue default
2017-04-28 09:32:44,002 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1493339600208_0002_000001 State change from SUBMITTED to SCHEDULED
2017-04-28 09:33:07,212 WARN org.apache.hadoop.yarn.server.webapp.AppBlock: Container with id 'container_1493339600208_0002_01_000001' doesn't exist in RM.
2017-04-28 09:34:56,370 INFO logs: Aliases are enabled
2017-04-28 09:37:57,445 WARN org.apache.hadoop.yarn.server.webapp.AppBlock: Container with id 'container_1493339600208_0002_01_000001' doesn't exist in RM.
2017-04-28 09:38:46,039 INFO org.apache.hadoop.http.HttpServer2: Process Thread Dump: jsp requested