hdfs - hadoop + Blocks with corrupt replicas

Question

we have HDP cluster version 2.6.4 with ambari platform

from ambari dashboard we can see Blocks with corrupt replicas with 1

and also from

$ hdfs dfsadmin -report
Configured Capacity: 57734285504512 (52.51 TB)
Present Capacity: 55002945909856 (50.02 TB)
DFS Remaining: 29594344477833 (26.92 TB)
DFS Used: 25408601432023 (23.11 TB)
DFS Used%: 46.19%
Under replicated blocks: 0
Blocks with corrupt replicas: 1    <-----------------
Missing blocks: 0
Missing blocks (with replication factor 1): 0

in order to find the corrupted file we do the following

$ hdfs fsck -list-corruptfileblocks
Connecting to namenode via http://master.sys76.com:50070/fsck?ugi=hdfs&listcorruptfileblocks=1&path=%2F
The filesystem under path '/' has 0 CORRUPT files

but as we can see above we not found the file

also we did the following in order to delete the corrupted file

 hdfs fsck / -delete

but still Blocks with corrupt replicas still remain with 1

any suggestions?

question from:https://stackoverflow.com/questions/65868895/hadoop-blocks-with-corrupt-replicas

Answer 1

Consider that replicas and blocks are two different concepts.

Try using command:

hdfs fsck / | egrep -v '^.+'

to find out more about unusual blocks.