filesystems - Hadoop FS getFileStatus() modification time is 0 for directories

Question

I am using the getFileStatus(Path p) method of hadoop fs as following. I use the Java library in Scala. Whenever I call the method for a directory path I get modification time as 0 even though a direct child of the directory has been edited recently.

val rawStatus = fs.getFileStatus(path)

There isn't any problem calling the method for files. I am getting the correct timestamps for those.

I have tried testing this with multiple different folders on different environments (Azure and AWS). What could be the reason for this? Is this modification time value expected?

Thanks.

EDIT:I was wrong about Azure. I can get proper timestamps for Azure directories. This makes me think HDFS doesn't fully work with AWS S3 filesystem since they don't have inodes. Can someone confirm, elaborate on this?

question from:https://stackoverflow.com/questions/65888971/hadoop-fs-getfilestatus-modification-time-is-0-for-directories

Answer 1

Waitting for answers