[Lustre-discuss] e2scan

[Daire Byrne]

Mertol,

> Using e2scan will allow you to efficiently generate lists of files
> that have changed since the last rsync.  The e2scan tool is included in
> e2fsprogs at ftp://ftp.lustre.org/pub/lustre/other/e2fsprogs/testing/ but it is
> still undergoing some development.

This is why we had to go with the "rsync --dry-run --itemise-changes" method. It requires a lot of scripting, LVM snapshots and works well with a gridengine installation. 

Doing multiple rsyncs of the network filesystem may be easier for you but the counting and comparing of files is going to be very slow and I doubt you will be able trawl an 80TB filesystem within 24 hours.

Daire