We have two very large files each nearly 100GB in size. We need to design a system to compare those two files efficiently, on comparison write the differences to a file. The files maybe present on different servers/filesystems.

Any suggestions?