Set up a couple of users to handle rsync of cache files between the servers and got it working with ssh etc.
If the cache has a structure similar to:
/vo/1/2/3/4/1234001/files
Running rsync with just /vo/ might be quite painful if it has to traverse everything to work out what has changed. Perhaps I will need to look at triggering rsync as soon as a new set of files has been created at running it at the level of: /vo/1/2/3/4/1234001/
That should decrease the time taken for cache to be available on both servers and reduce traversal overhead.
No comments:
Post a Comment