In CachingDirectoryFactory#close, if there are still refs for a Directory outstanding, we need to wait for them to be released before closing.

Spotted this in the replication handler test on windows.

Replication especially can hold some resources out a little after core container shutdown is called.