The Ray Cluster Architecture

Training in a multi-GPU environment necessarily requires communication and coordination among the GPUs.

This post briefly records what I learned about the Ray cluster architecture.

TODO: Fill this in when I have time.

It looks as though this unfinished post will have to wait quite a while.