We are running into similar issue similar to below issue.
Pondering whether to go with single cluster span across 3-4 data centers and go with each cluster dedicated to local DC. Each one has its own pros and cons but multiple clusters approach creating more management/operational overhead to both platform and client teams.
Why we hating multiple clusters approach?
I heard master place also can’t span across data centers, particularly etcd due to its latency requirements, to be co related in same location. Is it a still a problem if data centers are connected with decent network infra?
We are OK to restrict master and etcd to a single data center if latency as an issue but love to spin these components also across DC’s for high performance and fault tolerance.
Interested to hear what is the best reference architecture for multiple data centers or how people are dealing when they ran into similar situation?
Any comments or suggestions are highly appreciated.