This paper proposes viewing large language model (LLM) teams through the lens of distributed systems to create a principled framework for their design and evaluation. It reveals that many established advantages and challenges from distributed computing, such as scalability limits and coordination issues, directly apply to and explain the behavior of LLM teams.