Networked Multi-agent Systems (NMS), such as fleets of drones, connected autonomous vehicles, or smart power-grids, consist of multiple plants, controllers, and sensors exchanging data over a shared communication network managed by a network manager. This network manager allocates communication services (CS), such as bandwidth, reliability, and latency, to each agent, enabling sensors to transmit data to their respective controllers. For optimal NMS performance, the problem must be jointly studied at the agent level and the network level. Agents need to design communication-aware controllers, while the network manager must allocate communication services in a control-aware manner. Specifically, agents must develop controllers that proactively incorporate allocated communication services, analyzing their impact on sensor data quality, timing, and resolution. Simultaneously, the network manager must dynamically allocate communication resources to meet agents' evolving needs while ensuring fairness in allocations across all agents. At its core, this problem requires developing an optimal control-communication theory to guide decision-making for both agents and the network manager. The proposal envisions enabling optimal decision-making for NMS across various domains: from enhancing coordination and cooperation in multi-robot systems to optimizing information exchange among connected and autonomous vehicles to voltage and frequency control in power-grids. With advancements in c