US patent US12744797
Egress link safety for large uncontrollable workloads in a computing infrastructure
Abstract
A cloud provider implements a safety mechanism for links associated with its infrastructure. Link safety is achieved by changing how server and network capacity information is shared by the cloud provider with a customer entity that utilizes the infrastructure. To this end, the entity is provided information about defining a “mini-cluster” that is configured from a physical server cluster, and where the mini-cluster services only one particular link. A mini-cluster has one or more servers, typically virtual machines. The egress capacity of each of the servers within a mini-cluster is capped to match a maximum link capacity that is allocated to the customer entity's traffic. By dedicating a fixed set of servers to the link and capping the total server capacity to a maximum link size defined for a given customer, traffic provided by the customer entity's software system is controlled to prevent link overload.