US patent US12681830
Dynamic system resource-sensitive model software and hardware selection
Abstract
The systems and methods disclosed herein enable the dynamic selection of one or more AI models to generate an output in response to an input. The system receives, from a computing device, an output generation request including an input for the generation of an output using one or more models from a plurality of models. The system generates expected values for a set of output attributes of the output generation request. For each particular model in the plurality of models, the system determines the capabilities of the particular model, and dynamically select a subset of models from the plurality of models. The system dynamically selects a subset of available system resources to process the input included in the output generation request. The system generates the output by processing the input included in the output generation request using the selected subset of available system resources.