US patent US12748715
Digital switch between chiplet devices for handling transformer workloads
Abstract
An active bridge module is present between substrates of an apparatus that accelerates AI computation workload. In response to an input, the active bridge module is configured to dynamically configure links between packages on the different substrates (e.g., PCIe cards). The active bridge module may comprise a network of digital switches. In certain embodiments, the active bridge module employs optical conversion with links comprising optical waveguides and/or optical cables. For a certain input, links can be dynamically established between packages on either of the adjacent PCIe boards (e.g., accommodating TP-4 tensor parallelism). For a different input to the module, links can be dynamically established between individual packages on each of the PCIe boards (e.g., accommodating TP-2 tensor parallelism). Embodiments are not limited to implementing parallelism of any particular degree, and can scale generally to implement parallel processing utilizing numbers of package(s) and/or their supporting substrate(s) that are greater than two.