US patent US12802682
Audio generation method, method of training model, device, and storage medium
Abstract
An audio generation method, a method of training an audio generation model, an electronic device, and a storage medium, which relate to a field of an artificial intelligence technology, in particular to fields of deep learning, large model and audio synthesis technologies. The audio generation method includes: fusing a target phoneme feature of a target text and a target semantic feature of the target text to obtain a target fusion feature; obtaining an encoding feature according to the target fusion feature, a reference fusion feature and a reference audio feature, where the reference fusion feature is obtained by fusing a reference phoneme feature of a reference text and a reference semantic feature of the reference text, and the reference audio feature is determined according to a reference audio corresponding to the reference text; and decoding the encoding feature to obtain a target audio corresponding to the target text.