US patent US12748798
Prompt generation for generative artificial intelligence models
Abstract
A computer-implemented method for generating a prompt for a generative machine learning model is described. A user text prompt is encoded by an encoder implementing an encoding process, into a text embedding. The encoded text prompt is used to identify text embeddings in a vector database. The text embeddings in the vector database correspond to training captions used to train the generative machine learning model encoded using the encoding process. The identified text embeddings are used to generate a modified prompt. A large language model may be used to generate the modified prompt based on the identified text embeddings. The modified prompt may be passed to a generative machine learning model to generate media or one or more digital assets, such as a text-to-image machine learning model to generate one or more images.