ByteDance's groundbreaking AI model with 10 trillion parameters
Article excerpt
ByteDance, the company behind TikTok, has launched an ambitious project to create one of the largest artificial intelligence models in the world, which could contain up to 10 trillion parameters. This is reported by Finway According to sources familiar with the situation, ByteDance’s new AI model is currently undergoing preliminary training, and the final size of the model will be determined later. If the company succeeds in its plans, this system will become one of the most powerful in the world, significantly surpassing the Chinese Kimi K3 in the number of parameters - by about three times. Typically, the preliminary training of such models lasts from three to six months, after which additional tuning and system launch is planned, provided the development schedule is adhered to. For comparison, industry experts believe that the most powerful models from Anthropic have about 8 trillion parameters, although the company does not officially disclose these figures. “The number of parameters defines the basic capabilities of the model regarding information processing, but it does not guarantee better quality on its own. The effectiveness of AI is also influenced by the quality and volume of training data, training methods, system architecture, and subsequent tuning methods,” The potential 10 trillion parameters primarily indicate the scale of ByteDance’s project and...
Keep reading with a free account
The rest of this article, and every signal for ByteDance, is in your free account.
Extracted from this sentence
ByteDance is also developing its own specialized chips for artificial intelligence.
