r/MachineLearning
Carbon-X is an open 14.8B model trained jointly on DNA and text [R]
- upvotes
- 44
- comments
- 1
Post
Highlighted: the lines this signal was extracted from
Carbon-X is a 14.8B parameter decoder-only model that takes raw DNA in a normal chat and answers in English. It shares one token stream for text and DNA, using 6-mer tokens, and was mid-trained on 302B tokens. Hugging Face reports a 66.7% average across five DNA benchmarks with thinking disabled, versus 67.5% for GPT-6.1 Sol. The weights fit on one 80 GB GPU in bfloat16 and are Apache 2.0. It has not been clinically validated, and the model card says exact sequence operations should still be handled by code. the useful part is making sequence analysis local enough for sensitive datasets. has anyone tested whether the benchmark gains hold on private variant datasets? source: https://huggingface.co/HuggingFaceBio/Carbon-X