r/GithubCopilot
Will local AI keep getting cheaper, or will increasing demand cancel out the progress in hardware?
- upvotes
- 5
- comments
- 5
Post
Highlighted: the lines this signal was extracted from
I've been thinking about something and would be interested to hear the opinions of people working in the AI and hardware industry. We have Moore's Law, which basically states that computing power (or transistor density) roughly doubles every two years. On top of that, AI hardware and models are becoming increasingly efficient. My question is: will this eventually make running powerful AI models locally significantly cheaper and more accessible, or will the increasing demand for AI simply cancel out those gains? I imagine that as local AI becomes more capable, demand will also increase massively. Not just from individuals, but from companies as well. For example, I recently saw that Revolut has apparently moved its engineering team towards local AI models and is paying only around 10% of what it previously spent on Anthropic. If more companies start doing this, demand for GPUs, memory and other hardware could increase dramatically. So where does this leave us in 5-10 years? Will hardware improvements and better model efficiency consistently outpace demand, making local AI increasingly affordable? Or will demand for compute keep prices relatively high, despite the technological improvements? Could we eventually reach a point where running models locally is significantly cheaper than using cloud-based AI services for most coding and everyday tasks? I'm particularly...
Keep reading with a free account
The rest of this post, and every signal for Revolut, is in your free account.