OpenAI Considers Own AI Chips Amidst Shortages

OpenAI, known for its brainchild ChatGPT, has a new idea on the horizon: making its own AI chips. Sources tell Reuters that OpenAI wants specific technology which is currently scarce. This move could hint at a growing distance from its long-time ally, Microsoft.

Why AI Chips Matter Now


OpenAI鈥檚 decision to possibly craft their AI chips stems from the current digital age鈥檚 needs. AI chips, such as the coveted Nvidia鈥檚 H100, play a central role in driving advancements in artificial intelligence. These chips make it feasible for large language models like ChatGPT to operate and learn. With a soaring demand and a limited supply, OpenAI鈥檚 consideration becomes even more understandable.

The global race to secure these chips has intensified. Leading companies like Meta and Microsoft have already started thinking about producing their alternatives. Should OpenAI join this movement, it might find a way to cut costs, especially when running expansive projects like ChatGPT.

This path isn鈥檛 without its hurdles. Making chips requires time, money, and expertise. Alex White from SambaNova Systems commented, 鈥淲hile OpenAI鈥檚 interest in hardware is expected, producing chips is neither fast nor easy.鈥

The steps OpenAI takes next could reshape the AI industry鈥檚 fabric, affecting partnerships, costs, and advancements.

AI Chips: The New Gold


According to reports from Reuters, OpenAI鈥檚 curiosity in making these chips stems from a technology gap. They鈥檙e even considering buying a chip-making firm, although a final decision is pending.

Nvidia鈥檚 H100 chip is like gold in today鈥檚 tech market. It鈥檚 pivotal for training extensive models like ChatGPT. Their limited availability has left companies like Meta and Microsoft brainstorming their alternatives.

Should OpenAI jump into this trend, they could trim the cost of operating ChatGPT. Some suggest the daily cost could be an astounding $700,000.

Sharing his thoughts, Alex White from AI startup SambaNova systems mentioned, 鈥淥penAI showing interest in the hardware side, especially chips, aligns with industry expectations. But let鈥檚 remember, making and distributing chips is neither quick nor straightforward.鈥

A Shift in the Winds for Microsoft and OpenAI?


Reports and industry gossip indicate that OpenAI and Microsoft might be charting different courses in the future. Insiders suggest Microsoft is keen on carving its path by producing its own language models.

Let鈥檚 not forget that in 2023, Microsoft poured a massive $10 billion into OpenAI. This move allowed OpenAI access to the computational strength essential for AI development. By 2020, Microsoft had even crafted a bespoke supercomputer for OpenAI, decked out with 10,000 Nvidia GPUs. This partnership also let Microsoft mesh OpenAI鈥檚 models into its offerings, particularly its search engine, Bing.

But with concerns over increasing costs, especially with models like ChatGPT, Microsoft might be eyeing more cost-effective alternatives.

The Intricacies of Chip Production


Venturing into chip production isn鈥檛 child鈥檚 play. If we consider OpenAI鈥檚 timeline, they took over five years to roll out GPT-4. Chip production could demand an equal, if not longer, commitment.

Offering an industry perspective, Josep Bori from GlobalData said, 鈥淥penAI should segregate temporary setbacks from more significant, long-term issues.鈥

In his view, collaborating with Nvidia and AMD could be a practical interim solution, even if it鈥檚 a bit pricey upfront. Additionally, Bori suggests OpenAI will likely need support from TSMC if they choose to create AI chips.

AI Chips: The Bigger Picture


The ChatGPT launch turned the spotlight on AI-specific chips, with demand skyrocketing soon after. Nvidia, a leading name in AI chips, has been at the forefront, catering to this demand.

There are also cautionary tales. Reports point to Meta鈥檚 struggles with its custom chip projects. Despite setbacks, they鈥檙e currently crafting a new generation of AI chips.

Interestingly, Microsoft鈥檚 experiments with a bespoke AI chip could be a signal of widening gaps between the two tech entities.

The industry and consumers alike are keenly watching OpenAI鈥檚 next moves. Whatever path they choose could shape the future dynamics of AI development and deployment.