Anshu is the founder and CEO of ThirdAI (pronounced third eye) , a cutting-edge startup carving scalable and sustainable AI. Instead of trying to make it more efficient by throwing huge amounts of computing power at it, Anshu wants to rethink the fundamentals of AI itself in an effort to make it cheaper and more widely used. ThirdAI builds hash-based processing algorithms that accelerate training and inference of neural networks. The technology is a result of 10 years of innovation in finding fundamental ways to make deep learning more efficient.
He's currently an associate professor of computer science at Rice University. Previously, he was Amazon Visiting Academic at AWS, and machine learning consultant at Blackstone. Anshu earned a PhD in Computer Science from Cornell University.
This is arguably the most exciting time if you are working in efficiency and trying to make LLMs efficient. LLMs have stunned us with their capability. Enterprises want to give large language models a chance to tackle their hardest problems. And efficiency is going to play a key role here because AI is all about scale and the cost.
We are at a point where basic dense matrix multiplication becomes prohibitive for model and dataset sizes, even with a co-evolving software and hardware ecosystem.
We are building the capabilities to bring every core of CPUs out there to better the AI for the masses. We can democratize AI with CPUs.
It’s time for the humble CPU to conquer AI again. That’s the
The fascination with generative AI has spring-loaded demand for products that can help deliver on its promise. And startups are primed to pounce. ‘There’s new openings for attack,’ says one venture capitalist.
ThirdAI CEO and Founder, Dr. Anshumali Shrivastava takes a look at the technology, algorithms,and hardware that power the Generative AI movement and the realities, cost, and energy that it will take for generative AI to be trulyaccessible to all