When you purchase through links on our site, we may earn an affiliate commission.Heres how it works.
We also talked about AI PCs, Ryzen AI processors, and what AMD sees in its future.
This interview has been condensed and edited for clarity.
AMD Ryzen 7 vs Intel Core Ultra 7: Ryzen Mistral Intruct 7B benchmark measuring time to first token.
Impressive results, indeed.
This is really no different.
“We were the first ones with the NPU,” he continued.
AMD Ryzen 7 vs Intel Core Ultra 7: Ryzen Mistral Intruct 7B benchmark measuring time to first token.
“And then we’re the first ones to have kind of our second iteration already out and running.
In the8000 series, we have 16 [TOPS].
So it’s already 60% faster.
AMD Ryzen AI processors.
Our discussion led us to talk about the benefits of using AI PCs.
“So those are [reasons]…
I would flag to people and say, ‘Hey, this is why you want this hardware locally.’
AI PCs feature an NPU in addition to a CPU and GPU.
And that’s not to say we don’t think server AI is important.
Absolutely, it is.
And there’s going to be things that are more appropriate to run on servers.
“It is humbling to run an LLM locally and be like, ‘This is my laptop.
My laptop is that smart.
I can say things to it and it understands what I’m saying and it knows all these things.
It’s so bizarre.’
That’s so tiny.”
“…It’s a new resource too.
AMD frequently takes part in tech events.
If you think about it that way, right?
We’ve had CPUs and GPUs for years.
And it’s not like we have a slower CPU this year because we put in an NPU.
And it’s not like we have slower graphics.
“…AI isn’t just an NPU problem,” he continues.
There’s [sic] a lot of things the CPU does to also enhance your experience.
There’s also a ton of acceleration on the GPU now too.
The NPU is definitely going to come into its own in 2024.
And when that is [here] it’s going to be more integrated into your OS.
And that means your whole operating system is going to be more tied into it.”
As we continued to talk, I asked Woligroski about the future of AMD.
Specifically asking"what challenges is AMD facing right now with machine learning and AI in general?
This has made it so that the company frequently has to change tack on its plans.
Now it’s like, okay, what’s going to be taxed the most?
Where do we put our resources?
What kind of software do we optimize?
So it is just so fast-moving.
And the good news is, I can’t see it sustaining that realistically.
As time goes on, AMD will refine its hardware and bring us even better experiences.
AMD will certainly take steps to continue growth in this area for years to come.
