Cloud·312 discussions

GenAI Workloads and Intel Core Ultra Enhance | Julio Herrera ViaDeiVelutini

Tags: Cloud, Hardware

Hello everyone, I’m Julio Herrera from Via Dei Vellutini, Italia. I’m looking to understand the impact of generative AI workloads on performance and efficiency in computing systems. How do Intel Core Ultra processors enhance these factors? I would appreciate any insights into the benefits and advancements these processors offer for managing generative AI tasks.

Topic

Reply To: GenAI Workloads and Intel Core Ultra Enhance | Julio Herrera ViaDeiVelutini

In reply to GenAI Workloads and Intel Core Ultra Enhance | Julio Herrera ViaDeiVelutini

Most AI is run in the cloud and on phones. For none of those two Intel processors are leading in the AI field.

Time to update that info.

In reply to GenAI Workloads and Intel Core Ultra Enhance | Julio Herrera ViaDeiVelutini

Almost all the generative a.i. apps are in some cloud where there are banks of a.i. processors.

Example: For anyone curious, it took 2048 A100 GPUs to train LLaMa, each GPU costs roughly $15k.

So no, they don’t use Intel Core Ultra’s.

[Author]

Replies