Intel unveils Xeon 6, Gaudi 3 AI accelerators for its data centers

Intel unveiled its updated Xeon processors along with Gaudi AI accelerators to enhance its AI infrastructure.

The Xeon 6 processors come with P-cores and are now designed to handle compute-intensive workloads with improved efficiency.

The processor features increased core count, double the memory bandwidth and AI acceleration capabilities embedded in every core. Intel claims the processor Xeon 6 delivers twice the performance of its predecessor and is engineered to meet the performance demands of AI from edge to data center and cloud environments.

The company also unveiled its Gaudi 3 Ai accelerator which it claims is specifically optimised for large-scale generative AI.

The Gaudi 3 boasts 64 Tensor processor cores (TPCs) and eight matrix multiplication engines (MMEs) to accelerate deep neural network computations.

It includes 128 gigabytes (GB) of HBM2e memory for training and inference, and 24 200 Gigabit (Gb) Ethernet ports for scalable networking. Gaudi 3 also offers seamless compatibility with the PyTorch framework and advanced Hugging Face transformer and diffuser models.

Intel recently announced a collaboration with IBM to deploy Intel Gaudi 3 AI accelerators as a service on IBM Cloud. Through this collaboration, Intel and IBM aim to lower the total cost of ownership to leverage and scale AI, while enhancing performance.

Published - September 27, 2024 01:22 pm IST

Disclaimer: The copyright of this article belongs to the original author. Reposting this article is solely for the purpose of information dissemination and does not constitute any investment advice. If there is any infringement, please contact us immediately. We will make corrections or deletions as necessary. Thank you.
You might also like