Neural Processing Units come of age at the edge.

Intel NPUs meet the challenge of delivering local AI PC capabilities.

This workshop demystifies Intel NPUs providing examples with large language models (LLMs) and case studies. The fundamental architecture of NPUs is explained, and the capabilities of the technology revealed, offering a clear picture of the role of neural processors in an AI system and the acceleration benefits.

Real-world examples show how AI applications integrate LLMs with Intel NPUs, including Chatbot, Retrieval Augmented Generation (RAG), Stable Diffusion, and Speech 2 Text. Developers gain insights into how this technology improves performance and efficiency, allowing AI operations to be performed effectively on PCs rather than the cloud.

Areas covered in the workshop include:

Understanding the fundamentals of Intel NPUs and the acceleration offered by Intel® Core™ Ultra processors
Learning the significance of LLMs
Creating rapid prototypes with the Intel NPU Acceleration Library
Building LLM system partitions and applications
Leveraging OpenVINO and the NPU plugin for enhanced performance

Hands-on demonstrations of these techniques require an Intel® Tiber™ Developer Cloud account. If you don’t have one, get one here.

Novice developers as well as experienced professionals interested in NPUs will benefit from this workshop.

Welcome back Not you?

First Name

Please enter a first name.

First name must be at least 2 characters long.

First name must be less than 250 characters long.

Please enter a first name.

Last Name

Please enter a last name.

Last name must be at least 2 characters long.

Last name must be less than 250 characters long.

Please enter a last name.

Business Email Address

Please enter an email address.

Please enter a valid email address.

Email Address must be less than 250 characters.

Country/Region

Please select a country/region.

Your registration cannot proceed. The materials on this site are subject to U.S. and other applicable export control laws and are not accessible from all locations.

Profession

Please select a profession.

Business Phone

Please enter a business phone.

Business phone must be at least 2 characters long.

Business phone must be less than 250 characters long.

Please enter a business phone.

Please enter a valid business phone.

Company

Please enter a company name.

Company name must be at least 2 characters long.

Company name must be less than 250 characters long.

Please enter a company name.

What type of developer are you?*

Please select a developer role.

Development Language (select all that apply)*

Please select a development language.

Which hardware and accelerator architectures are you developing for? (select all that apply)*

Please select at least one option.

Industry *

Please select an industry.

What operating systems do you develop for/on? (select all that apply)*

Please select at least one operating system.

Intel strives to provide you with a great, personalized experience, and your data helps us to accomplish this.

I consent to Intel collecting and using my personal information as described below.

Above consent required for submission.

I expressly consent to Intel transferring my Personal Data outside of China to Intel U.S. headquarters as described in the Intel Privacy Notice Supplement for Users in China.

Above consent required for submission.

Intel may contact you for marketing-related communications. You can opt out at any time.

By submitting this form, you are confirming you are age 18 years or older. Intel may contact you for marketing-related communications. You can opt out at any time. To learn more about Intel's practices, including how to manage your preferences and settings, visit Intel's Privacy Notice.

By submitting this form, you are confirming you are age 18 years or older. Intel will process your Personal Data for the purpose of this business request. To learn more about Intel's practices, including how to manage your preferences and settings, visit Intel's Privacy Notice.

Using Intel® NPUs to Prototype and Deploy Large Language Models

Intel NPUs meet the challenge of delivering local AI PC capabilities.

Speakers

Alessandro Palla

Soumendu Ghosh