Mediatek Boosts On-device Ai With Meta's Llama 2

By Author: Ben Gross
Total Articles: 406
Comment this article

MediaTek, a leading global fabless semiconductor company powering over two billion connected edge devices annually, has partnered with Meta's Llama 2, the next-gen open-source Large Language Model (LLM). This collaboration aims to create a comprehensive edge computing ecosystem by integrating Meta's LLM with MediaTek's advanced APUs and NeuroPilot AI Platform. The goal is to accelerate AI application development for edge devices like smartphones, IoT, vehicles, and smart homes.

Unlike the conventional approach of cloud-based Generative AI processing, MediaTek's use of Llama 2 models allows generative AI applications to run directly on-device. This offers benefits like improved performance, privacy, security, lower latency, and reduced operational costs. MediaTek's 5G smartphone SoCs are equipped with APUs capable of executing various Generative AI features. The upcoming flagship chipset will feature a software stack optimized for Llama 2 and an upgraded APU, enhancing on-device Generative AI capabilities.

JC Hsu, Corporate Senior VP and GM of Wireless Communications Business Unit at MediaTek, states, "Through our partnership with Meta, we can deliver hardware and software with far more capability in the edge than ever before." MediaTek anticipates Llama 2-based AI applications to be available for smartphones with the next-gen flagship SoC by year-end.

More Information : https://www.techdogs.com/tech-news/pr-newswire/mediatek-leverages-metas-llama-2-to-enhance-on-device-generative-ai-in-edge-devices