MediaTek chip with Meta’s Llama 2 for on-device generative AI coming soon

Taiwanese chipmaker MediaTek on Thursday announced it is working with Meta’s open-source large language model Llama 2 to build an edge computing ecosystem to accelerate artificial intelligence application development on smartphones, IoT device, vehicles, and other edge devices. MediaTek said it expects Llama 2-based AI applications to become available for smartphones powered by its next-generation flagship system-on-chip, which is scheduled to hit the market by the end of the year.

“Presently, most Generative AI processing is performed through cloud computing; however, MediaTek’s use of Llama 2 models will enable generative AI applications to run directly on-device as well.