KAIST researchers develop world's first 'neuromorphic' AI chip

https://koreajoongangdaily.joins.com/news/2024-03-07/business/tech/KAIST-researchers-develop-worlds-first-neuromorphic-AI-chip/1996289

KAIST researchers develop world's first 'neuromorphic' AI chip

 

A research team at KAIST has developed the world's first AI semiconductor capable of processing a large language model(LLM) with ultra-low power consumption using neuromorphic computing technology.

 

The technology aims to develop integrated circuits mimiking the human nervous system so that chips could be able to perform more sophisticated tasks that require adaption and reasoning with far less energy consumption.

 

The Science Ministry said Wednesday that the team, led by Prof. Yoo Hoi-jun at the KAIST PIM Semiconductor Research Center, developed a 'Complementary-Transformer' AI chip, which processes GPT-2 with an ultra-low power consumption of 400 milliwatts and a high speed of 0.4 seconds, according to the Ministry of Science and ICT.

 

The 4.5-millimeter-square chip, developed using Korean tech giant Samsung Electronics' 28 nonometer process, has 625 time less power consumption compared with global AI chip giant Nvidia's A-100 GPU, which requires 250 watts of power to process LLMs, the ministry explained.

 

The chip is also 41 times smaller in area than Nvidia model, enabling it to be used on devices like mobile phones, therefore better protecting user privacy.

 

The KAIST team has succeeded in demonstrating various language processing tasks with its LLM accelerator on Samsung's latestsmartphone model, the Galaxy S24, whici is the world's first smartphone model with on-device AI, featuring real=time translation for phone calls and improved camera performance, Kim Sang-yeob, a reearcher on the team, told reporters in a press briefing.

 

The ministry said the utilization of neuromorphic computing technology, which functions like a human brain, specifically spiking neural networks(SNNs), is essential to the achievement.

 

Previously, the technology was less accurate than deep neural networks(DNNs) and mainly capable of simplr image classifications, but the research team succeeded in improving the accuracy of the technology to match that of DNNs to apply it to LLMs.

 

The team said its new AI chip optimizes computational energy consumption while maintaining acuuracy by using unique neural network architecture that fuses DNNs and SNNs and effectively compresses the large parameters of LLMs.

 

'Neuromorphic computing is a technology global tech giants, like IBM and Intel, failed to realize. We believe we are the first to run an LLM with a ultra-low power neuromorphic accelerator." Yoo said.

 

 

 

integrated: 통합적인

complementary: 상호보완적

demonstrate: 입증하다, 증거를 보여주다

SNNs: 스파이킹 신경망

accurate: 정확한, 정밀한

fuse: 융합하다