The embedded logic chip will allow users to write their own AI models according to their requirements.
Sony has announced it has developed the world’s first image sensor equipped with artificial intelligence (AI) processing.
By: Campbell Kwan | ZDnet.
The new image sensor has a configuration consisting of a pixel chip and logic chip. The logic chip, called Sony’s digital signal processor (DSP), is dedicated to AI signal processing, along with memory for the AI model.
According to Sony, the DSP eliminates the need for additional hardware, such as high-performance processors or external memory, making it “ideal for edge AI systems”.
By using AI, Sony said the sensor is also able to output metadata — semantic information belonging to image data — instead of image information, which reduces data volume and addresses privacy concerns. For practical applications, Sony said the logic chip within the image sensor allows it to send data for each individual output image frame for AI processing within a single video frame.
“This design makes it possible to deliver high-precision, real-time tracking of objects while recording video,” Sony said.
Read the full article here.
