Data transmission from image sensors to AP

Sony Develops the World's First CMOS Image Sensor Capable of Multiple Sensor Connection to a Single MIPI Input Port for Sensing Applications

Data transmission from image sensors to AP

Data transmission from image sensors to AP

SHARE:





October 22, 2018

Tokyo, Japan—Sony Corporation today announced that it has developed the IMX418 CMOS image sensor for sensing applications. The new sensor is equipped with a global shutter function and comes with an interface capable of multiple sensor connection on a single Mobile Industry Processor Interface (MIPI) input port, a world-first made possible by Sony's original data transmission technology. Because this interface enables data transmission that supports the MIPI standard, data can be received by existing application processors (AP). Sony expects this product to find application in a variety of products that use multiple image sensors. These include head mounted displays (HMD), drones, autonomous robots and other products that perform simultaneous localization and mapping (SLAM) and obstacle detection based on information obtained with image sensors.

IMX418 CMOS image sensor
IMX418 CMOS image sensor (Left: chip, right: chip sized package)

In normal situations, image sensors and the AP that processes the images captured with those image sensors are connected via MIPI, requiring a MIPI input port for each image sensor. When designing devices equipped with multiple image sensors for sensing capabilities, this makes for various constraints in terms of the design of flexible print boards, due to the need for extra wiring and MIPI input ports for the AP.

Sony’s new sensor is equipped with an interface capable of connecting multiple sensors to the same wiring and transferring the image data that was simultaneously captured and recorded on multiple sensors in sequence to a single AP MIPI input port. This makes it possible not only to reduce wiring but also to connect more image sensors than the number of available MIPI input ports.

The new product builds on the advantages of Sony’s CMOS image sensor equipped with a global shutter function, which has been used mainly in the industrial device market, now realized a global shutter function for mobile devices by supplying lower voltage drive and lower power consumption for use in mobile devices.

Connections between existing  image sensors and AP
Left: Connections between existing image sensors and AP. Right: Connection between IMX418 sensors and AP

The world’s first image sensor that enables multiple sensor connections to a single MIPI input port

This product is equipped with an interface which makes it possible to connect multiple sensors to the same wiring and transfer the image data simultaneously captured and recorded on multiple sensors to a single AP MIPI input port. This makes it possible not only to reduce the wiring but also to connect more image sensors than the number of available MIPI input ports in a device equipped with multiple image sensors.

In terms of the method for transferring recorded image data from each sensor to the AP, it is possible to select either frame-by-frame or line-by-line, depending on how the data is to be processed. The diagram below shows how image data captured on multiple sensors through simultaneous exposure is transferred to the AP in sequence, frame by frame.

Low power consumption global shutter function for mobile devices

The new product builds on the advantages of Sony’s CMOS image sensor equipped with a global shutter function without focal plane distortion, which has been used mainly in the industrial device market, now realized a global shutter function for mobile devices by supplying lower voltage drive and lower power consumption for use in mobile devices.

Sample shooting images of CMOS image sensors
Sample shooting images of CMOS image sensors
Left: Without a global shutter function with focal plane distortion
Right: With a global shutter function without focal plane distortion

IMX418 connection in a system for recording video
IMX418 connection in a system for recording video

Versatile 1:1 aspect ratio

This product employs an angle of view with a 1:1 aspect ratio, which minimizes image information loss due to device tilt, whether the camera is mounted on the front, back, top, bottom, left or right of an HMD, drone, or autonomous robot.

Image captured by IMX418 sensor through simultaneous exposure with no focal plane distortion

Microsoft
Development Category (English)728x90