公开(公告)号：US20200162721A1

公开(公告)日：2020-05-21

申请号：US16773505

申请日：2020-01-27

Applicant: Samsung Electronics Co., Ltd.

Inventor： Ilia OVSIANNIKOV ,  Yibing Michelle WANG ,  Peter DEANE

IPC: H04N13/254 ,  G01B11/25 ,  H04N13/257 ,  H04N13/296 ,  H04N13/271

Abstract: An apparatus and a method are provided. The apparatus includes a light source configured to project light in a changing pattern that reduces the light's noticeability; collection optics through which light passes and forms an epipolar plane with the light source; and an image sensor configured to receive light passed through the collection optics to acquire image information and depth information simultaneously. The method includes projecting light by a light source in a changing pattern that reduces the light's noticeability; passing light through collection optics and forming an epipolar plane between the collection optics and the light source; and receiving in an image sensor light passed through the collection optics to acquire image information and depth information simultaneously.

公开(公告)号：US20190392253A1

公开(公告)日：2019-12-26

申请号：US16553158

申请日：2019-08-27

Applicant: Samsung Electronics Co., Ltd.

Inventor： Zhengping JI ,  Ilia OVSIANNIKOV ,  Yibing Michelle WANG ,  Lilong SHI

IPC: G06K9/62 ,  G06K9/46 ,  G06N3/04 ,  G06N3/08

Abstract: A client device configured with a neural network includes a processor, a memory, a user interface, a communications interface, a power supply and an input device, wherein the memory includes a trained neural network received from a server system that has trained and configured the neural network for the client device. A server system and a method of training a neural network are disclosed.

公开(公告)号：US20190094015A1

公开(公告)日：2019-03-28

申请号：US16186477

申请日：2018-11-09

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibing Michelle WANG

IPC: G01B11/22

CPC classification number: G01B11/22 ,  G01B11/2518 ,  G03B15/02 ,  G03B17/54 ,  G06T7/521 ,  G06T2207/10028 ,  H04N5/2256 ,  H04N5/23245 ,  H04N13/271 ,  H04N2213/003

Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.

公开(公告)号：US20190045151A1

公开(公告)日：2019-02-07

申请号：US16149023

申请日：2018-10-01

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibing Michelle WANG ,  Ilia OVSIANNIKOV

IPC: H04N5/378 ,  H04N17/00 ,  H04N5/232 ,  H04N5/374 ,  H04N5/376

Abstract: Using the same image sensor to capture a two-dimensional (2D) image and three-dimensional (3D) depth measurements for a 3D object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor operates as a Time-to-Digital (TDC) converter to generate timestamps. A timestamp calibration circuit is provided on-board to record the propagation delay of each column of pixels in the pixel array and to provide necessary corrections to the timestamp values generated during 3D depth measurements.

公开(公告)号：US20180059224A1

公开(公告)日：2018-03-01

申请号：US15340972

申请日：2016-11-01

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibing Michelle WANG ,  Tae-Yon LEE ,  Ilia OVSIANNIKOV

IPC: G01S7/486 ,  G01S17/10 ,  G01S17/89

CPC classification number: G01S7/4863 ,  G01S7/4865 ,  G01S7/4868 ,  G01S17/10 ,  G01S17/89

Abstract: The Time-of-Flight (TOF) technique is combined with analog amplitude modulation within each pixel in an image sensor. The pixel may be a two-tap pixel or a one-tap pixel. Two photoelectron receiver circuits in the pixel receive respective analog modulating signals. The distribution of the received photoelectron charge between these two circuits is controlled by the difference (or ratio) of the two analog modulating voltages. The differential signals generated in this manner within the pixel are modulated in time domain for TOF measurement. Thus, the TOF information is added to the received light signal by the analog domain-based single-ended to differential converter inside the pixel itself. The TOF-based measurement of range and its resolution are controllable by changing the duration of modulation. An autonomous navigation system with these features may provide improved vision for drivers under difficult driving conditions like low light, fog, bad weather, or strong ambient light.

公开(公告)号：US20170142406A1

公开(公告)日：2017-05-18

申请号：US14989554

申请日：2016-01-06

Applicant: Samsung Electronics Co., Ltd.

Inventor： Ilia OVSIANNIKOV ,  Yibing Michelle WANG ,  Peter DEANE

IPC: H04N13/02 ,  G01B11/25 ,  H04N5/232

Abstract: An apparatus and a method are provided. The apparatus includes a light source configured to project light in a changing pattern that reduces the light's noticeability; collection optics through which light passes and forms an epipolar plane with the light source; and an image sensor configured to receive light passed through the collection optics to acquire image information and depth information simultaneously. The method includes projecting light by a light source in a changing pattern that reduces the light's noticeability; passing light through collection optics and forming an epipolar plane between the collection optics and the light source; and receiving in an image sensor light passed through the collection optics to acquire image information and depth information simultaneously.

公开(公告)号：US20170134710A1

公开(公告)日：2017-05-11

申请号：US14989716

申请日：2016-01-06

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yibing Michelle WANG ,  Ilia OVSIANNIKOV ,  Peter DEANE

IPC: H04N13/02 ,  H04N5/376 ,  G01B11/25 ,  G06T7/60 ,  H04N13/00 ,  H04N5/378 ,  G06T7/00

CPC classification number: H04N13/261 ,  G01B11/25 ,  G06T7/521 ,  G06T7/62 ,  G06T2207/10016 ,  G06T2207/10152 ,  H04N5/3765 ,  H04N5/378 ,  H04N13/128 ,  H04N13/257

Abstract: Using the same image sensor to capture a two-dimensional (2D) image and three-dimensional (3D) depth measurements for a 3D object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor operates as a Time-to-Digital Converter (TDC) to generate timestamps. When the epipolar line is misaligned or curved, multiple TDC arrays acquire timestamps of multiple pixels (in multiple rows) substantially simultaneously. Multiple timestamp values are reconciled to obtain a single timestamp value for a light spot.

公开(公告)号：US20150187844A1

公开(公告)日：2015-07-02

申请号：US14453124

申请日：2014-08-06

Applicant: Samsung Electronics Co., Ltd.

Inventor： Tae-Yon LEE ,  Yibing Michelle WANG ,  Gwi-deok Ryan LEE

IPC: H01L27/30 ,  H04N5/378 ,  H01L51/44

CPC classification number: H04N5/378 ,  H01L27/14609 ,  H01L27/14627 ,  H01L27/14641 ,  H01L27/14643 ,  H01L27/14665 ,  H04N5/37457 ,  H04N9/045

Abstract: A unit pixel of a stacked image sensor includes a stacked photoelectric conversion unit, a first and second signal generating units. The stacked photoelectric conversion unit includes first, second and third photoelectric conversion elements that are stacked on each other. The first, second and third photoelectric conversion elements collect first, second and third photocharges based on first, second and third components of incident light. The first signal generating unit generates a first pixel signal based on the first photocharges and a first signal node and generates a second pixel signal based on the second photocharges and the first signal node. The second signal generating unit generates a third pixel signal based on the third photocharges and a second signal node. At least a portion of the second signal generating unit is shared by the first signal generating unit.

Abstract translation: 层叠图像传感器的单位像素包括层叠光电转换单元，第一和第二信号生成单元。 叠层光电转换单元包括彼此堆叠的第一，第二和第三光电转换元件。 第一，第二和第三光电转换元件基于入射光的第一，第二和第三分量收集第一，第二和第三光电荷。 第一信号产生单元基于第一光电荷产生第一像素信号和第一信号节点，并且基于第二光电荷和第一信号节点生成第二像素信号。 第二信号生成单元基于第三光电荷产生第三像素信号和第二信号节点。 第二信号生成单元的至少一部分由第一信号生成单元共享。