公开(公告)号：US12165063B2

公开(公告)日：2024-12-10

申请号：US18411445

申请日：2024-01-12

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yuqian Zhou ,  Timothy Andrew Large ,  Se Hoon Lim ,  Neil Emerton ,  Yonghuan David Ren

IPC: G06N3/08 ,  G06F18/214 ,  G06N20/00 ,  G06T5/50 ,  G06T5/70 ,  G06T5/73 ,  G06V10/44 ,  G06V10/764 ,  G06V10/774 ,  G06V10/82 ,  G06V40/16 ,  H04N23/60

Abstract: Examples are disclosed that relate to the restoration of degraded images acquired via a behind-display camera. One example provides a method of training a machine learning model, the method comprising inputting training image pairs into the machine learning model, each training image pair comprising an undegraded image and a degraded image that represents an appearance of the undegraded image to a behind-display camera, and training the machine learning model using the training image pairs to generate frequency information that is missing from the degraded images.

公开(公告)号：US10955943B1

公开(公告)日：2021-03-23

申请号：US16820341

申请日：2020-03-16

Applicant: Microsoft Technology Licensing, LLC

Inventor： Timothy Andrew Large ,  Siyuan Ma ,  Neil Emerton

IPC: G06F3/0354 ,  G06F3/041 ,  G02F1/1333 ,  G06F3/044

Abstract: Embodiments enable forming a friction modified touch sensitive surface on a touch screen panel. In particular, the touch sensitive surface is augmented with two friction modifying materials that are interspersed with one another according to a predetermined pattern on the surface of the touch screen panel as a monomolecular layer. In an embodiment, The materials have indices of refraction that differ from each other by more than 0.10. In another embodiment, the materials have a kinetic coefficient of friction in one or the other range, respectively, of between 0.01 and 0.05, or between 0.06 and 0.1, said kinetic coefficients of friction being measured against printing paper that has a kinetic coefficient of friction of 0.17 with itself. In another embodiment, the materials have a water contact angle of greater than 90 degrees, and an oil contact angle of greater than 30 degrees as measured with n-hexadecane.

公开(公告)号：US10694146B2

公开(公告)日：2020-06-23

申请号：US16181103

申请日：2018-11-05

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Se Hoon Lim ,  Timothy Andrew Large

IPC: H04N7/15 ,  H04N7/14 ,  H04N9/09 ,  G06T7/194 ,  G06T5/50 ,  G06T7/12 ,  G06T7/13 ,  G06T7/11

Abstract: Techniques for video capture including determining a position of a subject in relation to multiple cameras; selecting a foreground camera from the cameras based on at least the determined position; obtaining an RGB image captured by the foreground camera; segmenting the RGB image to identify a foreground portion corresponding to the subject, with a total height of the foreground portion being a first percentage of a total height of the RGB image; generating a foreground image from the foreground portion; producing a composite image, including compositing the foreground image and a background image to produce a portion of the composite image, with a total height of the foreground image in the composite image being a second percentage of a total height of the composite image and the second percentage being substantially less than the first percentage; and causing the composite image to be displayed on a remote system.

公开(公告)号：US12125179B2

公开(公告)日：2024-10-22

申请号：US17755190

申请日：2020-11-10

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yonghuan David Ren ,  Timothy Andrew Large ,  Neil Emerton ,  Yuqian Zhou

IPC: G06T5/00 ,  G06T5/73 ,  H04N5/225 ,  H04N23/56

CPC classification number: G06T5/73 ,  H04N23/56 ,  G06T2207/20081

Abstract: An electronic device comprises a display, an illumination source, a camera, and a logic system. The illumination source is configured to project structured illumination onto a subject. The camera is configured to image the subject through the display, which includes collecting the structured illumination as reflected by the subject. The logic system is configured to receive, from the camera, a digital image of the subject imaged through the display. The logic system is further configured to sharpen the digital image based on the spatially resolved intensity of the structured illumination as reflected by the subject.

公开(公告)号：US11893482B2

公开(公告)日：2024-02-06

申请号：US16799597

申请日：2020-02-24

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yuqian Zhou ,  Timothy Andrew Large ,  Se Hoon Lim ,  Neil Emerton ,  Yonghuan David Ren

IPC: G06N3/08 ,  G06T5/50 ,  G06N20/00 ,  G06T5/00 ,  G06F18/214 ,  H04N23/60 ,  G06V10/764 ,  G06V10/774 ,  G06V10/82 ,  G06V10/44 ,  G06V40/16

CPC classification number: G06N3/08 ,  G06F18/214 ,  G06N20/00 ,  G06T5/002 ,  G06T5/003 ,  G06T5/50 ,  G06V10/764 ,  G06V10/774 ,  H04N23/64 ,  G06V10/454 ,  G06V10/82 ,  G06V40/161

Abstract: Examples are disclosed that relate to the restoration of degraded images acquired via a behind-display camera. One example provides a method of training a machine learning model, the method comprising inputting training image pairs into the machine learning model, each training image pair comprising an undegraded image and a degraded image that represents an appearance of the undegraded image to a behind-display camera, and training the machine learning model using the training image pairs to generate frequency information that is missing from the degraded images.

公开(公告)号：US11539021B2

公开(公告)日：2022-12-27

申请号：US17067026

申请日：2020-10-09

Applicant: Microsoft Technology Licensing, LLC

Inventor： Timothy Andrew Large ,  Lincoln Matthew Ghioni ,  Sarat Babu ,  Matthew James Longbottom ,  Duncan Alexander Wallis Carter

IPC: G06F1/16 ,  H05K5/00 ,  H05K7/00 ,  H01L51/52 ,  H01L51/56 ,  H01L51/00 ,  H04M1/02

Abstract: A computing device is disclosed that includes an organic light-emitting diode (OLED) display. The OLED display has a front surface and a back surface. The computing device includes a moveable display support connected to the back surface of the display. In some implementations, the moveable display support is configured to limit bending in one direction to a first bend radius and to limit bending in another direction to a second bend radius. In some implementations, the moveable display support is formed by a plurality of unit cells.

公开(公告)号：US10706556B2

公开(公告)日：2020-07-07

申请号：US15975740

申请日：2018-05-09

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Se Hoon Lim ,  Timothy Andrew Large

IPC: G06T7/00 ,  G06T7/194 ,  G06T7/215 ,  G06T7/50 ,  G06T7/13 ,  G06T5/00

Abstract: Systems and methods for foreground image segmentation, which receive image data captured at a first time, generate a skeleton model of a foreground subject captured in the image data, generate an initial foreground mask for a foreground segment including the foreground subject, generate secondary points corresponding to the foreground subject, identify supplemental points for the foreground segment based on at least the secondary points and the skeleton model, combine the supplemental points with the initial foreground mask to obtain a combined mask, obtain a foreground segment mask for the foreground subject based on the combined mask, and apply the foreground segment mask to the image data to obtain a foreground image portion for the foreground subject.

公开(公告)号：US10554921B1

公开(公告)日：2020-02-04

申请号：US16056446

申请日：2018-08-06

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Se Hoon Lim ,  Timothy Andrew Large

IPC: H04N7/14 ,  H04N5/445 ,  H04N7/15 ,  H04N5/272 ,  H04N5/247 ,  G06T7/50 ,  G06K9/00 ,  G06T7/70 ,  H04N9/04 ,  H04N5/262 ,  G06T7/194

Abstract: Techniques for video conferencing including obtaining a first image captured by a camera through a display device of a first device, receiving at the first device live images of a first participant of a video conferencing session, displaying a first composite image on the display device with an image portion of the eyes of the first participant at a lateral position corresponding to the camera, segmenting a foreground image from the first image that corresponds to a second participant of the video conferencing session, and causing via the video conferencing session a second composite image of the second device at a different geographic location, in which the second composite image includes the foreground image composited with a background image.

公开(公告)号：US10387711B2

公开(公告)日：2019-08-20

申请号：US15221472

申请日：2016-07-27

Applicant: Microsoft Technology Licensing, LLC

Inventor： Jiandong Huang ,  Timothy Andrew Large ,  Liying Chen ,  Steven Nabil Bathiche

IPC: H04N5/335 ,  G06K9/00 ,  G06F3/041 ,  G06F3/042 ,  G06F3/044 ,  G06F3/045 ,  G06K9/20 ,  H04N5/225 ,  H04N5/369 ,  G06T11/60 ,  H01L27/146 ,  H01L27/32

Abstract: An electronic device includes a cover glass having a display surface, a pixelated photoemitting element array, and a pixelated photodetecting element array. The pixelated photoemitting element array emits a light signal through the cover glass to the display surface. The pixelated photodetecting element array is positioned relative to the pixelated photoemitting element array and the cover glass to receive a reflected light signal. The reflected light signal includes a portion of the emitted light signal reflected by total internal reflection from a refractive boundary at the display surface. Operation of each pixel is switched between the one or more photodetecting elements and the one or more photoemitting elements by the pixel selector signal component received from the pixel selector signal bus. A sensing trigger is configured to trigger the imaging scan by the pixelated photoemitting element array and the pixelated photodetecting element array, responsive to detection of an initiating action.

公开(公告)号：US10122969B1

公开(公告)日：2018-11-06

申请号：US15835413

申请日：2017-12-07

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Se Hoon Lim ,  Timothy Andrew Large

IPC: H04N7/15 ,  H04N7/14 ,  H04N9/09 ,  G06T7/194 ,  G06T5/50 ,  G06T7/12 ,  G06T7/13

Abstract: Techniques for video capture including determining a position of a subject in relation to multiple cameras; selecting a foreground camera from the cameras based on at least the determined position; obtaining an RGB image captured by the foreground camera; segmenting the RGB image to identify a foreground portion corresponding to the subject, with a total height of the foreground portion being a first percentage of a total height of the RGB image; generating a foreground image from the foreground portion; producing a composite image, including compositing the foreground image and a background image to produce a portion of the composite image, with a total height of the foreground image in the composite image being a second percentage of a total height of the composite image and the second percentage being substantially less than the first percentage; and causing the composite image to be displayed on a remote system.