-
公开(公告)号:US10769812B2
公开(公告)日:2020-09-08
申请号:US15965710
申请日:2018-04-27
Applicant: Microsoft Technology Licensing, LLC
Inventor: Chunshui Zhao , Khawar Zuberi , Jie Liu , Di Wang , William Thomas , Yasser B. Asmi , Zhengyou Zhang
Abstract: The disclosure relates to tracking the location of a target object. In one example, a computer vision system detects a configuration of environment objects. A location model that has been trained for the environment configuration is selected. A signal associated with the target object is received and interpreted using the selected location model to determine the location of the target object.
-
公开(公告)号:US10274737B2
公开(公告)日:2019-04-30
申请号:US15056804
申请日:2016-02-29
Applicant: Microsoft Technology Licensing, LLC
Inventor: Nikolai Smolyanskiy , Zhengyou Zhang , Sean Eron Anderson , Michael Hall
IPC: G09G5/36 , G02B27/01 , B60R11/04 , G06T3/00 , H04N5/232 , H04N19/00 , H04N7/18 , H04N13/00 , H04N21/414 , H04N21/4223
Abstract: A vehicle camera system captures and transmits video to a user device, which includes a viewing device for playback of the captured video, such as virtual reality or augmented reality glasses. A rendering map is generated that indicates which pixels of the video frame (as identified by particular coordinates of the video frame) correspond to which coordinates of a virtual sphere in which a portion of the video frame is rendered for display. When a video frame is received, the rendering map is used to determine the texture values (e.g., colors) for coordinates in the virtual sphere, which is used to generate the display for the user. This technique reduces the rendering time when a user turns his or her head (e.g., while in virtual reality) and so it reduces motion and/or virtual reality sickness induced by the rendering lag.
-
公开(公告)号:US10271021B2
公开(公告)日:2019-04-23
申请号:US15056678
申请日:2016-02-29
Applicant: Microsoft Technology Licensing, LLC
Inventor: Nikolai Smolyanskiy , Zhengyou Zhang , Vikram R. Dendi
Abstract: A vehicle has a camera system that captures video while the vehicle moves. The vehicle records the captured video and/or wirelessly transmits the captured video to a remote user device for playback. When the vehicle is moving, a coarse waypoint is identified and a trajectory is determined from the current location of the vehicle to the coarse waypoint that reduces (e.g., minimizes) sudden changes in direction of movement of the vehicle, reduces (e.g., minimizes) sudden changes in speed of the vehicle, and/or reduces (e.g., minimizes) sudden changes in acceleration of the vehicle by reducing (e.g., minimizing) jerk or snap of the vehicle trajectory. One or more fine waypoints along the trajectory are selected and the vehicle moves to the coarse waypoint along the trajectory by passing through those fine waypoints, resulting in smooth movement of the device that reduces or eliminates motion sickness for users viewing the captured video.
-
公开(公告)号:US09875533B2
公开(公告)日:2018-01-23
申请号:US15408885
申请日:2017-01-18
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Seiichi Kato , Yasufumi Shiraishi , Daniel J. Moffitt , Kenji Nikaido , Daniel Eduardo Martinez , Lu Yuan , Jiangyu Liu , Aleksandar B. Tomic , Ivan Stojiljkovic , Zhengyou Zhang
IPC: G06K9/00 , G06T7/00 , G06T7/13 , G06T5/00 , G06K9/62 , G06T7/33 , G06K9/52 , G06K9/46 , G06K9/32
CPC classification number: G06T7/0004 , G06K9/00442 , G06K9/3275 , G06K9/4642 , G06K9/4647 , G06K9/4652 , G06K9/52 , G06K9/6215 , G06K9/6267 , G06T5/00 , G06T5/008 , G06T5/40 , G06T7/13 , G06T7/33 , G06T7/90 , G06T2207/20021 , G06T2207/30176 , H04N1/3878 , H04N1/6027
Abstract: Image processing for productivity applications is provided. An image may be received by a computing device. The computing device may detect the edges comprising the received image and adjust the image based on a skew state of the detected edges. The computing device may then process the adjusted image to correct imbalances. The computing device may then assign an image classification to the processed image. The computing device may then adjust the processed image based on the assigned image classification.
-
公开(公告)号:US09864430B2
公开(公告)日:2018-01-09
申请号:US14593955
申请日:2015-01-09
Applicant: Microsoft Technology Licensing, LLC
Inventor: Dijia Wu , Michael J. Conrad , Tim Burrell , Xu Miao , Zicheng Liu , Qin Cai , Zhengyou Zhang
CPC classification number: G06F3/013 , G06F3/0304 , G06F3/038 , G06K9/0061
Abstract: Examples are disclosed herein that are related to gaze tracking via image data. One example provides, on a gaze tracking system comprising an image sensor, a method of determining a gaze direction, the method comprising acquiring image data via the image sensor, detecting in the image data facial features of a human subject, determining an eye rotation center based upon the facial features using a calibrated face model, determining an estimated position of a center of a lens of an eye from the image data, determining an optical axis based upon the eye rotation center and the estimated position of the center of the lens, determining a visual axis by applying an adjustment to the optical axis, determining the gaze direction based upon the visual axis, and providing an output based upon the gaze direction.
-
公开(公告)号:US09756284B2
公开(公告)日:2017-09-05
申请号:US14817021
申请日:2015-08-03
Applicant: Microsoft Technology Licensing, LLC
Inventor: Cha Zhang , Timothy A. Large , Zhengyou Zhang , Ruigang Yang
Abstract: The described implementations relate to enhancement images, such as in videoconferencing scenarios. One system includes a poriferous display screen having generally opposing front and back surfaces. This system also includes a camera positioned proximate to the back surface to capture an image through the poriferous display screen.
-
公开(公告)号:US20170251180A1
公开(公告)日:2017-08-31
申请号:US15056922
申请日:2016-02-29
Applicant: Microsoft Technology Licensing, LLC
Inventor: Nikolai Smolyanskiy , Zhengyou Zhang , Vikram R. Dendi , Michael Hall
CPC classification number: H04N7/185 , B64C39/02 , G02B27/017 , G02B2027/0178 , G05D1/0038 , G06Q10/101 , G06T19/006 , H04N5/23296
Abstract: In embodiments of collaborative camera viewpoint control for interactive telepresence, a system includes a vehicle that travels based on received travel instructions, and the vehicle includes a camera system of multiple cameras that each capture video of an environment in which the vehicle travels from different viewpoints. Viewing devices receive the video of the environment from the different viewpoints, where the video of the environment from a selected one of the viewpoints is displayable to users of the viewing devices. Controller devices that are associated with the viewing devices can each receive a user input as a proposed travel instruction for the vehicle based on the selected viewpoint of the video that is displayed on the viewing devices. A trajectory planner receives the proposed travel instructions initiated via the controller devices, and generates a consensus travel instruction for the vehicle based on the proposed travel instructions.
-
公开(公告)号:US20170251179A1
公开(公告)日:2017-08-31
申请号:US15056678
申请日:2016-02-29
Applicant: Microsoft Technology Licensing, LLC
Inventor: Nikolai Smolyanskiy , Zhengyou Zhang , Vikram R. Dendi
CPC classification number: H04N7/185 , B64C39/024 , B64C2201/027 , B64C2201/127 , B64C2201/146 , G02B27/017 , G02B2027/0178 , G05D1/0094 , H04B7/18506
Abstract: A vehicle has a camera system that captures video while the vehicle moves. The vehicle records the captured video and/or wirelessly transmits the captured video to a remote user device for playback. When the vehicle is moving, a coarse waypoint is identified and a trajectory is determined from the current location of the vehicle to the coarse waypoint that reduces (e.g., minimizes) sudden changes in direction of movement of the vehicle, reduces (e.g., minimizes) sudden changes in speed of the vehicle, and/or reduces (e.g., minimizes) sudden changes in acceleration of the vehicle by reducing (e.g., minimizing) jerk or snap of the vehicle trajectory. One or more fine waypoints along the trajectory are selected and the vehicle moves to the coarse waypoint along the trajectory by passing through those fine waypoints, resulting in smooth movement of the device that reduces or eliminates motion sickness for users viewing the captured video.
-
公开(公告)号:US20170090560A1
公开(公告)日:2017-03-30
申请号:US14866534
申请日:2015-09-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Yinpeng Chen , Sasa Junuzovic , Zhengyou Zhang , Zicheng Liu
IPC: G06F3/01 , G06K9/00 , G06F3/041 , G06F17/24 , G06F3/0346
Abstract: The large display interaction implementations described herein combine mobile devices with people tracking to enable new interactions including making a non-touch-sensitive display touch-sensitive and allowing personalized interactions with the display. One implementation tracks one or more mobile computing device users relative to a large computer-driven display, and configures content displayed on the display based on a distance a given mobile computing device user is from the display. Another implementation personalizes user interactions with a large display. One or more mobile computing device users are tracked relative to a display. The identity of each of the one or more mobile computing device users is obtained. Content displayed on the display is configured based on a distance an identified mobile computing device user is from the display and the identity of the user that provides the content.
-
10.
公开(公告)号:US09552061B2
公开(公告)日:2017-01-24
申请号:US14226136
申请日:2014-03-26
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Zhengyou Zhang , Qin Cai
CPC classification number: G06F3/013 , G06K9/00604 , G06T7/0002 , G06T7/85 , G06T2207/10012 , G06T2207/30196
Abstract: The subject disclosure is generally directed towards eye gaze detection based upon both eyes being fixated on the same gaze location. In one aspect, an image including a subject's left and right eyes is captured, from which left and right glint and pupil center information are extracted. The left and right glint data and the left and right pupil data are used with left and right bias correction matrices to jointly determine a gaze location.
Abstract translation: 主题公开通常针对基于两只眼睛固定在同一注视位置上的眼睛注视检测。 在一个方面,捕获包括被摄体的左眼和右眼的图像,从中提取左,右闪光和瞳孔中心信息。 左和右闪烁数据以及左和右瞳孔数据与左和右偏置校正矩阵一起使用以共同确定凝视位置。
-
-
-
-
-
-
-
-
-