-
公开(公告)号:US12115416B2
公开(公告)日:2024-10-15
申请号:US17654327
申请日:2022-03-10
Applicant: Google LLC
Inventor: Konstantine Nicholas John Tsotsos , Ivo Duarte , Joao Afonso , Maria Nika Yocke , Lucy Abramyan , Luca Ballan , Christopher Ross , Young Hwan Kim , José Carlos Maranhão Pascoal
CPC classification number: A63B24/0062 , A63B71/0622 , A63B71/0686 , G06T7/50 , A63B2024/0068 , A63B2071/0666 , A63B2220/05 , A63B2220/13 , A63B2220/17 , A63B2220/20 , A63B2220/30 , A63B2220/40 , A63B2220/62 , A63B2220/836 , A63B2230/62
Abstract: A method can include determining, by a head-mounted device based on first data received from a depth-sensing device included in the head-mounted device, that a first distance of the head-mounted device from a landmark is outside a completion range; outputting, based on the determination that the first distance of the head-mounted device from the landmark is outside the completion range from the landmark, an indication that a repetition has yet to be completed; determining, based on second data received from the depth-sensing device, that a second distance of head-mounted device from the landmark is within the completion range; and based on the determination that the second distance of the head-mounted device from the landmark is within the completion range, incrementing a repetition counter and outputting an indication that the repetition has been completed.
-
公开(公告)号:US20230236219A1
公开(公告)日:2023-07-27
申请号:US17648572
申请日:2022-01-21
Applicant: GOOGLE LLC
Inventor: Yunwen Zhou , Ryan Christopher DuToit , Abhishek Kar , Konstantine Nicholas John Tsotsos , Eric Turner , Chao Guo
CPC classification number: G01P21/00 , G06T7/50 , G06T7/80 , G06T7/33 , G06T7/20 , G01P13/00 , G01P15/08 , G06T2207/20084
Abstract: Disclosed is a method including receiving a depth map estimated using data based on image and data received from a movement sensor as input, generating an alignment parameter based on the depth map, adding the alignment parameter to a pre-calibration state to define a user operational calibration state, generating scale parameters and shift parameters based on features associated with the data received from the image and movement sensor, and calibrating the image and movement sensor based on the user operational calibration state, the scale parameters and the shift parameters.
-
公开(公告)号:US11145075B2
公开(公告)日:2021-10-12
申请号:US16767401
申请日:2019-10-04
Applicant: Google LLC
Inventor: Julien Valentin , Onur G. Guleryuz , Mira Leung , Maksym Dzitsiuk , Jose Pascoal , Mirko Schmidt , Christoph Rhemann , Neal Wadhwa , Eric Turner , Sameh Khamis , Adarsh Prakash Murthy Kowdle , Ambrus Csaszar , João Manuel Castro Afonso , Jonathan T. Barron , Michael Schoenberg , Ivan Dryanovski , Vivek Verma , Vladimir Tankovich , Shahram Izadi , Sean Ryan Francesco Fanello , Konstantine Nicholas John Tsotsos
Abstract: A handheld user device includes a monocular camera to capture a feed of images of a local scene and a processor to select, from the feed, a keyframe and perform, for a first image from the feed, stereo matching using the first image, the keyframe, and a relative pose based on a pose associated with the first image and a pose associated with the keyframe to generate a sparse disparity map representing disparities between the first image and the keyframe. The processor further is to determine a dense depth map from the disparity map using a bilateral solver algorithm, and process a viewfinder image generated from a second image of the feed with occlusion rendering based on the depth map to incorporate one or more virtual objects into the viewfinder image to generate an AR viewfinder image. Further, the processor is to provide the AR viewfinder image for display.
-
4.
公开(公告)号:US20250093640A1
公开(公告)日:2025-03-20
申请号:US18468294
申请日:2023-09-15
Applicant: Google LLC
Inventor: Stiven Guillaume Francois Morvan , Konstantine Nicholas John Tsotsos , Dongeek Shin , Tinglin Duan
Abstract: A head-mounted display device may initiate display of a user interface on a display of the head-mounted display device. A head-mounted display device may compute an angular distance between a previous head orientation and a current head orientation based on head movement data. A head-mounted display device may apply a gain value to the angular distance to move a position indicator to an updated position within a boundary of the user interface, the user interface configured to remain fixed to a location in the display regardless of head movements.
-
公开(公告)号:US20230359286A1
公开(公告)日:2023-11-09
申请号:US18312448
申请日:2023-05-04
Applicant: Google LLC
Inventor: Luca Ballan , Mahesh Ramachandran , Qiyue Zhang , Chao Guo , Konstantine Nicholas John Tsotsos , Jie Zhang
IPC: G06F3/0346 , G06T7/70
CPC classification number: G06F3/0346 , G06T7/70 , G06T2207/20084
Abstract: A tracking system and associated algorithms are disclosed that can provide a user with a continuous, reset-free augmented reality (AR) experience. When the user wears an AR headset equipped with a camera and an inertial measurement unit (IMU), motion sensor data from the IMU can be combined with image data from the camera to create a device pose, representing a position and an orientation of the headset relative to its environment. In some implementations, when a reset occurs, a six-degrees-of-freedom (6DoF) algorithm can be configured to support the pose until a re-initialization is completed. In some implementations, a neural network can be used to correct for IMU integration drifts in the 6DoF algorithm. In some implementations, the IMU-based 6DoF uses a neural network that exploits the device's past motion to infer its future motion.
-
公开(公告)号:US11288844B2
公开(公告)日:2022-03-29
申请号:US15733376
申请日:2019-10-16
Applicant: Google LLC
Inventor: Chloe LeGendre , Laurent Charbonnel , Christina Tong , Konstantine Nicholas John Tsotsos , Wan-Chun Ma , Paul Debevec
Abstract: Systems, methods, and computer program products are described that implement obtaining, at an electronic computing device and for at least one image of a scene rendered in an Augmented Reality (AR) environment, a scene lighting estimation captured at a first time period. The scene lighting estimation may include at least a first image measurement associated with the scene. The implementations may include determining, at the electronic computing device, a second image measurement associated with the scene at a second time period, determining a function of the first image measurement and the second image measurement. Based on the determined function, the implementations may also include triggering calculation of a partial lighting estimation update or triggering calculation of a full lighting estimation update and rendering, on a screen of the electronic computing device and for the scene, the scene using the partial lighting estimation update or the full lighting estimation update.
-
公开(公告)号:US12072501B1
公开(公告)日:2024-08-27
申请号:US18168770
申请日:2023-02-14
Applicant: GOOGLE LLC
Inventor: Stiven Guillaume Francois Morvan , Dongeek Shin , Konstantine Nicholas John Tsotsos , Li-Te Cheng
CPC classification number: G02B27/0172 , G02B27/0179 , G02B2027/0178
Abstract: A head-mounted device may present a first user interface element and a second user interface element within a user interface that is included in a display of the head-mounted device. The head-mounted device may, in response to movement of the head-mounted device, move the first user interface element and the second user interface element within the display, the movement of the first user interface element decreasing a boundary distance below a threshold distance, the boundary distance being based on a distance between the first user interface element and a boundary associated with the user interface. The head-mounted device may decrease a size of the first user interface element while the boundary distance is decreasing and is below the threshold distance.
-
公开(公告)号:US20240272433A1
公开(公告)日:2024-08-15
申请号:US18168770
申请日:2023-02-14
Applicant: GOOGLE LLC
Inventor: Stiven Guillaume Francois Morvan , Dongeek Shin , Konstantine Nicholas John Tsotsos , Li-Te Cheng
IPC: G02B27/01
CPC classification number: G02B27/0172 , G02B27/0179 , G02B2027/0178
Abstract: A head-mounted device may present a first user interface element and a second user interface element within a user interface that is included in a display of the head-mounted device. The head-mounted device may, in response to movement of the head-mounted device, move the first user interface element and the second user interface element within the display, the movement of the first user interface element decreasing a boundary distance below a threshold distance, the boundary distance being based on a distance between the first user interface element and a boundary associated with the user interface. The head-mounted device may decrease a size of the first user interface element while the boundary distance is decreasing and is below the threshold distance.
-
公开(公告)号:US11694409B1
公开(公告)日:2023-07-04
申请号:US17643233
申请日:2021-12-08
Applicant: GOOGLE LLC
Inventor: Sazzadur Rahman , Konstantine Nicholas John Tsotsos , João Manuel de Castro Afonso , José Carlos Maranhão Pascoal , Ivo Duarte , Nuno Cruces
CPC classification number: G06T19/006 , G06T15/04
Abstract: A split-architecture for rendering and warping world-locked AR elements, such as graphics in a navigation application, for display on augmented reality (AR) glasses is disclosed. The split-architecture can help to alleviate a resource burden on the AR glasses by performing the more complex processes associated with the rendering and warping on a computing device, while performing the less complex processes associated with the rendering and warping on the AR glasses. The AR glasses and the computing device are coupled via wireless communication, and the disclosed systems and methods address the large and variable latencies associated with the wireless communication that could otherwise make splitting these processes impractical.
-
公开(公告)号:US20230285805A1
公开(公告)日:2023-09-14
申请号:US17654327
申请日:2022-03-10
Applicant: Google LLC
Inventor: Konstantine Nicholas John Tsotsos , Ivo Duarte , Joao Afonso , Maria Nika Yocke , Lucy Abramyan , Luca Ballan , Christopher Ross , Young Hwan Kim , José Carlos Maranhão Pascoal
CPC classification number: A63B24/0062 , G06T7/50 , A63B71/0686 , A63B71/0622 , A63B2024/0068 , A63B2220/836 , A63B2220/13 , A63B2220/20 , A63B2230/62 , A63B2220/40 , A63B2220/30 , A63B2220/05 , A63B2220/62 , A63B2220/17 , A63B2071/0666
Abstract: A method can include determining, by a head-mounted device based on first data received from a depth-sensing device included in the head-mounted device, that a first distance of the head-mounted device from a landmark is outside a completion range; outputting, based on the determination that the first distance of the head-mounted device from the landmark is outside the completion range from the landmark, an indication that a repetition has yet to be completed; determining, based on second data received from the depth-sensing device, that a second distance of head-mounted device from the landmark is within the completion range; and based on the determination that the second distance of the head-mounted device from the landmark is within the completion range, incrementing a repetition counter and outputting an indication that the repetition has been completed.
-
-
-
-
-
-
-
-
-