公开(公告)号：US20230410344A1

公开(公告)日：2023-12-21

申请号：US17807041

申请日：2022-06-15

Applicant: GOOGLE LLC

Inventor： Eric Turner ,  Idris Syed Aleem ,  Sushant Umesh Kulkarni ,  Rees Anwyl Samuel Simmons ,  Ryan Christopher DuToit

IPC: G06T7/60 ,  G06T7/73

CPC classification number: G06T7/60 ,  G06T2207/30201 ,  G06T7/74

Abstract: A system and method of detecting scale from image data obtained by a computing device together with position and orientation of the computing device is provided. The scale may be used for the virtual selection and/or fitting of a wearable device such as a head mounted wearable device and other such wearable devices. The system and method may include capturing a series of frames of image data, and detecting one or more fixed features in the series of frames of image data. Position and orientation data associated with the capture of the image data is combined with the position data related to the one or more fixed features to set a scale that is applicable to the image data. Scale may be determined without the use of a reference object having known scale, specialized equipment, and the like.

公开(公告)号：US20220343534A1

公开(公告)日：2022-10-27

申请号：US17238861

申请日：2021-04-23

Applicant: Google LLC

Inventor： Idris Syed Aleem ,  Rees Anwyl Samuel Simmons ,  Sushant Umesh Kulkarni ,  Ahmed Gawish ,  Mayank Bhargava

IPC: G06T7/73 ,  G06K9/00 ,  G06K19/06

Abstract: A system and method of detecting display fit measurements and/or ophthalmic measurements for a head mounted wearable computing device including a display device is provided. An image of a fitting frame worn by a user of the computing device is captured by the user, through an application running on the computing device. One or more visual markers each including a distinct pattern are detected in the image including the fitting frame. A model of the fitting frame, and configuration information associated with the fitting frame, are determined based on the detection of the pattern. A three-dimensional pose of the fitting frame is determined based on the detected visual marker(s) and patterns, and the configuration information associated with the fitting frame. The display device of the head mounted wearable computing device can then be configured based on the three-dimensional pose of the fitting frame as captured in the image.

公开(公告)号：US12142003B2

公开(公告)日：2024-11-12

申请号：US17238861

申请日：2021-04-23

Applicant: Google LLC

Inventor： Idris Syed Aleem ,  Rees Anwyl Samuel Simmons ,  Sushant Umesh Kulkarni ,  Ahmed Gawish ,  Mayank Bhargava

IPC: G06T7/73 ,  G06K19/06 ,  G06V40/16

Abstract: A system and method of detecting display fit measurements and/or ophthalmic measurements for a head mounted wearable computing device including a display device is provided. An image of a fitting frame worn by a user of the computing device is captured by the user, through an application running on the computing device. One or more visual markers each including a distinct pattern are detected in the image including the fitting frame. A model of the fitting frame, and configuration information associated with the fitting frame, are determined based on the detection of the pattern. A three-dimensional pose of the fitting frame is determined based on the detected visual marker(s) and patterns, and the configuration information associated with the fitting frame. The display device of the head mounted wearable computing device can then be configured based on the three-dimensional pose of the fitting frame as captured in the image.

公开(公告)号：US20230410355A1

公开(公告)日：2023-12-21

申请号：US17807230

申请日：2022-06-16

Applicant: GOOGLE LLC

Inventor： Idris Syed Aleem ,  Mayank Bhargava ,  Sushant Umesh Kulkarni ,  Ahmed Gawish ,  Rees Anwyl Samuel Simmons

IPC: G06T7/73 ,  G06V40/16 ,  G06T7/60 ,  G02B27/01

CPC classification number: G06T7/73 ,  G06V40/165 ,  G06T7/60 ,  G02B27/0172 ,  G06T2207/20081 ,  G06T2207/30201 ,  G06T2207/20076 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178

Abstract: A system and method of predicting the fitting of a head mounted wearable device for a user is provided. The system detects fixed facial landmarks in image data captured by a computing device of the user. Measurements associated with the detected fixed facial landmarks may be processed by one or more machine learning models and associated algorithm(s) to predict the probability of fitting of a head mounted wearable device on the head of the user.

公开(公告)号：US20240242441A1

公开(公告)日：2024-07-18

申请号：US18156156

申请日：2023-01-18

Applicant: GOOGLE LLC

Inventor： Idris Syed Aleem ,  Mayank Bhargava ,  Sushant Umesh Kulkarni

IPC: G06T19/00 ,  G01B11/00 ,  G01B11/14 ,  G01P13/00 ,  G02C7/02 ,  G06T7/246 ,  G06T7/579 ,  G06T7/60 ,  G06T17/00

CPC classification number: G06T19/00 ,  G01B11/002 ,  G01B11/14 ,  G01P13/00 ,  G02C7/027 ,  G06T7/248 ,  G06T7/579 ,  G06T7/60 ,  G06T17/00 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/30041 ,  G06T2207/30201

Abstract: A system and method of predicting fit of a wearable device from image data obtained by a computing device together with position and orientation of the computing device is provided. The system and method may include capturing a series of frames of image data, and detecting one or more fixed features in the series of frames of image data. Position and orientation data associated with the capture of the image data is combined with the position data related to the one or more fixed features, to extract depth data from the series of frames of image data. A three-dimensional model is generated based on the extracted depth data. The three-dimensional model and/or key points extracted therefrom, can be processed by a simulator and/or a machine learning model to predict fit of the wearable device for the user.

公开(公告)号：US20220405500A1

公开(公告)日：2022-12-22

申请号：US17304419

申请日：2021-06-21

Applicant: Google LLC

Inventor： Mayank Bhargava ,  Idris Syed Aleem ,  Yinda Zhang ,  Sushant Umesh Kulkarni ,  Rees Anwyl Simmons ,  Ahmed Gawish

IPC: G06K9/00 ,  G06T7/73 ,  G06K9/32 ,  G06K9/62 ,  G06T17/00 ,  G06T7/50 ,  G06T19/20 ,  G06T7/246 ,  G02C7/02

Abstract: A computer-implemented method includes receiving a two-dimensional (2-D) side view face image of a person, identifying a bounded portion or area of the 2-D side view face image of the person as an ear region-of-interest (ROI) area showing at least a portion of an ear of the person, and processing the identified ear ROI area of the 2-D side view face image, pixel-by-pixel, through a trained fully convolutional neural network model (FCNN model) to predict a 2-D ear saddle point (ESP) location for the ear shown in the ear ROI area. The FCNN model has an image segmentation architecture.