公开(公告)号：US20250022312A1

公开(公告)日：2025-01-16

申请号：US18577079

申请日：2021-07-16

Applicant: Hewlett-Packard Development Company, L.P.

Inventor： Paul Howard Mazurkiewicz ,  Joseph Nouri ,  Mark Lessman

IPC: G06V40/16 ,  G01B7/16 ,  G01R33/07 ,  G02B27/00 ,  G02B27/01

Abstract: Facial movement of a wearer of a head-mountable display (HMD) is detected by detecting movement of a gasket of the HMD positioned against a face of the wearer using resistive or magnetic sensors within the gasket. A facial expression of the wearer is identified based on the detected facial movement.

公开(公告)号：US12094378B2

公开(公告)日：2024-09-17

申请号：US18005348

申请日：2020-07-17

Applicant: Hewlett-Packard Development Company, L.P.

Inventor： Joseph Nouri ,  Kevin Smathers

IPC: G09G3/00 ,  A61B5/16 ,  G06F3/01

CPC classification number: G09G3/003 ,  A61B5/163 ,  G06F3/013 ,  G09G2320/0666 ,  G09G2320/0686 ,  G09G2340/02 ,  G09G2340/0407 ,  G09G2354/00

Abstract: A computing device is configured to downsample an image that is displayable at a head-mountable display (HMD) to an image pixel representative of the image. The computing device computes a luminance of the image pixel from a color value of the image pixel to determine image brightness. The computing device is configured to determine the foveal region of the image from eye-tracking information of the user of the HMD. The computing device dowsamples the foveal region of the image to a foveal pixel representative of the foveal region. The computing device is configured to compute a luminance of the foveal pixel from a color value of the foveal pixel to determine foveal region brightness.

公开(公告)号：US11676357B2

公开(公告)日：2023-06-13

申请号：US17415000

申请日：2019-07-26

Applicant: Hewlett-Packard Development Company, L.P.

Inventor： Joseph Nouri ,  Robert Paul Martin ,  Mark Lessman ,  Tsung-Nung Huang

IPC: G06V10/145 ,  G06V40/16 ,  H04N23/56

CPC classification number: G06V10/145 ,  G06V40/166 ,  G06V40/174 ,  H04N23/56

Abstract: Structured light is projected onto an object, and an image of the object as illuminated by the projected structured light is captured. Reference object points are identified within the captured image, and the structured light projected onto the object is modified based on the identified reference object points. An additional image of the object as illuminated by the modified projected structured light is captured, and additional reference object points are identified within the captured additional image.

公开(公告)号：US20220021867A1

公开(公告)日：2022-01-20

申请号：US17298581

申请日：2019-03-13

Applicant: Hewlett-Packard Development Company, L.P.

Inventor： Joseph Nouri ,  Nathan Nuber

IPC: H04N13/327 ,  H04N13/383 ,  H04N13/344

Abstract: Computer-implemented methods, systems, apparatus, and computer-readable media (transitory or non-transitory) are described herein for detecting eye tracking calibration errors. In various examples, respective poses of first and second eyes of a wearer of a head-mounted display (“HMD”) may be determined. A portion of a first image rendered on a first display of the HMD may be selected based on the pose of the first eye of the wearer. The selected portion of the first image may be matched to a portion of a second image rendered on a second display of the HMD. An eye tracking calibration error may be determined based on the pose of the second eye of the wearer and a location of the portion of the second image.

公开(公告)号：US20210405741A1

公开(公告)日：2021-12-30

申请号：US17056866

申请日：2019-03-22

Applicant: Hewlett-Packard Development Company, L.P.

Inventor： Joseph Nouri ,  Eric Bokides

IPC: G06F3/01 ,  G06K9/00 ,  G06K9/62

Abstract: In various examples, a plurality of reference points may be generated by processing an image of an eye of a user from a vision sensor. The plurality of reference points may correspond to, for example, a boundary between a sclera of the eye and an eyelid of the user, a boundary between a pupil and a cornea, etc. Based on the reference points corresponding to the boundary between the sclera and the eyelid, a measure of the eye of the user may be detected.

公开(公告)号：US20240312151A1

公开(公告)日：2024-09-19

申请号：US18573330

申请日：2021-06-30

Applicant: Hewlett-Packard Development Company, L.P.

Inventor： Robert P. Martin ,  Joseph Nouri

IPC: G06T19/00 ,  G06F3/01

CPC classification number: G06T19/006 ,  G06F3/012

Abstract: A physical object is detected within one or multiple images captured by a camera of a head-mountable display (HMD). It is determined that the physical object is represented as a synthetic object within an extended reality (XR) environment of one or multiple images displayed by a display panel of the HMD. A portion of the synthetic object within the XR environment of the images displayed by the display panel of the HMD is replaced based on a corresponding portion of the physical object within the images captured by the camera.

公开(公告)号：US11550392B2

公开(公告)日：2023-01-10

申请号：US17414351

申请日：2019-05-20

Applicant: Hewlett-Packard Development Company, L.P.

Inventor： Robert Paul Martin ,  Joseph Nouri

IPC: G06F3/01 ,  A63F13/212 ,  A63F13/25

Abstract: In some examples, a facial gasket device includes a plurality of physiological sensors to detect physiological signals, and a signal processor to receive output signals based on measurements of the plurality of physiological sensors, the signal processor programmable to selectively combine a collection of the output signals to detect a target physiological activity of the user.

公开(公告)号：US20220350144A1

公开(公告)日：2022-11-03

申请号：US17414338

申请日：2019-07-31

Applicant: Hewlett-Packard Development Company, L.P.

Inventor： Nathan Nuber ,  Robert P. Martin ,  Joseph Nouri ,  Louis M. Gaiot ,  Owen Richard ,  Eric Bokides

IPC: G02B27/01

Abstract: In an example implementation, a head-mounted display (HMD) device includes a display, a variable lens receptacle to receive an interchangeable lens, a sensor to retrieve lens information from the lens, and a controller to obtain images that are predistorted according to the lens information, wherein the controller is to display the predistorted images on the display.

公开(公告)号：US20240312095A1

公开(公告)日：2024-09-19

申请号：US18576628

申请日：2021-07-09

Applicant: Hewlett-Packard Development Company, L.P.

Inventor： Jishang Wei ,  Joseph Nouri ,  Kaden Strand ,  Rafael Ballagas

IPC: G06T13/40 ,  G06V10/44 ,  G06V40/16

CPC classification number: G06T13/40 ,  G06V10/44 ,  G06V40/174

Abstract: Avatar training images of facial avatars having facial expressions corresponding to specified blendshape weights are rendered. A two-stage machine learning model is trained based on the rendered avatar training images and the specified blendshape weights. The machine learning model has a first stage extracting image features from the rendered avatar training images and a second stage predicting blendshape weights from the extracted image features. The trained machine learning model is applied to predict the blendshape weights for a facial expression of a wearer of a head-mountable display (HMD) from a set of images captured by the HMD of a face of the wearer when exhibiting the facial expression.

公开(公告)号：US20240201733A1

公开(公告)日：2024-06-20

申请号：US18555667

申请日：2021-04-23

Applicant: Hewlett-Packard Development Company, L.P.

Inventor： Joseph Nouri ,  Kaden Strand

IPC: G06F1/14

CPC classification number: G06F1/14

Abstract: As sensor readings are received from a hardware sensor, each sensor reading is stored within a buffer along with a system timestamp of a system clock indicating when the sensor reading was received. Each sensor reading includes a sensor timestamp of a sensor clock indicating when the sensor reading occurred at the hardware sensor. Responsive to receipt of each sensor reading, a synthetic timestamp compensating for skew between the system clock and the sensor clock is generated and applied to the sensor reading. The synthetic timestamp is generated based on an average skew of the sensor readings within the buffer and an initial system timestamp indicating when a first sensor reading was received.