-
11.
公开(公告)号:US12216818B2
公开(公告)日:2025-02-04
申请号:US18384648
申请日:2023-10-27
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Jongchul Choi , Sangho Yoon , Bonkon Koo , Jeonggeun Yun , Youngmo Jeong
Abstract: An augmented reality (AR) device for obtaining depth information of an object in a real world, includes: a gaze tracking sensor configured to obtain a gaze point by tracking a gaze direction of a user's eye; a depth sensor configured to obtain depth information of the object; a memory storing one or more instructions; and at least one processor configured to execute the one or more instructions to: determine a region of interest (ROI) confidence level indicating a degree to which at least one partial region within a field of view (FOV) of the AR device is predicted as an ROI, based on at least one of a moving speed, an acceleration, a fixation time, a fixation number, or a location of the gaze point; determine an ROI based on the ROI confidence level; and set a parameter for controlling an operation of the depth sensor to obtain depth information of the object within the ROI.
-
公开(公告)号:US12073016B2
公开(公告)日:2024-08-27
申请号:US17678613
申请日:2022-02-23
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Doyoun Kim , Harry Edward Milton , Bonkon Koo , Sangho Yoon , Youngmo Jeong
CPC classification number: G06F3/013 , G02B27/0093 , G02B27/0172 , G06F3/011 , G06F3/017 , A61B3/024 , A61B3/032 , G02B2027/0125 , G02B2027/0138
Abstract: Provided is an electronic device for detecting lost portions of a field of vision and distorted portions of a field of vision and storing these in a vision map. The lost portions and distorted portions are identified in cooperation with the user by means of virtual image superposition on a real scene, audible requests to the user, gesture inputs provided by the user and gaze tracking. The electronic device may detect an object and provide visual information to a user when the object is in a lost portion or distorted portion of the field of vision.
-
公开(公告)号:US11924536B2
公开(公告)日:2024-03-05
申请号:US17846810
申请日:2022-06-22
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Kyookeun Lee , Bonkon Koo , Doyoun Kim , Harry Edward Milton
CPC classification number: H04N23/56 , G02B27/0172 , G02B27/0179 , G06F3/013 , G06T7/246 , G06T7/50 , G06T7/73 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06T2207/10048 , G06T2207/30201
Abstract: Provided is an augmented reality device including a variable focus lens, an eye tracking sensor configured to emit light to eyes of a user, receive the light reflected by the eyes of the user, and detect a plurality of feature points based on the light reflected by the eyes of the user, and at least one processor configured to obtain information with respect to eye relief, which is a distance between the eyes of the user and the variable focus lens, based on position information of the plurality of feature points detected by the eye tracking sensor, obtain information with respect to a gaze point at which gaze directions of the eyes of the user converge, and an interpupillary distance of the eyes of the user, based on the plurality of feature points, and determine a position of a focal region of the variable focus lens based on the information with respect to the eye relief, the gaze point, and the interpupillary distance.
-
公开(公告)号:US11809623B2
公开(公告)日:2023-11-07
申请号:US17985464
申请日:2022-11-11
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Bonkon Koo , Jaewoo Ko , Wonwoo Lee
IPC: G06F3/01 , G02B27/00 , G02B27/01 , G06T7/521 , G06T7/593 , G06T19/00 , G06V10/145 , G06V10/94 , G06V20/20 , G06V40/18 , G06V10/25
CPC classification number: G06F3/013 , G02B27/0093 , G02B27/017 , G06T7/521 , G06T7/593 , G06T19/006 , G06V10/145 , G06V10/25 , G06V10/94 , G06V20/20 , G06V40/18 , G02B2027/0178 , G06T2207/10028 , G06T2215/16
Abstract: A head-mounted display device includes an eye tracking sensor configured to obtain eye information by tracking both eyes of a user, a depth sensor configured to obtain depth information about one or more objects, and a processor configured to obtain information about a gaze point based on the eye information, and determine a measurement parameter of the depth sensor based on the information about the gaze point.
-
公开(公告)号:US11422622B2
公开(公告)日:2022-08-23
申请号:US17334130
申请日:2021-05-28
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Youngmo Jeong , Bonkon Koo , Sunghwan Shin
IPC: G09G5/00 , G06F3/01 , G06T3/40 , H04L67/131 , G06T7/73
Abstract: An electronic device that outputs at least one calibration point through a display, obtains gaze information corresponding to the at least one calibration point by using a gaze tracking sensor in response to an output of guide information instructing a user wearing the electronic device to gaze at the at least one calibration point, obtains a gaze accuracy corresponding to the at least one calibration point based on the obtained gaze information, determines a gaze zone-specific resolution based on the gaze accuracy corresponding to the at least one calibration point, and outputs an image through the display based on the determined gaze zone-specific resolution.
-
公开(公告)号:US12279033B2
公开(公告)日:2025-04-15
申请号:US18430233
申请日:2024-02-01
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Kyookeun Lee , Bonkon Koo , Doyoun Kim , Harry Edward Milton
Abstract: Provided is an augmented reality device including a variable focus lens, an eye tracking sensor configured to emit light to eyes of a user, receive the light reflected by the eyes of the user, and detect a plurality of feature points based on the light reflected by the eyes of the user, and at least one processor configured to obtain information with respect to eye relief, which is a distance between the eyes of the user and the variable focus lens, based on position information of the plurality of feature points detected by the eye tracking sensor, obtain information with respect to a gaze point at which gaze directions of the eyes of the user converge, and an interpupillary distance of the eyes of the user, based on the plurality of feature points, and determine a position of a focal region of the variable focus lens based on the information with respect to the eye relief, the gaze point, and the interpupillary distance.
-
公开(公告)号:US11868524B2
公开(公告)日:2024-01-09
申请号:US17561329
申请日:2021-12-23
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Kimin Kim , Dowan Kim , Bonkon Koo , Taehwa Hong
CPC classification number: G06F3/013 , G06V40/18 , G09G3/2092 , G09G2320/0626 , G09G2330/021 , G09G2354/00
Abstract: An augmented reality (AR) device is provided. The AR device includes a display module configured to output light of a virtual image, a waveguide configured to transmit the output light of the virtual image to an eye of a user and to pass external light therethrough, a gaze tracking sensor configured to obtain information on the eye of the user, the information including a pupil size, a memory storing instructions, and a processor configured to execute the instructions to control the display module to adjust a brightness of the light of the virtual image based on the pupil size.
-
公开(公告)号:US11527004B2
公开(公告)日:2022-12-13
申请号:US17167778
申请日:2021-02-04
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Bonkon Koo , Jongchul Choi , Kyookeun Lee , Jaeyun Jeong
Abstract: An electronic device including an eye tracking sensor configured to detect viewing direction of eye of a user; a camera; a tilting unit configured to adjust a direction of the camera; a memory; and a processor configured to obtain information about a gaze point of the user; determine a region of interest (ROI) based on the information about the gaze point; obtain two or more images including the ROI at different tilt angles; and determine depth information of the ROI by using the obtained two or more images.
-
公开(公告)号:US11526004B2
公开(公告)日:2022-12-13
申请号:US16818698
申请日:2020-03-13
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Bonkon Koo , Jaewoo Ko , Wonwoo Lee
Abstract: A head-mounted display device includes an eye tracking sensor configured to obtain eye information by tracking both eyes of a user, a depth sensor configured to obtain depth information about one or more objects, and a processor configured to obtain information about a gaze point based on the eye information, and determine a measurement parameter of the depth sensor based on the information about the gaze point.
-
公开(公告)号:US11490022B2
公开(公告)日:2022-11-01
申请号:US16940662
申请日:2020-07-28
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Wonwoo Lee , Bonkon Koo
Abstract: An operating method of an AR glass apparatus includes obtaining a preview image through a camera of the apparatus, tracking a gaze direction of a user wearing the apparatus, determining an object of interest in the preview image based on the tracked gaze direction, obtaining local motion information indicating a movement of the object of interest by tracking the movement of the object of interest, measuring a movement of the apparatus, obtaining global motion information indicating a movement of a background region included in the preview image based on the measured movement of the apparatus, adjusting a degree of exposure based on the local motion information and the global motion information, and photographing a front of the apparatus through the camera having the adjusted degree of exposure.
-
-
-
-
-
-
-
-
-