-
公开(公告)号:US11783582B2
公开(公告)日:2023-10-10
申请号:US17876786
申请日:2022-07-29
Applicant: Snap Inc.
Inventor: Stephen Pomes
IPC: G06V20/20 , G06K9/62 , G09B21/00 , G10L13/047 , G06F3/16 , G06N3/02 , G06F18/24 , G06F18/211 , G06F18/213
CPC classification number: G06V20/20 , G06F3/16 , G06F18/211 , G06F18/213 , G06F18/24 , G06N3/02 , G09B21/006 , G10L13/047
Abstract: An eyewear device with camera-based compensation that improves the user experience for user's having partial blindness or complete blindness. The camera-based compensation determines objects, converts determined objects to text, and then converts the text to audio that is indicative of the objects and that is perceptible to the eyewear user. The camera-based compensation may use a region-based convolutional neural network (RCNN) to generate a feature map including text that is indicative of objects in images captured by a camera. Relevant text of the feature map is then processed through a text to speech algorithm featuring a natural language processor to generate audio indicative of the objects in the processed images.
-
公开(公告)号:US11774764B2
公开(公告)日:2023-10-03
申请号:US17954473
申请日:2022-09-28
Applicant: Snap Inc.
Inventor: Stephen Pomes
CPC classification number: G02B27/0172 , G09G5/10 , G02B2027/0118 , G02B2027/0178 , G09G2354/00
Abstract: An eyewear device that adjusts aspects of a displayed object as a function of a user's eyeglass prescription. A detector identifies object edges for displayed far objects. A correction chart stores brightness corrections as a function of eyeglass prescriptions. The object edges are brightened as a function of the brightness corrections to sharpen objects displayed for a user with nearsightedness and/or farsightedness.
-
公开(公告)号:US12241755B2
公开(公告)日:2025-03-04
申请号:US18530820
申请日:2023-12-06
Applicant: Snap Inc.
Inventor: Stephen Pomes , Yu Jiang Tham
Abstract: Eyewear having a light array and vibration sensors for indicating to a user when to turn left and right, such as when the eyewear is operating a navigation map application, that improves the user experience of eyewear devices for users having partial blindness or complete blindness. To compensate for partial blindness, the front portion of the eyewear frame, such as the bridge, may include the light array, where the left portion of the light array is illuminated to indicate to the user to turn left. The right portion of the light array is illuminated to indicate to the user to turn right. To compensate for complete users having complete blindness, the eyewear has a vibration device on each side of the eyewear, such as in the temples, which selectively vibrate to indicate when the user should turn left and right.
-
公开(公告)号:US20230020122A1
公开(公告)日:2023-01-19
申请号:US17954473
申请日:2022-09-28
Applicant: Snap Inc.
Inventor: Stephen Pomes
Abstract: An eyewear device that adjusts aspects of a displayed object as a function of a user's eyeglass prescription. A detector identifies object edges for displayed far objects. A correction chart stores brightness corrections as a function of eyeglass prescriptions. The object edges are brightened as a function of the brightness corrections to sharpen objects displayed for a user with nearsightedness and/or farsightedness.
-
公开(公告)号:US11830494B2
公开(公告)日:2023-11-28
申请号:US18084926
申请日:2022-12-20
Applicant: Snap Inc.
Inventor: Stephen Pomes
Abstract: An eyewear device with camera-based compensation that improves the user experience for user's having partial blindness or complete blindness. The camera-based compensation determines features, such as objects, and then converts the determined objects to audio that is indicative of the objects and that is perceptible to the eyewear user. The camera-based compensation may use a region-based convolutional neural network (RCNN) to generate a feature map including text that is indicative of objects in images captured by a camera. The feature map is then processed through a speech to audio algorithm featuring a natural language processor to generate audio indicative of the objects in the processed images.
-
公开(公告)号:US11675217B2
公开(公告)日:2023-06-13
申请号:US17537087
申请日:2021-11-29
Applicant: Snap Inc.
Inventor: Stephen Pomes , Yu Jiang Tham
IPC: G02C11/04 , G08B7/06 , G06F3/01 , H04N13/239
CPC classification number: G02C11/04 , G08B7/06 , G06F3/012 , G06F3/013 , H04N13/239
Abstract: Eyewear having a light array and vibration sensors for indicating to a user the direction and distance of an object relative to the eyewear to help a user understand and avoid objects. To compensate for partial blindness, the front portion of the eyewear frame may include the light array, where one or more lights of the light array is illuminated to indicate a corresponding direction of a proximate object. The relative brightness of the one or more lights indicates how close the object is, where brighter light(s) indicates a close object. To compensate for more severe partial blindness or complete blindness, the eyewear has haptics, such as a plurality of vibration devices on the front portion of the eyewear, such as in the bridge, which selectively vibrate to indicate a direction of the object. The stronger the vibration, the closer the object.
-
公开(公告)号:US11506902B2
公开(公告)日:2022-11-22
申请号:US17464338
申请日:2021-09-01
Applicant: Snap Inc.
Inventor: Stephen Pomes
Abstract: An eyewear device that adjusts aspects of a displayed object as a function of a user's eyeglass prescription. A detector identifies object edges for displayed far objects. A correction chart stores brightness corrections as a function of eyeglass prescriptions. The object edges are brightened as a function of the brightness corrections to sharpen objects displayed for a user with nearsightedness and/or farsightedness.
-
-
-
-
-
-