System and method for AI enhanced shutter button user interface

    公开(公告)号:US11743574B2

    公开(公告)日:2023-08-29

    申请号:US17484822

    申请日:2021-09-24

    CPC classification number: H04N23/631 H04N23/611

    Abstract: An electronic device includes a display, a camera, and a processing device. The processing device is configured to determine whether (i) a user's face or eyes are within the camera's field of view or (ii) a gaze of the user is directed towards the display. The processing device is also configured, in response to determining that (i) the user's face or eyes are not within the camera's field of view or (ii) the gaze of the user is not directed towards the display, to modify a user interface button presented on the display. The user interface button may represent a shutter button configured to cause the camera or another camera of the electronic device to capture one or more images.

    Mobile data augmentation engine for personalized on-device deep learning system

    公开(公告)号:US11631163B2

    公开(公告)日:2023-04-18

    申请号:US16946989

    申请日:2020-07-14

    Abstract: A method includes processing, using at least one processor of an electronic device, each of multiple images using a photometric augmentation engine, where the photometric augmentation engine performs one or more photometric augmentation operations. The method also includes applying, using the at least one processor, multiple layers of a convolutional neural network to each of the images, where each layer generates a corresponding feature map. The method further includes processing, using the at least one processor, at least one of the feature maps using at least one feature augmentation engine between consecutive layers of the multiple layers, where the at least one feature augmentation engine performs one or more feature augmentation operations.

    Multi-task fusion neural network architecture

    公开(公告)号:US11556784B2

    公开(公告)日:2023-01-17

    申请号:US16693112

    申请日:2019-11-22

    Abstract: A method includes identifying, by at least one processor, multiple features of input data using a common feature extractor. The method also includes processing, by the at least one processor, at least some identified features using each of multiple pre-processing branches. Each pre-processing branch includes a first set of neural network layers and generates initial outputs associated with a different one of multiple data processing tasks. The method further includes combining, by the at least one processor, at least two initial outputs from at least two pre-processing branches to produce combined initial outputs. In addition, the method includes processing, by the at least one processor, at least some initial outputs or at least some combined initial outputs using each of multiple post-processing branches. Each post-processing branch includes a second set of neural network layers and generates final outputs associated with a different one of the multiple data processing tasks.

    Super-resolution depth map generation for multi-camera or other environments

    公开(公告)号:US11503266B2

    公开(公告)日:2022-11-15

    申请号:US16811585

    申请日:2020-03-06

    Abstract: A method includes obtaining, using at least one processor, first and second input image frames, where the first and second input image frames are associated with first and second image planes, respectively. The method also includes obtaining, using the at least one processor, a depth map associated with the first input image frame. The method further includes producing another version of the depth map by performing one or more times: (a) projecting, using the at least one processor, the first input image frame to the second image plane in order to produce a projected image frame using (i) the depth map and (ii) information identifying a conversion from the first image plane to the second image plane and (b) adjusting, using the at least one processor, at least one of the depth map and the information identifying the conversion from the first image plane to the second image plane.

    ARRAY-BASED DEPTH ESTIMATION
    26.
    发明申请

    公开(公告)号:US20210248769A1

    公开(公告)日:2021-08-12

    申请号:US17027106

    申请日:2020-09-21

    Abstract: A method includes obtaining at least three input image frames of a scene captured using at least three imaging sensors. The input image frames include a reference image frame and multiple non-reference image frames. The method also includes generating multiple disparity maps using the input image frames. Each disparity map is associated with the reference image frame and a different non-reference image frame. The method further includes generating multiple confidence maps using the input image frames. Each confidence map identifies weights associated with one of the disparity maps. In addition, the method includes generating a depth map of the scene using the disparity maps and the confidence maps. The imaging sensors are arranged to define multiple baseline directions, where each baseline direction extends between the imaging sensor used to capture the reference image frame and the imaging sensor used to capture a different non-reference image frame.

    Wearable augmented reality head mounted display device for phone content display and health monitoring

    公开(公告)号:US11048325B2

    公开(公告)日:2021-06-29

    申请号:US15646048

    申请日:2017-07-10

    Abstract: An embodiment of this disclosure provides a wearable device. The wearable device includes a memory configured to store a plurality of content for display, a transceiver configured to receive the plurality of content from a connected device, a display configured to display the plurality of content, and a processor coupled to the memory, the display, and the transceiver. The processor is configured to control the display to display at least some of the plurality of content in a spatially arranged format. The displayed content is on the display at a display position. The plurality of content, when shown on the connected device, is not in the spatially arranged format. The processor is also configured to receive movement information based on a movement of the wearable device. The processor is also configured to adjust the display position of the displayed content according to the movement information of the wearable device.

    System and method for natural three-dimensional calibration for robust eye tracking

    公开(公告)号:US10936057B2

    公开(公告)日:2021-03-02

    申请号:US16379713

    申请日:2019-04-09

    Abstract: A method for eye tracking in a head-mountable device (HMD) includes determining at least one object within a three-dimensional (3D) extended reality (XR) environment as an eye tracking calibration point and determining a 3D location of the eye tracking calibration point within the XR environment. The method also includes detecting a gaze point of a user of the HMD and comparing the detected gaze point to an area of the XR environment that includes the 3D location of the eye tracking calibration point. The method further includes, in response to determining that the user is looking at the eye tracking calibration point based on the detected gaze point being within the area, calibrating, using a processor, the HMD to correct a difference between the eye tracking calibration point and the detected gaze point. In addition, the method includes, in response to determining that the user is not looking at the eye tracking calibration point based on the detected gaze point being outside of the area, maintaining an existing calibration of the HMD.

    SYSTEM AND METHOD FOR INVERTIBLE WAVELET LAYER FOR NEURAL NETWORKS

    公开(公告)号:US20200349411A1

    公开(公告)日:2020-11-05

    申请号:US16399998

    申请日:2019-04-30

    Abstract: An electronic device, method, and computer readable medium for an invertible wavelet layer for neural networks are provided. The electronic device includes a memory and at least one processor coupled to the memory. The at least one processor is configured to receive an input to a neural network, apply a wavelet transform to the input at a wavelet layer of the neural network, and generate a plurality of subbands of the input as a result of the wavelet transform.

    APPARATUS AND METHOD FOR OPERATING MULTIPLE CAMERAS FOR DIGITAL PHOTOGRAPHY

    公开(公告)号:US20200186710A1

    公开(公告)日:2020-06-11

    申请号:US16704982

    申请日:2019-12-05

    Abstract: A method includes, in a first mode, positioning first and second tiltable image sensor modules of an image sensor array of an electronic device so that a first optical axis of the first tiltable image sensor module and a second optical axis of the second tiltable image sensor module are substantially perpendicular to a surface of the electronic device, and the first and second tiltable image sensor modules are within a thickness profile of the electronic device. The method also includes, in a second mode, tilting the first and second tiltable image sensor modules so that the first optical axis of the first tiltable image sensor module and the second optical axis of the second tiltable image sensor module are not perpendicular to the surface of the electronic device, and at least part of the first and second tiltable image sensor modules are no longer within the thickness profile of the electronic device.

Patent Agency Ranking