Gaze-driven recording of video
    3.
    发明授权

    公开(公告)号:US11825103B2

    公开(公告)日:2023-11-21

    申请号:US17825167

    申请日:2022-05-26

    申请人: Apple Inc.

    IPC分类号: H04N19/23 G06F3/01 G11B27/02

    CPC分类号: H04N19/23 G06F3/013 G11B27/02

    摘要: Systems and methods for gaze-driven recording of video are described. Some implementations may include accessing gaze data captured using one or more gaze-tracking sensors; applying a temporal filter to the gaze data to obtain a smoothed gaze estimate; determining a region of interest based on the smoothed gaze estimate, wherein the region of interest identifies a subset of a field of view; accessing a frame of video; recording a portion of the frame associated with the region of interest as an enhanced frame of video, wherein the portion of the frame corresponds to a smaller field of view than the frame; and storing, transmitting, or displaying the enhanced frame of video.

    Video transmission based on independently encoded background updates

    公开(公告)号:US09871967B2

    公开(公告)日:2018-01-16

    申请号:US14603212

    申请日:2015-01-22

    申请人: Huddly AS

    摘要: Systems and methods are provided for alleviating bandwidth limitations of video transmission and enhancing the quality of videos at a receiver. In particular, an improved video transmission system is provided for generating high-resolution videos. The systems have therein a transmitter and a receiver; the transmitter includes an outer encoder and a core encoder, while the receiver includes a core decoder and an outer decoder. The outer encoder is adapted to receive the video from a source and separately output a salient video and an encoded background, and the outer decoder is adapted to merge the background with the salient video thereby producing an enhanced video. Also provided is a system that simulates pan-tilt-zoom (PTZ) operations without PTZ hardware. Further provided are methods for video transmission whereby a background model is initialized, a background independently encoded, updated incrementally, and the background and the updates transmitted independently from the video.

    Standards-compliant model-based video encoding and decoding

    公开(公告)号:US09743078B2

    公开(公告)日:2017-08-22

    申请号:US13797644

    申请日:2013-03-12

    IPC分类号: H04N7/26 H04N19/50 H04N19/543

    摘要: A model-based compression codec applies higher-level modeling to produce better predictions than can be found through conventional block-based motion estimation and compensation. Computer-vision-based feature and object detection algorithms identify regions of interest throughout the video datacube. The detected features and objects are modeled with a compact set of parameters, and similar feature/object instances are associated across frames. Associated features/objects are formed into tracks and related to specific blocks of video data to be encoded. The tracking information is used to produce model-based predictions for those blocks of data, enabling more efficient navigation of the prediction search space than is typically achievable through conventional motion estimation methods. A hybrid framework enables modeling of data at multiple fidelities and selects the appropriate level of modeling for each portion of video data. A compliant-stream version of the model-based compression codec uses the modeling information indirectly to improve compression while producing bitstreams that can be interpreted by standard decoders.