-
公开(公告)号:US20240303897A1
公开(公告)日:2024-09-12
申请号:US18600552
申请日:2024-03-08
发明人: Carl Doersch , Yi Yang , Mel Vecerik , Dilara Gokay , Ankush Gupta , Yusuf Aytar , Joao Carreira , Andrew Zisserman
摘要: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for animating images using point trajectories.
-
公开(公告)号:US12067693B2
公开(公告)日:2024-08-20
申请号:US17518828
申请日:2021-11-04
申请人: Snap Inc.
发明人: Bernhard Jung , Daniel Wagner
CPC分类号: G06T3/18 , G06T13/40 , G06T13/80 , G06T15/205 , G06T2210/44
摘要: A method for minimizing latency of moving objects in an augmented reality (AR) display device is described. In one aspect, the method includes determining an initial pose of a visual tracking device, identifying an initial location of an object in an image that is generated by an optical sensor of the visual tracking device, the image corresponding to the initial pose of the visual tracking device, rendering virtual content based on the initial pose and the initial location of the object, retrieving an updated pose of the visual tracking device, tracking an updated location of the object in an updated image that corresponds to the updated pose, and applying a time warp transformation to the rendered virtual content based on the updated pose and the updated location of the object to generate transformed virtual content.
-
公开(公告)号:US20240265488A1
公开(公告)日:2024-08-08
申请号:US18618059
申请日:2024-03-27
CPC分类号: G06T3/18 , G02B27/0101 , G06T5/50 , G06T5/80 , G02B2027/014 , G06T2207/20221
摘要: A circuit apparatus includes a memory unit and a warp processing unit. The memory unit stores a warp object image. The warp processing unit performs warp processing on the warp object image and generates a display image displayed in a display area. The warp processing unit performs the warp processing on an image of a first view object of the warp object image based on a first warp parameter for vibration correction and distortion correction. Further, the warp processing unit performs the warp processing on an image of a second view object of the warp object image based on a second warp parameter for the distortion correction.
-
公开(公告)号:US12058300B2
公开(公告)日:2024-08-06
申请号:US18142202
申请日:2023-05-02
申请人: Snap Inc.
发明人: Sagi Katz , Matan Zohar , Ilya Levin
IPC分类号: H04N13/111 , G02B27/01 , G06T3/10 , G06T3/18 , G06T7/521 , H04N13/271
CPC分类号: H04N13/111 , G02B27/0176 , G06T3/10 , G06T3/18 , G06T7/521 , H04N13/271 , G02B2027/0178
摘要: A virtual wave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual wave creation system to generate, for each of multiple initial depth images, a respective wave image by applying a transformation function that is responsive to a selected input parameter to the initial three-dimensional coordinates. The virtual wave creation system creates a warped wave video including a sequence of the generated warped wave images. The virtual wave creation system presents, via an image display, the warped wave video.
-
公开(公告)号:US20240249378A1
公开(公告)日:2024-07-25
申请号:US18426228
申请日:2024-01-29
发明人: Joseph Lemay , Jacob Epstein
CPC分类号: G06T3/18 , G06T7/11 , G06T7/194 , G06T7/70 , B43L1/00 , G06T2207/20132 , G06T2207/30204
摘要: A system for capturing, organizing, and storing handwritten notes includes a plurality of boundary markers. The boundary markers are configured to be positioned on a writing surface. The system also includes a tangible non-transitory computer readable medium encoded with instructions which, when run on a camera-equipped computing device, causes the camera-equipped computing device to execute processes. The processes include capturing an image of the writing surface with the markers thereon. The processes also include detecting the boundary markers in the captured image. Additionally, the processes include identifying a virtual boundary in the captured image based on the positions of the boundary markers. The processes then unwarp a portion of the captured image within the virtual boundary to produce an unwarped image.
-
公开(公告)号:US20240223817A1
公开(公告)日:2024-07-04
申请号:US18563734
申请日:2022-07-05
申请人: Google LLC
发明人: George Dan Toderici , Eirikur Thor Agustsson , Fabian Julius Mentzer , David Charles Minnen , Johannes Balle , Nicholas Johnston
IPC分类号: H04N19/91 , G06T3/18 , G06T5/70 , H04N19/124 , H04N19/137
CPC分类号: H04N19/91 , G06T3/18 , G06T5/70 , H04N19/124 , H04N19/137 , G06T2207/20084
摘要: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for compressing video data. In one aspect, a method comprises: receiving a video sequence of frames; generating, using a flow prediction network, an optical flow between two sequential frames, wherein the two sequential frames comprise a first frame and a second frame that is subsequent the first frame; generating from the optical flow, using a first autoencoder neural network: a predicted optical flow between the first frame and the second frame; and warping a reconstruction of the first frame according to the predicted optical flow and subsequently applying a blurring operation to obtain an initial predicted reconstruction of the second frame.
-
公开(公告)号:US12026801B2
公开(公告)日:2024-07-02
申请号:US17326913
申请日:2021-05-21
发明人: Zhou Hong , Yufei Zhang
CPC分类号: G06T1/60 , G06F17/153 , G06T1/20 , G06T3/18 , G06T15/005
摘要: The disclosed technology relates to graphics processing units (GPU), In one aspect, a GPU includes a general purpose register (GPR) including registers, an arithmetic logic unit (ALU) reading pixels of an image independently of a shared memory, and a level 1 (L1) cache storing pixels to implement a pixel mapping that maps the pixels read from the L1 cache into the registers of the GPR. The pixel mapping includes separating pixels of an image into three regions, with each region including a set of pixels. A first and second set of the pixels are loaded into registers corresponding to two of the three regions horizontally, and a third set of the pixels are loaded into registers corresponding to the third of the three regions vertically. Each of the registers in the first, second, and third registers are loaded as a contiguous ordered number of registers in the GPR.
-
公开(公告)号:US12020481B2
公开(公告)日:2024-06-25
申请号:US17506805
申请日:2021-10-21
发明人: Feng-Sheng Lin , Sheng-Han Wu , Ruen-Rone Lee
摘要: A sports event video processing method is provided. The processing method includes: receiving a sports event input video; performing SOI detection on the sports event input video to obtain at least one SOI; performing logo detection and extraction on the at least one SOI to detect at least one logo; performing pixel-level rearrangement on the at least one detected logo; and outputting a sports event output video having completed pixel-level rearrangement.
-
公开(公告)号:US20240202866A1
公开(公告)日:2024-06-20
申请号:US18286522
申请日:2022-03-29
申请人: Apple Inc.
发明人: Samer Barakat , Bertrand Nepveu , Christian W. Gosch , Emmanuel Piuze-Phaneuf , Vincent Chapdelaine-Couture
CPC分类号: G06T3/18 , G02B27/017 , G06T7/55
摘要: In one implementation, a method of performing perspective correction of an image is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes capturing, using the image sensor, an image of a physical environment. The method includes obtaining a plurality of initial depths respectively associated with a plurality of pixels of the image of the physical environment. The method includes generating a depth map for the image of the physical environment based on the plurality of initial depths and a respective plurality of confidences of the plurality of initial depths. The method includes transforming, using the one or more processors, the image of the physical environment based on the depth map and a difference between a perspective of the image sensor and a perspective of a user. The method includes displaying, on the display, the transformed image.
-
公开(公告)号:US20240185378A1
公开(公告)日:2024-06-06
申请号:US18425760
申请日:2024-01-29
申请人: Stats LLC
发明人: Long Sha , Sujoy Ganguly , Patrick Joseph Lucey
IPC分类号: G06T3/00 , G06F18/214 , G06N3/08 , G06T3/18 , G06T7/11 , G06T7/80 , G06V10/24 , G06V10/82 , G06V20/40 , G06V30/19 , G06V30/262 , H04N21/854
CPC分类号: G06T3/00 , G06F18/214 , G06N3/08 , G06T3/18 , G06T7/11 , G06T7/80 , G06V10/24 , G06V10/82 , G06V20/49 , G06V30/19173 , G06V30/274 , H04N21/854 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/30244
摘要: A system and method of calibrating a broadcast video feed are disclosed herein. A computing system retrieves a plurality of broadcast video feeds that include a plurality of video frames. The computing system generates a trained neural network, by generating a plurality of training data sets based on the broadcast video feed and learning, by the neural network, to generate a homography matrix for each frame of the plurality of frames. The computing system receives a target broadcast video feed for a target sporting event. The computing system partitions the target broadcast video feed into a plurality of target frames. The computing system generates for each target frame in the plurality of target frames, via the neural network, a target homography matrix. The computing system calibrates the target broadcast video feed by warping each target frame by a respective target homography matrix.
-
-
-
-
-
-
-
-
-