-
公开(公告)号:US11449968B2
公开(公告)日:2022-09-20
申请号:US17139894
申请日:2020-12-31
Applicant: Samsung Electronics Co., Ltd.
Inventor: Kaimo Lin , Chenchi Luo , Yingmao Li , Youngjun Yoo
Abstract: A method includes obtaining, using at least one processor of an electronic device, multiple video frames of a video stream and multiple depth frames corresponding to the multiple video frames. The method also includes generating, using the at least one processor, multiple blur kernel maps based on the multiple depth frames. The method further includes reducing, using the at least one processor, depth errors in each of the multiple blur kernel maps. The method also includes performing, using the at least one processor, temporal smoothing on the multiple blur kernel maps to suppress temporal artifacts between different ones of the multiple blur kernel maps. In addition, the method includes generating, using the at least one processor, blur effects in the video stream using the multiple blur kernel maps.
-
公开(公告)号:US20220207655A1
公开(公告)日:2022-06-30
申请号:US17139894
申请日:2020-12-31
Applicant: Samsung Electronics Co., Ltd.
Inventor: Kaimo Lin , Chenchi Luo , Yingmao Li , Youngjun Yoo
Abstract: A method includes obtaining, using at least one processor of an electronic device, multiple video frames of a video stream and multiple depth frames corresponding to the multiple video frames. The method also includes generating, using the at least one processor, multiple blur kernel maps based on the multiple depth frames. The method further includes reducing, using the at least one processor, depth errors in each of the multiple blur kernel maps. The method also includes performing, using the at least one processor, temporal smoothing on the multiple blur kernel maps to suppress temporal artifacts between different ones of the multiple blur kernel maps. In addition, the method includes generating, using the at least one processor, blur effects in the video stream using the multiple blur kernel maps.
-
23.
公开(公告)号:US20220012903A1
公开(公告)日:2022-01-13
申请号:US16946956
申请日:2020-07-13
Applicant: Samsung Electronics Co., Ltd.
Inventor: Kushal K. Vyas , Yingmao Li , Chenchi Luo , George Q. Chen , Hamid R. Sheikh , Youngjun Yoo , Michael O. Polley
Abstract: A method includes obtaining, using at least one processor, an input image frame. The method also includes identifying, using the at least one processor, one or more regions of the input image frame containing redundant information. In addition, the method includes performing, using the at least one processor, an image processing task using the input image frame. The image processing task is guided based on the one or more identified regions of the input image frame. The method may further include obtaining, using the at least one processor, a coarse depth map associated with the input image frame. Performing the image processing task may include refining the coarse depth map to produce a refined depth map, where the refining of the coarse depth map is guided based on the one or more identified regions of the input image frame.
-
公开(公告)号:US11025942B2
公开(公告)日:2021-06-01
申请号:US15892141
申请日:2018-02-08
Applicant: Samsung Electronics Co., Ltd.
Inventor: Hamid R. Sheikh , Youngjun Yoo , Michael Polley , Chenchi Luo , David Liu
IPC: H04N19/48 , H04N19/167 , H04N19/11 , H04N19/44
Abstract: Methods and systems for compressed domain progressive application of computer vision techniques. A method for decoding video data includes receiving a video stream that is encoded for multi-stage decoding. The method includes partially decoding the video stream by performing one or more stages of the multi-stage decoding. The method includes determining whether a decision for a computer vision system can be identified based on the partially decoded video stream. Additionally, the method includes generating the decision for the computer vision system based on decoding of the video stream. A system for encoding video data includes a processor configured to receive the video data from a camera, encode the video data received from the camera into a video stream for consumption by a computer vision system, and include metadata with the encoded video stream to indicate whether a decision for the computer vision system can be identified from the metadata.
-
公开(公告)号:US10986287B2
公开(公告)日:2021-04-20
申请号:US16369071
申请日:2019-03-29
Applicant: Samsung Electronics, Co. Ltd.
Inventor: David Liu , Michael Polley , Youngjun F. Yoo , Hamid Rahim Sheikh , Kaimo Lin , George Chen , Chenchi Luo
Abstract: A method of capturing a photo using a mobile device is described. The method comprises detecting a signature motion of the mobile device; capturing video using a camera of the mobile device upon detecting the signature motion; and automatically identifying a start frame and an end frame of the captured images using neural networks. A mobile device for capturing a photo is also described.
-
公开(公告)号:US20200349426A1
公开(公告)日:2020-11-05
申请号:US16399928
申请日:2019-04-30
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Yuming Zhu , Hyejung Kim , John Seokjun Lee , Manish Goel
Abstract: A method, an electronic device, and computer readable medium are provided. The method includes receiving an input into a neural network that includes a kernel. The method also includes generating, during a convolution operation of the neural network, multiple panel matrices based on different portions of the input. The method additionally includes successively combining each of the multiple panel matrices with the kernel to generate an output. Generating the multiple panel matrices can include mapping elements within a moving window of the input onto columns of an indexing matrix, where a size of the window corresponds to the size of the kernel.
-
公开(公告)号:US20230245328A1
公开(公告)日:2023-08-03
申请号:US17590998
申请日:2022-02-02
Applicant: Samsung Electronics Co., Ltd.
Inventor: Yingmao Li , Chenchi Luo , Gyeongmin Choe , John Seokjun Lee
IPC: G06T7/269
CPC classification number: G06T7/269 , G06T2207/10016 , G06T2207/20081
Abstract: A method includes obtaining a first optical flow vector representing motion between consecutive video frames during a previous time step. The method also includes generating a first predicted optical flow vector from the first optical flow vector using a trained prediction model, where the first predicted optical flow vector represents predicted motion during a current time step. The method further includes refining the first predicted optical flow vector using a trained update model to generate a second optical flow vector representing motion during the current time step. The trained update model uses the first predicted optical flow vector, a video frame of the previous time step, and a video frame of the current time step to generate the second optical flow vector.
-
公开(公告)号:US11631163B2
公开(公告)日:2023-04-18
申请号:US16946989
申请日:2020-07-14
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Yingmao Li , Youngjun Yoo
Abstract: A method includes processing, using at least one processor of an electronic device, each of multiple images using a photometric augmentation engine, where the photometric augmentation engine performs one or more photometric augmentation operations. The method also includes applying, using the at least one processor, multiple layers of a convolutional neural network to each of the images, where each layer generates a corresponding feature map. The method further includes processing, using the at least one processor, at least one of the feature maps using at least one feature augmentation engine between consecutive layers of the multiple layers, where the at least one feature augmentation engine performs one or more feature augmentation operations.
-
公开(公告)号:US11593637B2
公开(公告)日:2023-02-28
申请号:US16399928
申请日:2019-04-30
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Yuming Zhu , Hyejung Kim , John Seokjun Lee , Manish Goel
Abstract: A method, an electronic device, and computer readable medium are provided. The method includes receiving an input into a neural network that includes a kernel. The method also includes generating, during a convolution operation of the neural network, multiple panel matrices based on different portions of the input. The method additionally includes successively combining each of the multiple panel matrices with the kernel to generate an output. Generating the multiple panel matrices can include mapping elements within a moving window of the input onto columns of an indexing matrix, where a size of the window corresponds to the size of the kernel.
-
公开(公告)号:US11556784B2
公开(公告)日:2023-01-17
申请号:US16693112
申请日:2019-11-22
Applicant: Samsung Electronics Co., Ltd.
Inventor: Chenchi Luo , Yingmao Li , Youngjun Yoo
Abstract: A method includes identifying, by at least one processor, multiple features of input data using a common feature extractor. The method also includes processing, by the at least one processor, at least some identified features using each of multiple pre-processing branches. Each pre-processing branch includes a first set of neural network layers and generates initial outputs associated with a different one of multiple data processing tasks. The method further includes combining, by the at least one processor, at least two initial outputs from at least two pre-processing branches to produce combined initial outputs. In addition, the method includes processing, by the at least one processor, at least some initial outputs or at least some combined initial outputs using each of multiple post-processing branches. Each post-processing branch includes a second set of neural network layers and generates final outputs associated with a different one of the multiple data processing tasks.
-
-
-
-
-
-
-
-
-