公开(公告)号：US12223661B2

公开(公告)日：2025-02-11

申请号：US17735728

申请日：2022-05-03

Applicant: ADOBE INC.

Inventor： Lu Zhang ,  Jianming Zhang ,  Zhe Lin ,  Radomir Mech

IPC: G06T7/11 ,  G06F3/01 ,  G06F3/04845 ,  G06N3/02 ,  G06T7/00 ,  G06T7/20 ,  G06T11/60

Abstract: Systems and methods provide editing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. An eye-gaze network may produce a hotspot map of predicted focal points in a video frame. These predicted focal points may then be used by a gaze-to-mask network to determine objects in the image and generate an object mask for each of the detected objects. This process may then be repeated to effectively track the trajectory of objects and object focal points in videos. Based on the determined trajectory of an object in a video clip and editing parameters, the editing engine may produce editing effects relative to an object for the video clip.

公开(公告)号：US11758082B2

公开(公告)日：2023-09-12

申请号：US17526853

申请日：2021-11-15

Applicant: Adobe Inc.

Inventor： Lu Zhang ,  Jianming Zhang ,  Zhe Lin ,  Radomir Meeh

IPC: H04N5/262 ,  G11B27/031 ,  G06V20/40 ,  G06V10/20 ,  G06V40/18

CPC classification number: H04N5/2628 ,  G06V10/255 ,  G06V20/40 ,  G06V20/41 ,  G11B27/031 ,  G06V40/193

Abstract: Systems and methods provide reframing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. A reframing engine may processes video clips using a segmentation and hotspot module to determine a salient region of an object, generate a mask of the object, and track the trajectory of an object in the video clips. The reframing engine may then receive reframing parameters from a crop suggestion module and a user interface. Based on the determined trajectory of an object in a video clip and reframing parameters, the reframing engine may use reframing logic to produce temporally consistent reframing effects relative to an object for the video clip.

公开(公告)号：US11367199B2

公开(公告)日：2022-06-21

申请号：US16900483

申请日：2020-06-12

Applicant: ADOBE INC.

Inventor： Lu Zhang ,  Jianming Zhang ,  Zhe Lin ,  Radomir Mech

IPC: G06K9/62 ,  G06T7/20 ,  G06T7/00 ,  G06T11/60 ,  G06F3/01 ,  G06N3/02 ,  G06F3/04845

Abstract: Systems and methods provide editing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. An eye-gaze network may produce a hotspot map of predicted focal points in a video frame. These predicted focal points may then be used by a gaze-to-mask network to determine objects in the image and generate an object mask for each of the detected objects. This process may then be repeated to effectively track the trajectory of objects and object focal points in videos. Based on the determined trajectory of an object in a video clip and editing parameters, the editing engine may produce editing effects relative to an object for the video clip.

公开(公告)号：US20210392278A1

公开(公告)日：2021-12-16

申请号：US16900435

申请日：2020-06-12

Applicant: ADOBE INC.

Inventor： Lu Zhang ,  Jianming Zhang ,  Zhe Lin ,  Radomir Mech

IPC: H04N5/262 ,  G06K9/46 ,  G06K9/00 ,  G11B27/031

Abstract: Systems and methods provide reframing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. A reframing engine may processes video clips using a segmentation and hotspot module to determine a salient region of an object, generate a mask of the object, and track the trajectory of an object in the video clips. The reframing engine may then receive reframing parameters from a crop suggestion module and a user interface. Based on the determined trajectory of an object in a video clip and reframing parameters, the reframing engine may use reframing logic to produce temporally consistent reframing effects relative to an object for the video clip.

公开(公告)号：US20210390710A1

公开(公告)日：2021-12-16

申请号：US16900483

申请日：2020-06-12

Applicant: Adobe Inc.

Inventor： Lu Zhang ,  Jianming Zhang ,  Zhe Lin ,  Radomir Mech

IPC: G06T7/20 ,  G06T7/00 ,  G06T11/60 ,  G06F3/01 ,  G06F3/0484 ,  G06N3/02

Abstract: Systems and methods provide editing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. An eye-gaze network may produce a hotspot map of predicted focal points in a video frame. These predicted focal points may then be used by a gaze-to-mask network to determine objects in the image and generate an object mask for each of the detected objects. This process may then be repeated to effectively track the trajectory of objects and object focal points in videos. Based on the determined trajectory of an object in a video clip and editing parameters, the editing engine may produce editing effects relative to an object for the video clip.

公开(公告)号：US20220262011A1

公开(公告)日：2022-08-18

申请号：US17735728

申请日：2022-05-03

Applicant: ADOBE INC.

Inventor： Lu Zhang ,  Jianming Zhang ,  Zhe Lin ,  Radomir Mech

IPC: G06T7/20 ,  G06T7/00 ,  G06T11/60 ,  G06F3/01 ,  G06N3/02 ,  G06F3/04845

Abstract: Systems and methods provide editing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. An eye-gaze network may produce a hotspot map of predicted focal points in a video frame. These predicted focal points may then be used by a gaze-to-mask network to determine objects in the image and generate an object mask for each of the detected objects. This process may then be repeated to effectively track the trajectory of objects and object focal points in videos. Based on the determined trajectory of an object in a video clip and editing parameters, the editing engine may produce editing effects relative to an object for the video clip.

公开(公告)号：US20220078358A1

公开(公告)日：2022-03-10

申请号：US17526853

申请日：2021-11-15

Applicant: Adobe Inc.

Inventor： Lu Zhang ,  Jianming Zhang ,  Zhe Lin ,  Radomir Mech

IPC: H04N5/262 ,  G11B27/031 ,  G06K9/00 ,  G06K9/46

Abstract: Systems and methods provide reframing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. A reframing engine may processes video clips using a segmentation and hotspot module to determine a salient region of an object, generate a mask of the object, and track the trajectory of an object in the video clips. The reframing engine may then receive reframing parameters from a crop suggestion module and a user interface. Based on the determined trajectory of an object in a video clip and reframing parameters, the reframing engine may use reframing logic to produce temporally consistent reframing effects relative to an object for the video clip.

公开(公告)号：US11184558B1

公开(公告)日：2021-11-23

申请号：US16900435

申请日：2020-06-12

Applicant: ADOBE INC.

Inventor： Lu Zhang ,  Jianming Zhang ,  Zhe Lin ,  Radomir Mech

IPC: H04N5/262 ,  G11B27/031 ,  G06K9/00 ,  G06K9/46

Abstract: Systems and methods provide reframing operations in a smart editing system that may generate a focal point within a mask of an object for each frame of a video segment and perform editing effects on the frames of the video segment to quickly provide users with natural video editing effects. A reframing engine may processes video clips using a segmentation and hotspot module to determine a salient region of an object, generate a mask of the object, and track the trajectory of an object in the video clips. The reframing engine may then receive reframing parameters from a crop suggestion module and a user interface. Based on the determined trajectory of an object in a video clip and reframing parameters, the reframing engine may use reframing logic to produce temporally consistent reframing effects relative to an object for the video clip.