公开(公告)号：US20160092561A1

公开(公告)日：2016-03-31

申请号：US14559705

申请日：2014-12-03

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Douglas S. Price ,  Albert E. Keinath

IPC: G06F17/30 ,  G06K9/00 ,  G11B27/031 ,  G11B27/34 ,  G11B27/30

CPC classification number: G06F16/739 ,  G06F16/745 ,  G06F16/783 ,  G06F16/7837 ,  G06F16/7867 ,  G06K9/00718 ,  G06K9/00751 ,  G11B27/031 ,  G11B27/3081 ,  G11B27/34

Abstract: Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.

Abstract translation: 描述了基于元数据生成和分析改进视频编辑，汇总和导航的系统和过程。 元数据可以是基于内容的（例如，相邻帧之间的差异，曝光数据，关键帧识别数据，运动数据或面部检测数据）或非基于内容的（例如，曝光，焦点，位置，时间）并且被使用 对视频的部分进行优先排序和/或分类。 元数据可以在图像捕获时或在后处理期间生成。 诸如图像数据的各个部分的得分的优先级信息可以基于元数据和/或图像数据。 可以基于元数据和/或图像数据来确定诸如场景的类型或质量的分类信息。 分类和优先化信息可以是元数据，并且可以用于自动去除视频的不期望的部分，在编辑期间生成建议或自动生成汇总视频。

公开(公告)号：US20130070151A1

公开(公告)日：2013-03-21

申请号：US13677887

申请日：2012-11-15

Applicant: Apple Inc.

Inventor： Douglas S. Price ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N5/235

CPC classification number: H04N5/235 ,  H04N5/2351 ,  H04N5/243 ,  H04N2007/145

Abstract: Systems, methods, and a computer readable medium for performing auto exposure (AE) techniques that are beneficial in variable lighting conditions—and particularly applicable to handheld and/or mobile videoconferencing applications—are disclosed herein. Handheld and/or mobile videoconferencing applications—unlike their fixed camera counterparts—are often exposed to a wide variety of rapidly changing lighting and scene conditions, and thus face a difficult trade-off between adjusting exposure parameter values too frequently or not frequently enough. In personal electronic devices executing such handheld and/or mobile videoconferencing applications, it may be desirable to: use a small, centered, and center-weighted exposure metering region; set a relatively low brightness target value; and adjust the camera's exposure parameter values according to a distance-dependent convergence speed function. The use of such techniques, in conjunction with a relatively large stability region, may also improve the quality of a video encoder's temporal predictions—and thus video quality—in videoconferencing applications.

Abstract translation: 本文公开了用于执行可变照明条件有利的自动曝光（AE）技术的系统，方法和计算机可读介质，并且特别适用于手持和/或移动视频会议应用。 手持和/或移动视频会议应用程序（与固定摄像机对应的设备不同）通常会受到各种快速变化的照明和场景条件的影响，因此在过多调整曝光参数值或不够频繁地面临困难的折衷。 在执行这种手持和/或移动视频会议应用的个人电子设备中，可能需要：使用小的，中心的和中心加权的曝光计量区域; 设定相对较低的亮度目标值; 并根据距离相关的收敛速度功能调整相机的曝光参数值。 使用这样的技术结合相对较大的稳定性区域，也可以提高视频编码器在视频会议应用中的时间预测的质量，从而提高视频质量。

公开(公告)号：US10452713B2

公开(公告)日：2019-10-22

申请号：US14559705

申请日：2014-12-03

Applicant: Apple Inc.

Inventor： Shujie Liu ,  Ke Zhang ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Chris Y. Chung ,  James O. Normile ,  Douglas S. Price ,  Albert E. Keinath

IPC: G06F16/738 ,  G06F16/78 ,  G06F16/74 ,  G11B27/34 ,  G06K9/00 ,  G11B27/031 ,  G11B27/30 ,  G06F16/783

Abstract: Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.

公开(公告)号：US08724017B2

公开(公告)日：2014-05-13

申请号：US13677887

申请日：2012-11-15

Applicant: Apple Inc.

Inventor： Douglas S. Price ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC: H04N5/235

CPC classification number: H04N5/235 ,  H04N5/2351 ,  H04N5/243 ,  H04N2007/145

Abstract: Systems, methods, and a computer readable medium for performing auto exposure (AE) techniques that are beneficial in variable lighting conditions—and particularly applicable to handheld and/or mobile videoconferencing applications—are disclosed herein. Handheld and/or mobile videoconferencing applications—unlike their fixed camera counterparts—are often exposed to a wide variety of rapidly changing lighting and scene conditions, and thus face a difficult trade-off between adjusting exposure parameter values too frequently or not frequently enough. In personal electronic devices executing such handheld and/or mobile videoconferencing applications, it may be desirable to: use a small, centered, and center-weighted exposure metering region; set a relatively low brightness target value; and adjust the camera's exposure parameter values according to a distance-dependent convergence speed function. The use of such techniques, in conjunction with a relatively large stability region, may also improve the quality of a video encoder's temporal predictions—and thus video quality—in videoconferencing applications.

Abstract translation: 本文公开了用于执行可变照明条件有利的自动曝光（AE）技术的系统，方法和计算机可读介质，并且特别适用于手持和/或移动视频会议应用。 手持和/或移动视频会议应用程序（与固定摄像机对应的设备不同）通常会受到各种快速变化的照明和场景条件的影响，因此在过多调整曝光参数值或不够频繁地面临困难的折衷。 在执行这种手持和/或移动视频会议应用的个人电子设备中，可能需要：使用小的，中心的和中心加权的曝光计量区域; 设定相对较低的亮度目标值; 并根据距离相关的收敛速度功能调整相机的曝光参数值。 使用这样的技术结合相对较大的稳定性区域，也可以提高视频编码器在视频会议应用中的时间预测的质量，从而提高视频质量。