公开(公告)号：US12067806B2

公开(公告)日：2024-08-20

申请号：US17176479

申请日：2021-02-16

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Eduard Oks ,  Ridge Carpenter ,  Lamarr Smith ,  Claire McGowan ,  Elizabeth Reisman ,  Ianir Ideses ,  Eli Alshan ,  Mark Kliger ,  Matan Goldman ,  Liza Potikha ,  Ido Yerushalmy ,  Dotan Kaufman ,  Guy Adam ,  Omer Meir ,  Lior Fritz ,  Imry Kissos ,  Georgy Melamed ,  Eran Borenstein ,  Sharon Alpert ,  Noam Sorek

IPC: G06K9/00 ,  G06N20/00 ,  G06T7/70 ,  G06V40/20

CPC classification number: G06V40/23 ,  G06N20/00 ,  G06T7/70

Abstract: Characteristics of a user's movement are evaluated based on performance of activities by a user within a field of view of a camera. Video data representing performance of a series of movements by the user is acquired by the camera. Pose data is determined based on the video data, the pose data representing positions of the user's body while performing the movements. The pose data is compared to a set of existing videos that correspond to known errors to identify errors performed by the user. The errors may be used to generate scores for various characteristics of the user's movement. Based on the errors, exercises or other activities to improve the movement of the user may be determined and included in an output presented to the user.

公开(公告)号：US11955145B1

公开(公告)日：2024-04-09

申请号：US17113888

申请日：2020-12-07

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Dotan Kaufman ,  Guy Adam ,  Eran Borenstein ,  Ianir Ideses ,  Eduard Oks ,  Noam Sorek

IPC: G11B27/19 ,  G06T7/70 ,  G06V40/20 ,  G11B27/11 ,  G11B27/00

CPC classification number: G11B27/19 ,  G06T7/70 ,  G06V40/23 ,  G11B27/11 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: Video output is synchronized to the actions of a user by determining positions of the user's body based on acquired video of the user. The positions of the user's body are compared to the positions of a body shown in the video output to determine corresponding positions in the video output. The video output may then be synchronized so that the subsequent output that is shown corresponds to the subsequent position attempted by the user. The rate of movement of the user may be used to determine output characteristics for the video to cause the body shown in the video output to appear to move at a similar rate to that of the user. If the user moves at a rate less than a threshold or performs an activity erroneously, the video output may be slowed or portions of the video output may be repeated.

公开(公告)号：US11771863B1

公开(公告)日：2023-10-03

申请号：US16710211

申请日：2019-12-11

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Eli Alshan ,  Mark Kliger ,  Ido Yerushalmy ,  Liza Potikha ,  Dotan Kaufman ,  Ianir Ideses ,  Eduard Oks ,  Noam Sorek

IPC: G08B21/04 ,  A61M21/02 ,  G16H10/60 ,  G16H50/30 ,  G16H20/00 ,  G06Q10/1093 ,  G06V40/20 ,  G06V40/16 ,  A61M21/00

CPC classification number: A61M21/02 ,  G06Q10/1097 ,  G06V40/176 ,  G06V40/23 ,  G16H10/60 ,  G16H20/00 ,  G16H50/30 ,  A61M2021/0016 ,  A61M2021/0022 ,  A61M2021/0044 ,  A61M2021/005 ,  A61M2205/3306 ,  A61M2205/3375 ,  A61M2205/50 ,  A61M2205/52 ,  A61M2230/04 ,  A61M2230/06 ,  A61M2230/20 ,  A61M2230/30 ,  A61M2230/42 ,  A61M2230/50 ,  A61M2230/62 ,  A61M2230/63

Abstract: Systems for assisting a user in performance of a meditation activity or another type of activity are described. The systems receive user input and sensor data indicating physiological values associated with the user. These values are used to determine a recommended type of activity and a length of time for the activity. While the user performs the activity, sensors are used to measure physiological values, and an output that is provided to the user is selected based on the measured physiological values. The output may be selected to assist the user in reaching target physiological values, such as a slower respiration rate. After completion of the activity, additional physiological values are used to determine the effectiveness of the activity and the output that was provided. The effectiveness of the activity and the output may be used to determine future recommendations and future output.

公开(公告)号：US11158344B1

公开(公告)日：2021-10-26

申请号：US14870227

申请日：2015-09-30

Applicant: Amazon Technologies, Inc.

Inventor： Matthew Alan Townsend ,  Rohith Mysore Vijaya Kumar ,  Yadunandana Nagaraja Rao ,  Ambrish Tyagi ,  Eduard Oks ,  Apoorv Chaudhri

IPC: G11B27/031 ,  H04N9/79

Abstract: Devices, systems and methods are disclosed for improving story assembly and video summarization. For example, video clips may be received and a theme may be determined from the received video clips based on annotation data or other characteristics of the received video data. Individual moments may be extracted from the video clips, based on the selected theme and the annotation data. The moments may be ranked based on a priority metric corresponding to content determined to be desirable for purposes of video summarization. Select moments may be chosen based on the priority metric and a structure may be determined based on the selected theme. Finally, a video summarization may be generated using the selected theme and the structure, the video summarization including the select moments.

公开(公告)号：US10580453B1

公开(公告)日：2020-03-03

申请号：US15479489

申请日：2017-04-05

Applicant: Amazon Technologies, Inc.

Inventor： Matthew Alan Townsend ,  Moshe Bouhnik ,  Konstantin Kraimer ,  Eduard Oks

IPC: G11B27/02 ,  H04N5/262 ,  G06K9/00 ,  G06K9/62 ,  G06T7/60 ,  G06K9/52 ,  G06K9/46 ,  G06T7/90 ,  G06T7/73 ,  H04N5/232

Abstract: A system and method for determining video clips including interesting content from video data. The system may receive annotation data identifying time and positions corresponding to objects represented in the video data and the system may determine priority metrics associated with each of the objects. By associating the priority metrics with the time and positions corresponding to the objects, the system may generate a priority metric map indicating a time and position of interesting moments in the video data. The system may generate moments and/or video clips based on the priority metric map. The system may determine a time (e.g., video frames) and/or space (e.g., pixel coordinates) associated with the moments/video clips and may simulate camera motion such as panning and/or zooming with the moments/video clips. The system may generate a Master Clip Table including the moments, video clips and/or annotation data associated with the moments/video clips.

公开(公告)号：US11682237B1

公开(公告)日：2023-06-20

申请号：US17012662

申请日：2020-09-04

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Eran Borenstein ,  Guy Adam ,  Dotan Kaufman ,  Ianir Ideses ,  Eduard Oks ,  Noam Sorek ,  Lior Fritz ,  Omer Meir ,  Imry Kissos ,  Matan Goldman

IPC: G06K9/00 ,  G06V40/20 ,  G06T7/70 ,  G06F18/22

CPC classification number: G06V40/23 ,  G06F18/22 ,  G06T7/70

Abstract: A first user generates video data for performance of an activity, such as a fitness exercise, by performing the activity in front of a camera. Based on the video data, the amount of movement of different parts of the first user's body is determined. Data representing the position of the first user over time is generated. The data may take the form of a function or a signal that is based on the function. The locations of body parts that move significantly are prioritized over other body parts when determining this data. At a subsequent time, a second user performs the activity. The number of times the second user completes the activity is counted by determining the number of times the second user reaches a position corresponding to a maximum value in the data representing the position of the first user.

公开(公告)号：US11961601B1

公开(公告)日：2024-04-16

申请号：US16919870

申请日：2020-07-02

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Imry Kissos ,  Joel Wilson Brown ,  Ilia Vitsnudel ,  Omer Meir ,  Lior Fritz ,  Matan Goldman ,  Eduard Oks

IPC: G16H20/30 ,  A63B24/00 ,  A63B71/06 ,  G06T19/20 ,  G06V20/40 ,  G06V40/20 ,  G09B19/00

CPC classification number: G16H20/30 ,  A63B24/0006 ,  A63B71/0622 ,  G06T19/20 ,  G06V20/40 ,  G06V40/23 ,  G09B19/003 ,  A63B2024/0009 ,  A63B2024/0068 ,  A63B2024/0096 ,  A63B2071/0647 ,  A63B2220/806 ,  A63B2220/833 ,  A63B2220/836 ,  G06T2200/24 ,  G06T2219/2016

Abstract: To assist a user in the correct performance of an activity, video data is acquired. A pose of the user is determined from the video data and an avatar is generated representing the user in the pose. The pose of the user is compared to one or more other poses representing correct performance of the activity to determine one or more differences that may represent errors by the user. Depending on the activity that is being performed, some errors may be presented to the user during performance of the activity, while other errors may be presented after performance of the activity has ceased. To present an indication of an error, a specific body part or other portion of the avatar that corresponds to a difference between the user's pose and a correct pose may be presented along with an instruction regarding correct performance of the activity.

公开(公告)号：US11880492B1

公开(公告)日：2024-01-23

申请号：US17019934

申请日：2020-09-14

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Dotan Kaufman ,  Guy Adam ,  Eran Borenstein ,  Ianir Ideses ,  Eduard Oks ,  Noam Sorek

IPC: G06T7/73 ,  G06F21/62 ,  G06T5/00 ,  G09B19/00 ,  G09B5/06 ,  H04N5/272 ,  G06V20/40 ,  G06V40/16 ,  H04N23/90

CPC classification number: G06F21/6263 ,  G06T5/005 ,  G06T7/73 ,  G06V20/40 ,  G06V40/161 ,  G09B5/065 ,  G09B19/003 ,  H04N5/272 ,  H04N23/90 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30196

Abstract: First video data representing performance of an activity by a first user is acquired. Poses of the first user are determined from the first video data. Second video data is generated based on the determined poses and based on appearance data that represents a second user, such as a model, paid performer, and so forth, in various poses. The resulting second video data depicts the second user performing the same poses as the first user. The second video data may then be sent to a recipient. For example, a participant in an exercise class may send a video to an instructor that depicts what appears to be the paid performer performing the poses, instead of the participant. As a result, video data showing the participant is not shared, protecting the privacy of the participant while still allowing them to participate and interact.

公开(公告)号：US11783542B1

公开(公告)日：2023-10-10

申请号：US17489487

申请日：2021-09-29

Applicant: Amazon Technologies, Inc.

Inventor： Matan Goldman ,  Lior Fritz ,  Omer Meir ,  Imry Kissos ,  Yaar Harari ,  Eduard Oks ,  Mark Kliger

IPC: G06T17/20 ,  G06T7/20 ,  H04N5/04 ,  G06N3/08 ,  G06T7/70 ,  G06N3/045

CPC classification number: G06T17/20 ,  G06N3/045 ,  G06N3/08 ,  G06T7/20 ,  G06T7/70 ,  H04N5/04 ,  G06T2207/30196 ,  G06T2207/30244

Abstract: Devices and techniques are generally described for three dimensional mesh generation. In various examples, first two-dimensional (2D) image data representing a human body may be received from a first image sensor. Second 2D image data representing the human body may be received from a second image sensor. A first pose parameter and a first shape parameter may be determined using a first three-dimensional (3D) mesh prediction model and the first 2D image data. A second pose parameter and a second shape parameter may be determined using a second 3D mesh prediction model and the second 2D image data. In various examples, an updated 3D mesh prediction model may be generated from the first 3D mesh prediction model based at least in part on a first difference between the first pose parameter and the second pose parameter and a second difference between the first shape parameter and the second shape parameter.

公开(公告)号：US20220122639A1

公开(公告)日：2022-04-21

申请号：US17492781

申请日：2021-10-04

Applicant: Amazon Technologies, Inc.

Inventor： Matthew Alan Townsend ,  Rohith Mysore Vijaya Kumar ,  Yadunandana Nagaraja Rao ,  Ambrish Tyagi ,  Eduard Oks ,  Apoorv Chaudhri

IPC: G11B27/031 ,  H04N9/79

Abstract: Devices, systems and methods are disclosed for improving story assembly and video summarization. For example, video clips may be received and a theme may be determined from the received video clips based on annotation data or other characteristics of the received video data. Individual moments may be extracted from the video clips, based on the selected theme and the annotation data. The moments may be ranked based on a priority metric corresponding to content determined to be desirable for purposes of video summarization. Select moments may be chosen based on the priority metric and a structure may be determined based on the selected theme. Finally, a video summarization may be generated using the selected theme and the structure, the video summarization including the select moments.