公开(公告)号：US12283291B1

公开(公告)日：2025-04-22

申请号：US18450695

申请日：2023-08-16

Applicant: Amazon Technologies, Inc.

Inventor： Noah Lirone Sarfati ,  Ido Yerushalmy ,  Michael Chertok ,  Ianir Ideses

IPC: G11B27/036 ,  G10L15/26 ,  H04N21/81 ,  H04N21/8549

Abstract: Systems, devices, and methods are provided for determining factually consistent generative narrations. A narrative may be generated by performing steps to determine one or more metadata messages for a first portion of a video stream, determine transcribed commentary for a second portion of the video stream, wherein the second portion includes the first portion, and determine a prompt based at least in part on the one or more metadata messages and the transcribed commentary. The prompt may be provided to a generative model that produces an output text. Techniques for performing a factual consistency evaluation may be used to determine a consistency score for the output text that indicates whether the output text is factually consistent with the one or more metadata messages and the transcribed commentary. A narrated highlight video may be generated using the consistent narrative.

公开(公告)号：US20230419730A1

公开(公告)日：2023-12-28

申请号：US17850596

申请日：2022-06-27

Applicant: Amazon Technologies, Inc.

Inventor： Ido Yerushalmy ,  Amir Dudai ,  Eli Alshan

IPC: G06V40/20 ,  G06T7/73 ,  G06V10/26 ,  G06V40/10 ,  G06V10/70 ,  A63B71/06

CPC classification number: G06V40/23 ,  G06T7/75 ,  G06V10/26 ,  G06V40/10 ,  G06V10/70 ,  A63B71/0622 ,  G06T2207/30196 ,  G06T2207/20081 ,  A63B2220/05 ,  A63B2220/807 ,  A63B2220/17 ,  A63B2071/0694 ,  A63B2071/0625 ,  A63B2071/0655

Abstract: Described are systems and methods directed to the processing of two-dimensional (“2D”) images of a body to determine a physical activity performed by the body, repetitions of the physical activity, whether the body is performing the physical activity with proper form, and providing physical activity feedback. In addition, the disclosed implementations are able to determine the physical activity, repetitions, and/or form through the processing of 2D partial body images that include less than all of the body of the user.

公开(公告)号：US12067806B2

公开(公告)日：2024-08-20

申请号：US17176479

申请日：2021-02-16

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Eduard Oks ,  Ridge Carpenter ,  Lamarr Smith ,  Claire McGowan ,  Elizabeth Reisman ,  Ianir Ideses ,  Eli Alshan ,  Mark Kliger ,  Matan Goldman ,  Liza Potikha ,  Ido Yerushalmy ,  Dotan Kaufman ,  Guy Adam ,  Omer Meir ,  Lior Fritz ,  Imry Kissos ,  Georgy Melamed ,  Eran Borenstein ,  Sharon Alpert ,  Noam Sorek

IPC: G06K9/00 ,  G06N20/00 ,  G06T7/70 ,  G06V40/20

CPC classification number: G06V40/23 ,  G06N20/00 ,  G06T7/70

Abstract: Characteristics of a user's movement are evaluated based on performance of activities by a user within a field of view of a camera. Video data representing performance of a series of movements by the user is acquired by the camera. Pose data is determined based on the video data, the pose data representing positions of the user's body while performing the movements. The pose data is compared to a set of existing videos that correspond to known errors to identify errors performed by the user. The errors may be used to generate scores for various characteristics of the user's movement. Based on the errors, exercises or other activities to improve the movement of the user may be determined and included in an output presented to the user.

公开(公告)号：US11961331B1

公开(公告)日：2024-04-16

申请号：US17446390

申请日：2021-08-30

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Ido Yerushalmy ,  Michael Chertok ,  Sharon Alpert

IPC: G06V40/20 ,  G06N20/00 ,  G06T7/73 ,  G06V10/98 ,  G06V20/40

CPC classification number: G06V40/23 ,  G06N20/00 ,  G06T7/73 ,  G06V10/993 ,  G06V20/46 ,  G06T2207/10016 ,  G06T2207/20081

Abstract: A first computing device acquires video data representing a user performing an activity. The first device uses a first pose extraction algorithm to determine a pose of the user within a frame of video data. If the pose is determined to be potentially inaccurate, the user is prompted for authorization to send the frame of video data to a second computing device. If authorization is granted, the second computing device may use a different algorithm to determine a pose of the user and send data indicative of this pose to the first computing device to enable the first computing device to update a score or other output. The second computing device may also use the frame of video data as training data to retrain or modify the first pose extraction algorithm, and may send the modified algorithm to the first computing device for future use.

公开(公告)号：US11771863B1

公开(公告)日：2023-10-03

申请号：US16710211

申请日：2019-12-11

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Eli Alshan ,  Mark Kliger ,  Ido Yerushalmy ,  Liza Potikha ,  Dotan Kaufman ,  Ianir Ideses ,  Eduard Oks ,  Noam Sorek

IPC: G08B21/04 ,  A61M21/02 ,  G16H10/60 ,  G16H50/30 ,  G16H20/00 ,  G06Q10/1093 ,  G06V40/20 ,  G06V40/16 ,  A61M21/00

CPC classification number: A61M21/02 ,  G06Q10/1097 ,  G06V40/176 ,  G06V40/23 ,  G16H10/60 ,  G16H20/00 ,  G16H50/30 ,  A61M2021/0016 ,  A61M2021/0022 ,  A61M2021/0044 ,  A61M2021/005 ,  A61M2205/3306 ,  A61M2205/3375 ,  A61M2205/50 ,  A61M2205/52 ,  A61M2230/04 ,  A61M2230/06 ,  A61M2230/20 ,  A61M2230/30 ,  A61M2230/42 ,  A61M2230/50 ,  A61M2230/62 ,  A61M2230/63

Abstract: Systems for assisting a user in performance of a meditation activity or another type of activity are described. The systems receive user input and sensor data indicating physiological values associated with the user. These values are used to determine a recommended type of activity and a length of time for the activity. While the user performs the activity, sensors are used to measure physiological values, and an output that is provided to the user is selected based on the measured physiological values. The output may be selected to assist the user in reaching target physiological values, such as a slower respiration rate. After completion of the activity, additional physiological values are used to determine the effectiveness of the activity and the output that was provided. The effectiveness of the activity and the output may be used to determine future recommendations and future output.

公开(公告)号：US11861944B1

公开(公告)日：2024-01-02

申请号：US16582789

申请日：2019-09-25

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Ido Yerushalmy ,  Ianir Ideses ,  Eli Alshan ,  Mark Kliger ,  Liza Potikha ,  Dotan Kaufman ,  Sharon Alpert ,  Eduard Oks ,  Noam Sorek

IPC: H04N5/04 ,  G06V40/20 ,  G06V20/40

CPC classification number: G06V40/23 ,  G06V20/40 ,  H04N5/04

Abstract: Video output is generated based on first video data that depicts the user performing an activity. Poses of the user during performance of the activity are compared with second video data that depicts an instructor performing the activity. Corresponding poses of the user's body and the instructor's body may be determined through comparison of the first and second video data. The video data is used to determine the rate of motion of the user and to generate video output in which a visual representation of the instructor moves at a rate similar to the that of the user. For example, video output generated based on an instructional fitness video may be synchronized so that movement of the presented instructor matches the rate of movement of the user performing an exercise, improving user comprehension and performance.