-
1.发明授权公开(公告)号：US11211060B2
公开(公告)日：2021-12-28
申请号：US16887418
申请日：2020-05-29
申请人： Adobe Inc.
发明人： Wilmot Li , Jovan Popovic , Deepali Aneja , David Simons
IPC分类号： G10L15/197 , G06N3/04 , G06N3/08 , G10L15/02 , G10L15/06 , G10L21/0316 , G10L25/21 , G10L25/24
摘要： Disclosed systems and methods predict visemes from an audio sequence. In an example, a viseme-generation application accesses a first audio sequence that is mapped to a sequence of visemes. The first audio sequence has a first length and represents phonemes. The application adjusts a second length of a second audio sequence such that the second length equals the first length and represents the phonemes. The application adjusts the sequence of visemes to the second audio sequence such that phonemes in the second audio sequence correspond to the phonemes in the first audio sequence. The application trains a machine-learning model with the second audio sequence and the sequence of visemes. The machine-learning model predicts an additional sequence of visemes based on an additional sequence of audio.
-
2.发明申请公开(公告)号：US20190392823A1
公开(公告)日：2019-12-26
申请号：US16016418
申请日：2018-06-22
申请人： Adobe Inc.
发明人： Wilmot Li , Jovan Popovic , Deepali Aneja , David Simons
IPC分类号： G10L15/197 , G06N3/08 , G06N3/04 , G10L15/06 , G10L15/02 , G10L25/24 , G10L25/21 , G10L21/0316
摘要： Disclosed systems and methods predict visemes from an audio sequence. A viseme-generation application accesses a first set of training data that includes a first audio sequence representing a sentence spoken by a first speaker and a sequence of visemes. Each viseme is mapped to a respective audio sample of the first audio sequence. The viseme-generation application creates a second set of training data adjusting a second audio sequence spoken by a second speaker speaking the sentence such that the second and first sequences have the same length and at least one phoneme occurs at the same time stamp in the first sequence and in the second sequence. The viseme-generation application maps the sequence of visemes to the second audio sequence and trains a viseme prediction model to predict a sequence of visemes from an audio sequence.
-
公开(公告)号：US11461947B2
公开(公告)日：2022-10-04
申请号：US17187273
申请日：2021-02-26
申请人： Adobe Inc.
发明人： Ashwani Chandil , Wilmot Li , Vineet Batra , Matthew David Fisher , Kevin Wampler , Daniel Kaufman , Ankit Phogat
摘要： Embodiments are disclosed for constrained modification of vector geometry. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving a selection of a first segment of a vector graphic to be edited, identifying an active region associated with the first segment, wherein the active region includes the first segment and at least one second segment which comprise a geometric primitive, identifying the region of influence including at least one third segment connected to the active region, identifying at least one constraint associated with the active region or the region of influence based at least on the geometric primitive, receiving an edit to the active region, and generating an update for the vector graphic based on the edit and the at least one constraint.
-
公开(公告)号：US11361467B2
公开(公告)日：2022-06-14
申请号：US16692450
申请日：2019-11-22
申请人： Adobe Inc. , Princeton University
发明人： Wilmot Li , Hijung Shin , Adam Finkelstein , Nora Willett
摘要： This disclosure generally relates to character animation. More specifically, this disclosure relates to pose selection using data analytics techniques applied to training data, and generating 2D animations of illustrated characters using performance data and the selected poses. An example process or system includes extracting sets of joint positions from a training video including the subject, grouping the plurality of frames into frame groups using the sets of joint positions for each frame, identifying a representative frame for each frame group using the frame groups, clustering the frame groups into clusters using the representative frames, outputting a visualization of the clusters at a user interface, and receiving a selection of a cluster for animation of the subject.
-
公开(公告)号：US11423549B2
公开(公告)日：2022-08-23
申请号：US16683665
申请日：2019-11-14
申请人： Adobe Inc.
发明人： Nazmus Saquib , Rubaiat Habib Kazi , Li-Yi Wei , Wilmot Li
摘要： This disclosure involves mapping body movements to graphical manipulations for real-time human interaction with graphics. Certain aspects involve importing graphical elements and mapping input actions, such as gestures, to output graphical effects, such as moving, resizing, changing opacity, and/or deforming a graphic, by using nodes of a reference skeleton and edges (e.g., links) between the nodes of the reference skeleton and the pins. The mapping is used to trigger and interact with the graphical elements with body position and/or movement.
-
公开(公告)号：US11164355B1
公开(公告)日：2021-11-02
申请号：US16856269
申请日：2020-04-23
申请人： ADOBE INC.
发明人： Ankit Phogat , Kevin Wampler , Wilmot Li , Matthew David Fisher , Vineet Batra , Daniel Kaufman
摘要： Systems and methods for editing an image based on multiple constraints are described. Embodiments of the systems and methods may identify a change to a vector graphics data structure, generate an update for the vector graphics data structure based on strictly enforcing a handle constraint, a binding constraint, and a continuity constraint, adjust the vector graphics data structure sequentially for each of a plurality of sculpting constraints according to a priority ordering of the sculpting constraints, generate an additional update for the vector graphics data structure based on strictly enforcing the binding constraint and the continuity constraint and approximately enforcing the handle constraint and the sculpting constraints, adjust the vector graphics data structure sequentially for each of a plurality of sculpting constraints, and display the vector graphic based on the adjusted vector graphics data structure.
-
公开(公告)号：US20210150731A1
公开(公告)日：2021-05-20
申请号：US16683665
申请日：2019-11-14
申请人： Adobe Inc.
发明人： Nazmus Saquib , Rubaiat Habib Kazi , Li-Yi Wei , Wilmot Li
摘要： This disclosure involves mapping body movements to graphical manipulations for real-time human interaction with graphics. Certain aspects involve importing graphical elements and mapping input actions, such as gestures, to output graphical effects, such as moving, resizing, changing opacity, and/or deforming a graphic, by using nodes of a reference skeleton and edges (e.g., links) between the nodes of the reference skeleton and the pins. The mapping is used to trigger and interact with the graphical elements with body position and/or movement.
-
公开(公告)号：US11182905B2
公开(公告)日：2021-11-23
申请号：US16825583
申请日：2020-03-20
申请人： Adobe Inc.
发明人： Hijung Shin , Holger Winnemoeller , Wilmot Li
摘要： Introduced here are computer programs and associated computer-implemented techniques for finding the correspondence between sets of graphical elements that share a similar structure. In contrast to conventional approaches, this approach can leverage the similar structure to discover how two sets of graphical elements are related to one another without the relationship needing to be explicitly specified. To accomplish this, a graphics editing platform can employ one or more algorithms designed to encode the structure of graphical elements using a directed graph and then compute element-to-element correspondence between different sets of graphical elements that share a similar structure.
-
公开(公告)号：US20210158593A1
公开(公告)日：2021-05-27
申请号：US16692471
申请日：2019-11-22
申请人： Adobe Inc. , Princeton University
发明人： Wilmot Li , Hijung Shin , Adam Finkelstein , Nora Willett
摘要： This disclosure generally relates to character animation. More specifically, but not by way of limitation, this disclosure relates to pose selection using data analytics techniques applied to training data, and generating 2D animations of illustrated characters using performance data and the selected poses. An example process or system includes obtaining a selection of training poses of the subject and a set of character poses, obtaining a performance video of the subject, wherein the performance video includes a plurality of performance frames that include poses performed by the subject, grouping the plurality of performance frames into groups of performance frames, assigning a selected training pose from the selection of training poses to each group of performance frames using the clusters of training frames, generating a sequence of character poses based on the groups of performance frames and their assigned training poses, outputting the sequence of character poses.
-
公开(公告)号：US20210158565A1
公开(公告)日：2021-05-27
申请号：US16692450
申请日：2019-11-22
申请人： Adobe Inc. , Princeton University
发明人： Wilmot Li , Hijung Shin , Adam Finkelstein , Nora Willett
摘要： This disclosure generally relates to character animation. More specifically, this disclosure relates to pose selection using data analytics techniques applied to training data, and generating 2D animations of illustrated characters using performance data and the selected poses. An example process or system includes extracting sets of joint positions from a training video including the subject, grouping the plurality of frames into frame groups using the sets of joint positions for each frame, identifying a representative frame for each frame group using the frame groups, clustering the frame groups into clusters using the representative frames, outputting a visualization of the clusters at a user interface, and receiving a selection of a cluster for animation of the subject.
-
-
-
-
-
-
-
-
-
搜索结果
17 条记录 (耗时 0.018 秒)
