-
公开(公告)号:US20240354997A1
公开(公告)日:2024-10-24
申请号:US18430369
申请日:2024-02-16
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Dimitar Petkov Dinev , Siddarth Ravichandran , Hyun Jae Kang , Ondrej Texler , Anthony Sylvain Jean-Yves Liot , Sajid Sadi
IPC: G06T9/00 , G06T3/40 , G06T11/00 , G06V10/771
CPC classification number: G06T9/00 , G06T3/40 , G06T11/00 , G06V10/771
Abstract: Generating images includes generating encoded data by encoding input data into a latent space. The encoded data is decoded through a first decoder having first decoder layers by processing the encoded data through one or more of the first decoder layers. The encoded data is decoded through a second decoder having second decoder layers by processing the encoded data through one or more of the second decoder layers. An updated feature map is generated by replacing at least a portion of a feature map output from a selected layer of the first decoder layers with at least a portion of a feature map output from a selected layer of the second decoder layers. An image is generated by further decoding the updated feature map through one or more additional layers of the first decoder layers.
-
公开(公告)号:US20240013464A1
公开(公告)日:2024-01-11
申请号:US18296202
申请日:2023-04-05
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Siddarth Ravichandran , Dimitar Petkov Dinev , Ondrej Texler , Ankur Gupta , Janvi Chetan Palan , Hyun Jae Kang , Anthony Sylvain Jean-Yves Liot , Sajid Sadi
CPC classification number: G06T13/40 , G06T13/205 , G06T5/50 , G06T7/13 , G06T7/73 , G06V10/761 , G06T2207/20081 , G06T2207/20221 , G06T2207/30201
Abstract: Multimodal disentanglement can include generating a set of silhouette images corresponding to a human face, the generating undoing a correlation between an upper portion and a lower portion of the human face depicted by each silhouette image. A unimodal machine learning model can be trained with the set of silhouette images. As trained, the unimodal machine learning model can generate synthetic images of the human face. The synthetic images generated by the unimodal machine learning model once trained can be used to train a multimodal rendering network. The multimodal rendering network can be trained to generate a voice-animated digital human. Training the multimodal rendering network can be based on minimizing differences between the synthetic images and images generated by the multimodal rendering network.
-
公开(公告)号:US12169880B2
公开(公告)日:2024-12-17
申请号:US17967868
申请日:2022-10-17
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Ondrej Texler , Dimitar Petkov Dinev , Ankur Gupta , Hyun Jae Kang , Anthony Sylvain Jean-Yves Liot , Siddarth Ravichandran , Sajid Sadi
Abstract: Image generation using a hierarchical, model-based system includes generating a first region of an image using a first neural network model. The first region of the image is provided to a second neural network model as input. A second region of the image is generated using the second neural network model. The second region of the image shares a boundary with at least a portion of the first region of the image.
-
公开(公告)号:US20240221254A1
公开(公告)日:2024-07-04
申请号:US18342726
申请日:2023-06-27
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Hyun Jae Kang , Siddarth Ravichandran , Ondrej Texler , Dimitar Petkov Dinev , Anthony Sylvain Jean-Yves Liot , Sajid Sadi
Abstract: Image-to-image translations using 1D inputs includes concatenating multiple 1D vectors forming a concatenated 1D vector. The multiplicity of 1D vectors includes 1D vectors of at least two different modalities. An encoded 1D vector is generated by encoding the concatenated 1D vector. An encoded 2D array of features is generated by reshaping an arrangement of features of the encoded 1D feature vector. An image of a virtual human is generated by decoding the encoded 2D array.
-
公开(公告)号:US20240331088A1
公开(公告)日:2024-10-03
申请号:US18422466
申请日:2024-01-25
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Rahul Lokesh , Sandipan Banerjee , Hyun Jae Kang , Ondrej Texler , Sajid Sadi
IPC: G06T3/4053 , G06T3/4046
CPC classification number: G06T3/4053 , G06T3/4046
Abstract: An ultralight rendering system is capable of generating first content locally within a first data processing system. The first data processing system is capable of monitoring for second content conveyed from a second data processing system. The first data processing system plays a version of the first content. The first data processing system is capable of dynamically switching, by the first data processing system, between playing the version of the first content and playing a version of the second content based on receipt of the second content by the first data processing system.
-
公开(公告)号:US20240323459A1
公开(公告)日:2024-09-26
申请号:US18419123
申请日:2024-01-22
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Anthony Sylvain Jean-Yves Liot , Anil Unnikrishnan , Sajid Sadi , Sandipan Banerjee , Vignesh Gokul , Janvi Chetan Palan , Hyun Jae Kang , Ondrej Texler
IPC: H04N21/231 , H04N21/266 , H04N21/845
CPC classification number: H04N21/23106 , H04N21/266 , H04N21/8455
Abstract: Computer-implemented content delivery includes caching a source content having a plurality of bridge points. A user event indicating an interaction with a user is received. The user event is received during playback of the source content. In response to the user event, a template is selected from a plurality of cached templates. The template corresponds to a bridge point selected from the plurality of bridge points of the source content as an exit point from the source content. In response to the user event, a bridge is dynamically generated. The bridge links the bridge point with the template. In response to the user event, a target content is selected from a plurality of cached target contents. In response to the user event, the bridge, the template, and the target content is conveyed to a device of the user for playback following the bridge point of the source content.
-
公开(公告)号:US20240221260A1
公开(公告)日:2024-07-04
申请号:US18342721
申请日:2023-06-27
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Dimitar Petkov Dinev , Ondrej Texler , Siddarth Ravichandran , Janvi Chetan Palan , Hyun Jae Kang , Ankur Gupta , Anil Unnikrishnan , Anthony Sylvain Jean-Yves Liot , Sajid Sadi
CPC classification number: G06T13/40 , G06T13/205 , G06T19/20 , G06V40/174 , G06V40/20 , G06T2219/2004
Abstract: Synthesizing speech and movement of a virtual human includes capturing supplemental data generated by a transducer. The supplemental data specifies one or more attributes of a user. The capturing is performed in substantially real-time with the user providing input to a conversational platform. A behavior determiner generates behavioral data based on the supplemental data and an audio response generated by the conversational platform in response to the input to the conversation platform. Based on the behavioral data and the audio response, a rendering network generates a video rendering of a virtual human engaging in a conversation with the user, the video rendering synchronized with the audio response.
-
公开(公告)号:US20230394732A1
公开(公告)日:2023-12-07
申请号:US17967872
申请日:2022-10-17
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Siddarth Ravichandran , Anthony Sylvain Jean-Yves Liot , Dimitar Petkov Dinev , Ondrej Texler , Hyun Jae Kang , Janvi Chetan Palan , Sajid Sadi
CPC classification number: G06T13/40 , G06T17/20 , G06T7/70 , G10L15/25 , G06T2207/30201
Abstract: Creating images and animations of lip motion from mouth shape data includes providing, as one or more input features to a neural network model, a vector of a plurality of coefficients. Each vector of the plurality of coefficients corresponds to a different mouth shape. Using the neural network model, a data structure output specifying a visual representation of a mouth including lips having a shape corresponding to the vector is generated.
-
公开(公告)号:US20230394715A1
公开(公告)日:2023-12-07
申请号:US17967868
申请日:2022-10-17
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Ondrej Texler , Dimitar Petkov Dinev , Ankur Gupta , Hyun Jae Kang , Anthony Sylvain Jean-Yves Liot , Siddarth Ravichandran , Sajid Sadi
CPC classification number: G06T11/00 , G06T13/00 , G06T7/70 , G06T2207/20084 , G06T2207/30201
Abstract: Image generation using a hierarchical, model-based system includes generating a first region of an image using a first neural network model. The first region of the image is provided to a second neural network model as input. A second region of the image is generated using the second neural network model. The second region of the image shares a boundary with at least a portion of the first region of the image.
-
-
-
-
-
-
-
-