公开(公告)号：US20240314397A1

公开(公告)日：2024-09-19

申请号：US18120769

申请日：2023-03-13

Applicant: Google LLC

Inventor： Dongeek Shin

IPC: H04N21/472 ,  H04N21/45 ,  H04N21/466 ,  H04N21/482

CPC classification number: H04N21/47217 ,  H04N21/4532 ,  H04N21/466 ,  H04N21/482

Abstract: Methods and systems for determining a time point of user disengagement with a media item using audiovisual interaction events are provided herein. A media item is provided to a user for an initial viewing. One or more user interaction events associated with the media item at one or more time points of a plurality of time points within the media item is identified. An indication of a level of user engagement with the media item is determined for each of the one or more user interaction events. A time point of the one or more time points associated with a level of user engagement that satisfies a level of user engagement criterion is identified based on the indication of the level of user engagement for each of the one or more user interaction events. A playback of the media item is caused to be initiated at the identified time point when the media item is provided to the user for a secondary viewing.

公开(公告)号：US20240281918A1

公开(公告)日：2024-08-22

申请号：US18171889

申请日：2023-02-21

Applicant: GOOGLE LLC

Inventor： Dongeek Shin

IPC: G06T1/20 ,  G02B27/01 ,  G06F3/14 ,  G06V10/74

CPC classification number: G06T1/20 ,  G02B27/017 ,  G06F3/14 ,  G06V10/761 ,  G02B2027/0178

Abstract: A method including an image is received, a modified image is generated based on the image using a trained machine learning model, a rendered image is generated based on the modified image using an image injection pipeline, and the rendered image is displayed on a display of a wearable device.

公开(公告)号：US12067359B2

公开(公告)日：2024-08-20

申请号：US17719917

申请日：2022-04-13

Applicant: Google LLC

Inventor： Dongeek Shin

IPC: G06F40/197 ,  G06F3/048 ,  G06F3/0484 ,  G06F40/166

CPC classification number: G06F40/197 ,  G06F3/048 ,  G06F3/0484 ,  G06F40/166 ,  G06F2203/04803

Abstract: A first version of an electronic document is provided via a first region of a graphical user interface (GUI) for presentation to a first user of a collaborative document platform. A second region of the GUI includes an edit history GUI element that enables one or more users to access each edit made to the electronic document. A user selection of a portion of the edit history GUI element is detected. The user-selected portion of the edit history GUI element corresponds to edits made to the electronic document by a second user. A determination is made of a state of the electronic document following the edits made by the second user. The first region of the GUI is updated to include a rendering of a second version of the electronic document. The second version is rendered in view of the determined document state.

公开(公告)号：US20240272762A1

公开(公告)日：2024-08-15

申请号：US18108365

申请日：2023-02-10

Applicant: Google LLC

Inventor： Dongeek Shin

IPC: G06F3/04812 ,  G06F3/04842 ,  G06F9/451 ,  G06F16/44

CPC classification number: G06F3/04812 ,  G06F3/04842 ,  G06F9/451 ,  G06F16/44

Abstract: A method includes presenting, on a screen of a client device of a user, a primary media item being viewed by the user and a representation of a secondary media item. The method further includes, while the primary media item is being viewed by the user and prior to a user selection of the secondary media item, predicting a user interest in viewing the secondary media item based on a trajectory of a cursor on the screen of the client device and causing a portion of the secondary media item to be pre-loaded to the client device. The method further includes, in response to the user selection of the secondary media item, initiating playback of the secondary media item using the pre-loaded portion of the secondary media item.

公开(公告)号：US12061681B2

公开(公告)日：2024-08-13

申请号：US17441628

申请日：2020-12-07

Applicant: Google LLC

Inventor： Dongeek Shin

IPC: G06F21/32 ,  G06F3/01 ,  G06V10/84 ,  G06V40/12 ,  G06V40/13

CPC classification number: G06F21/32 ,  G06F3/017 ,  G06V10/84 ,  G06V40/13 ,  G06V40/1347 ,  G06V40/1365

Abstract: Techniques and apparatuses are described that enable a device to be unlocked and continuous user authentication without a touch input dedicated to fingerprint requisition. A touch input is received that comprises one or more touches to a touchscreen, and raw image data corresponding to the touches is retrieved from a fingerprint imaging sensor. A pixel-clustering technique is performed on the raw image data to determine a portion of the raw image data that corresponds to each of the touches. Touch embeddings are formed for each of the portions of the raw image data and compared to one or more stored fingerprint embeddings that correspond to respective fingerprints of one or more authorized users. An authentication result is then determined for the touch input based on the comparison results.

公开(公告)号：US20240249720A1

公开(公告)日：2024-07-25

申请号：US18100990

申请日：2023-01-24

Applicant: GOOGLE LLC

Inventor： Dongeek Shin

IPC: G10L15/22 ,  G06F1/16 ,  G10L15/08

CPC classification number: G10L15/22 ,  G06F1/163 ,  G10L15/08 ,  G10L2015/088 ,  G10L2015/223

Abstract: Implementations relate to an automated assistant that can bypass invocation phrase detection when an estimation of device-to-device distance satisfies a distance threshold. The estimation of distance can be performed for a set of devices, such as a computerized watch and a cellular phone, and/or any other combination of devices. The devices can communicate ultrasonic signals between each other, and the estimated distance can be determined based on when the ultrasonic signals are sent and/or received by each respective device. When an estimated distance satisfies the distance threshold, the automated assistant can operate as if the user is holding onto their cellular phone while wearing their computerized watch. This scenario can indicate that the user may be intending to hold their device to interact with the automated assistant and, based on this indication, the automated assistant can temporarily bypass invocation phrase detection (e.g., invoke the automated assistant).

公开(公告)号：US12045933B2

公开(公告)日：2024-07-23

申请号：US17574881

申请日：2022-01-13

Applicant: GOOGLE LLC

Inventor： Dongeek Shin ,  Steven Benjamin Goldberg

IPC: G06T15/50 ,  G06T3/02 ,  G06T7/50 ,  G06T7/70 ,  G06T11/00

CPC classification number: G06T15/506 ,  G06T3/02 ,  G06T7/50 ,  G06T7/70 ,  G06T11/00 ,  G06T2200/21 ,  G06T2207/10028

Abstract: Systems and methods related to simulated light-in-flight imaging are described. A computing device may execute a light-in-flight engine to process an optical image and a corresponding depth map to produce a light-in-flight image or video that simulates propagation of a wavefront across a scene. The light-in-flight engine may generate an optical simulation output by transforming a depth map to a three-dimensional lift domain to produce a three-dimensional data structure, then convolving the three-dimensional data structure with a convolutional operator, which may define a Gaussian sphere, to produce a filtered three-dimensional data structure. The light-in-flight engine then affine transforms the optical image with an identified slice of the filtered three-dimensional data structure to produce a light-in-flight image.

公开(公告)号：US20240201938A1

公开(公告)日：2024-06-20

申请号：US18083281

申请日：2022-12-16

Applicant: GOOGLE LLC

Inventor： Dongeek Shin

IPC: G06F3/16 ,  G10L15/22

CPC classification number: G06F3/165 ,  G06F3/167 ,  G10L15/22 ,  G10L2015/223

Abstract: Techniques disclosed herein are directed towards pairing a first audio data stream of a first client device with a second audio data stream of a second client device based on identifying a user has imitated playback of media at the second client device, where the imitation of the playback by the user occurs at the first client device. Many implementations include the user controlling the media playback at the second client device using one or more automated assistant queries. Various implementations include deleting the pairing between the first audio data stream and the second audio data stream in response to determining whether one or more conditions have been satisfied (e.g., whether the user stops the playback, whether the first client device is a threshold distance away from the second client device, whether a period of time has elapsed, whether the entire media has played at the second client device, whether one or more additional or alternative conditions are satisfied, and/or combinations thereof).

公开(公告)号：US20240201792A1

公开(公告)日：2024-06-20

申请号：US18537224

申请日：2023-12-12

Applicant: GOOGLE LLC

Inventor： Stiven Guillaume Francois Morvan ,  Dongeek Shin ,  Andrea Colaco ,  Sambuddha Basu ,  Sean Kyungmok Bae ,  Junyi Zhu

IPC: G06F3/01 ,  A61B5/0536 ,  A61B5/263 ,  G06V10/12 ,  G06V10/764 ,  G06V40/20

CPC classification number: G06F3/017 ,  A61B5/0536 ,  A61B5/263 ,  G06V10/12 ,  G06V10/764 ,  G06V40/28

Abstract: Techniques include determining hand gestures formed by a user based on an electrical impedance tomograph of the wrist. For example, a user may be outfitted with a flexible wristband that fits snugly around the wrist and contains a plurality of electrodes, e.g., 32 electrodes. When a current is applied to a first subset of the electrodes, e.g., two of 32 electrodes, the electric field induced through at least one cross-section of the wrist will in turn induce a voltage across adjacent pairs of a second subset of the electrodes (e.g., the other 30 of 32 electrodes). From this current and induced voltage, one may use techniques of electrical impedance tomography (EIT) to determine the electrical impedance throughout the at least one cross-section of the wrist, e.g., in an electrical impedance tomograph. One may use a neural network to map the electrical impedance tomograph to a hand gesture.

公开(公告)号：US20230418369A1

公开(公告)日：2023-12-28

申请号：US18035970

申请日：2020-12-30

Applicant: GOOGLE LLC

Inventor： Steven Benjamin Goldberg ,  Qiyue John Zhang ,  Dongeek Shin ,  Clayton Kimber

IPC: G06F3/01 ,  G01S5/02

CPC classification number: G06F3/012 ,  G01S5/02585 ,  G01S5/0294 ,  G01S5/0278

Abstract: A wearable device, such as a head-wearable display (HWD), identifies a device pose based on a combination of angle-of-arrival (AOA) data generated by, for example, an ultra-wideband (UWB) positioning module, and inertial data generated by an inertial measurement unit (IMU). The HWD fuses the AOA data with the inertial data using data integration techniques such as one or more of stochastic estimation (e.g., a Kalman filter), a machine learning model, and the like, or any combination thereof. A computer device associated with the HWD can employ the fused data to identify a pose of the HWD (e.g., a six degree of freedom (6 DoF) pose) and can use the identified pose to modify virtual reality or augmented reality content implemented by the computer device, thereby providing an immersive and enjoyable experience for a user.