-
公开(公告)号：US11497995B2
公开(公告)日：2022-11-15
申请号：US17325137
申请日：2021-05-19
申请人： Niantic, Inc.
IPC分类号： A63F13/358 , A63F13/34 , A63F13/332
摘要： Systems and methods for providing a shared augmented reality environment are provided. In particular, the latency of communication is reduced by using a peer-to-peer protocol to determine where to send datagrams. Datagrams describe actions that occur within the shared augmented reality environment, and the processing of datagrams is split between an intermediary node of a communications network (e.g., a cell tower) and a server. As a result, the intermediary node may provide updates to a local state of a client device when a datagram is labelled peer-to-peer, and otherwise provides updates to the master state on the server. This may reduce the latency of communication and allow users of the location-based parallel reality game to see actions occur more quickly in the shared augmented reality environment.
-
公开(公告)号：US20220331689A1
公开(公告)日：2022-10-20
申请号：US17721756
申请日：2022-04-15
申请人： Niantic, Inc.
IPC分类号： A63F13/26 , A63F13/213 , A63F13/212
摘要： A wearable augmented reality device is described. The device comprises a headband, brim, optical displays, and environmental sensors. The headband wraps at least partially around a head of a user and distributes the weight of components of the device across the head of the user, supporting the device. The brim is coupled to the headband such that the brim extends away from the headband, over the eyes of the user. The brim includes a heatsink that releases heat from the electronics of the device into the environment. The optical displays are coupled to the underside of the brim. The optical displays both present image light and allow environmental light to pass through. The environmental sensors are couples to the forward edge of the brim and capture data about the environment.
-
公开(公告)号：US20220319016A1
公开(公告)日：2022-10-06
申请号：US17714341
申请日：2022-04-06
申请人： Niantic, Inc.
发明人： Colin Graber , Grace Shin-Yee Tsai , Michael David Firman , Gabriel J. Brostow , Alexander Schwing
摘要： Panoptic segmentation forecasting predicts future positions of foreground objects and background objects separately. An egomotion model may be implemented to estimate egomotion of the camera. Pixels in frames of captured video are classified between foreground and background. The foreground pixels are grouped into foreground objects. A foreground motion model forecasts motion of the foreground objects to a future timestamp. A background motion model backprojects the background pixels into point clouds in a three-dimensional space. The background motion model predicts future positions of the point clouds based on egomotion. The background motion model may further generate novel point clouds to fill in occluded space. With the predicted future positions, the foreground objects and the background pixels are combined into a single panoptic segmentation forecast. An augmented reality mobile game may utilize the panoptic segmentation forecast to accurately portray movement of virtual elements in relation to the real-world environment.
-
公开(公告)号：US20220309756A1
公开(公告)日：2022-09-29
申请号：US17747608
申请日：2022-05-18
申请人： Niantic, Inc.
发明人： Chihiro Kanno , Shigeru Miyamoto
IPC分类号： G06T19/00 , G06T7/50 , G06F3/04815
摘要： A client device can display various augmented reality and virtual reality images to a user. For example, the client device captures images of an external environment and identifies objects in the environment. If an object satisfies a virtual environment criterion, the client device displays a window to a virtual environment at the location of the object in the environment. In another example, the client device includes a light assembly that can generate light. If the user turns the light assembly on, virtual objects displayed in the environment will gather to a region highlighted by the light from the light assembly. In another example, the client device estimates depth information of an object in the environment. The client device then displays a virtual object in the environment based on the depth information and may also display the virtual object interacting with an object in the external environment.
-
公开(公告)号：US11167207B2
公开(公告)日：2021-11-09
申请号：US16713466
申请日：2019-12-13
申请人： Niantic, Inc.
IPC分类号： A63F13/216 , A63F13/30 , A63F13/65 , H04N19/70 , G06F16/901 , G06T19/00
摘要： A location-based parallel reality game may use regions to determine how to disperse virtual elements, locate virtual experiences, and/or define game objectives. To determine the regions of the geographic area, a server divides the geographic region into cells. The server assigns real-world data to each of the cells and constructs a graph of nodes and edges based on the cells. Each node corresponds to a cell, and each edge connects nodes that correspond to adjacent cells. The server partitions the graph into contiguous segments based on the real-world data. The server defines regions of the geographic area based on the contiguous segments and stores the defined regions in a data store. The server may hierarchically partition the regions into higher order regions until each region meets a set of criteria.
-
公开(公告)号：US11110343B2
公开(公告)日：2021-09-07
申请号：US16377095
申请日：2019-04-05
申请人： Niantic, Inc.
发明人： Ryan Michael Hickman , Soohyun Bae
IPC分类号： A63F13/655 , G06K9/00 , A63F13/213 , G06T7/00 , G06K9/62 , A63F13/215 , A63F13/25 , A63F13/56 , A63F13/60 , G06F16/583 , G06F16/51 , G06K9/20 , G06T15/00
摘要： An example method includes obtaining, obtaining, from one or more sensors of a computing device, data relating to a feature in an environment. Following, the method includes analyzing the data to identify one or more details of the feature in the environment and determining, based on a comparison of the data to a stored dataset in a database, that the details includes a detail that the stored dataset lacks. The method includes providing one or more game elements for gameplay on an interface of the computing device based on the details including the detail that the stored dataset lacks.
-
公开(公告)号：US11100401B2
公开(公告)日：2021-08-24
申请号：US16332343
申请日：2017-09-12
申请人： Niantic, Inc.
发明人： Clément Godard , Oisin MacAodha , Gabriel Brostow
摘要： Systems and methods are described for predicting depth from colour image data using a statistical model such as a convolutional neural network (CNN), The model is trained on binocular stereo pairs of images, enabling depth data to be predicted from a single source colour image. The model is trained to predict, for each image of an input binocular stereo pair, corresponding disparity values that enable reconstruction of another image when applied, to the image. The model is updated based on a cost function that enforces consistency between the predicted disparity values for each image in the stereo pair.
-
公开(公告)号：US20210228988A1
公开(公告)日：2021-07-29
申请号：US17228285
申请日：2021-04-12
申请人： Niantic, Inc.
发明人： Paul M. Franceus , Daphne Alesia Larose , Ethan Jacob Chan , Joshua Y. Tang , Sang-Min Park , Yuegang Mao , Rowan Rebholz Meara , Laura Mae Warner , Matthew Kiichi Slemon , James William Otermat
IPC分类号： A63F13/65 , A63F13/216 , A63F13/35
摘要： Events in an interactive application (e.g., a location-based parallel reality game) are triggered by a user's real-world activity meeting one or more criteria. A background process executing on the user's client device periodically extracts activity data from an activity monitoring application (e.g., a fitness application) and provides it to a server hosting the interactive application. The server determines whether received activity data triggers an event and, if so, sends a notification of the event to the client device.
-
公开(公告)号：US11044462B2
公开(公告)日：2021-06-22
申请号：US16864743
申请日：2020-05-01
申请人： Niantic, Inc.
IPC分类号： H04N13/268 , G06T7/593 , G06T7/80 , G06T7/73 , H04N13/00
摘要： A method for training a depth estimation model with depth hints is disclosed. For each image pair: for a first image, a depth prediction is determined by the depth estimation model and a depth hint is obtained; the second image is projected onto the first image once to generate a synthetic frame based on the depth prediction and again to generate a hinted synthetic frame based on the depth hint; a primary loss is calculated with the synthetic frame; a hinted loss is calculated with the hinted synthetic frame; and an overall loss is calculated for the image pair based on a per-pixel determination of whether the primary loss or the hinted loss is smaller, wherein if the hinted loss is smaller than the primary loss, then the overall loss includes the primary loss and a supervised depth loss between depth prediction and depth hint. The depth estimation model is trained by minimizing the overall losses for the image pairs.
-
公开(公告)号：US20210023452A1
公开(公告)日：2021-01-28
申请号：US17037318
申请日：2020-09-29
申请人： Niantic, Inc.
发明人： Hansong Zhang
摘要： A method and system for verifying a client device's location in a parallel reality game hosted by a server. The client transmits its location to the server and receives verification instructions comprising a landmark and a verification pathway. The client prompts a player to capture image data of the landmark and, in response, receives a first set of image data of the landmark from an initial perspective. The client determines whether the first set of image data matches to the landmark before prompting the player to move along the verification pathway while capturing image data. The client receives a second set of image data of the landmark from a moving perspective. The client determines whether the second set of image data matches to an expected change in perspective of the landmark. Upon completion of the verification instructions, the client confirms to the server the client's location.
-
-
-
-
-
-
-
-
-
搜索结果
167 条记录 (耗时 0.028 秒)
