-
公开(公告)号：US20240362857A1
公开(公告)日：2024-10-31
申请号：US18309761
申请日：2023-04-28
申请人： Niantic, Inc.
摘要： An AR device displays virtual objects to users as part of an AR experience by generating a depth image by rendering the depth image from a three-dimensional (3D) world model. The AR device receives an image from a camera and estimates its physical pose in the real world when the image was captured. The AR device accesses the 3D world model and estimates a virtual pose within a 3D world model that corresponds to the estimated physical pose in the real world. The AR device uses the virtual pose to render the depth image using the 3D world model. The AR device may use a graphics processor to render the depth image from a camera view corresponding to the virtual pose. The AR device uses the depth image to present content to the user over the image captured by the camera.
-
2.发明公开公开(公告)号：US20240202967A1
公开(公告)日：2024-06-20
申请号：US18542460
申请日：2023-12-15
申请人： Niantic, Inc.
IPC分类号： G06T7/73
CPC分类号： G06T7/73 , A63F13/216 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084 , G06T2207/30244
摘要： A set of training images of one or more environments and corresponding metadata are received. The metadata includes camera pose and intrinsics. A relocalizer model is trained using the set of training images and the corresponding metadata to generate predict scene coordinates corresponding to pixels in an image of an environment. The relocalizer model includes a scene-agnostic convolutional network and a scene-specific regression network. A set of query images of an environment is received and the trained relocalizer model is applied to the set of query images of the environment to generate predicted scene coordinates corresponding to the pixels in a query image. A pose solver algorithm is applied to the predicted scene coordinates to generate a camera pose.
-
公开(公告)号：US12008740B2
公开(公告)日：2024-06-11
申请号：US17396568
申请日：2021-08-06
申请人： Niantic, Inc.
CPC分类号： G06T5/80 , G06T3/00 , G06T7/187 , G06T7/50 , G06T7/74 , H04N5/2628 , A63F13/216 , A63F13/65 , A63F2300/69 , G06T2207/20081 , G06T2207/20084 , G06T2207/30244
摘要： An image localization system receives an image of a scene and generates a depth map for the image by inputting the image to a model trained for generating depth maps for images. The system determines surface normal vectors for the pixels in the depth map. The system clusters the surface normal vectors to identify regions in the image corresponding to planar surfaces. The system partitions the image into patches, each of which is a region of connected pixels in the image and corresponds to a cluster of surface normal vectors. The system rectifies the perspective distortion of patches and extracts perspective corrected features from the rectified patches. The system matches the perspective corrected features of the image with perspective corrected features of other images for three-dimensional re-localization.
-
公开(公告)号：US20240114078A1
公开(公告)日：2024-04-04
申请号：US17956611
申请日：2022-09-29
申请人： Niantic, Inc.
发明人： Mingliang Wei , Maoyang Li , Michael Chang , Laura Tang
IPC分类号： H04L67/55 , H04L67/1008 , H04L67/131
CPC分类号： H04L67/55 , H04L67/1008 , H04L67/131
摘要： A push gateway brokers messages between backend services and client devices connected to the gateway. The gateway includes a plurality of messaging frontend servers, a messaging database, and a plurality of topic servers. The messaging frontend servers manage the socket connections connecting the client devices to the push gateway. The messaging frontend servers may further monitor the socket connections, collecting analytical data on the client devices and the connections. The messaging database is a key-value database that subscribes messaging frontend servers to topics. The topic servers receive publish requests from the backend servers to identify subscribed messaging frontend servers in the messaging database to push messages out to. The frontend messaging servers subsequently push out the message to the client devices subscribed to the topic.
-
公开(公告)号：US11833420B2
公开(公告)日：2023-12-05
申请号：US17950880
申请日：2022-09-22
申请人： Niantic, Inc.
IPC分类号： A63F13/358 , A63F13/34 , A63F13/332
CPC分类号： A63F13/358 , A63F13/332 , A63F13/34 , A63F2300/534
摘要： Systems and methods for providing a shared augmented reality environment are provided. In particular, the latency of communication is reduced by using a peer-to-peer protocol to determine where to send datagrams. Datagrams describe actions that occur within the shared augmented reality environment, and the processing of datagrams is split between an intermediary node of a communications network (e.g., a cell tower) and a server. As a result, the intermediary node may provide updates to a local state of a client device when a datagram is labelled peer-to-peer, and otherwise provides updates to the master state on the server. This may reduce the latency of communication and allow users of the location-based parallel reality game to see actions occur more quickly in the shared augmented reality environment.
-
公开(公告)号：US20230310984A1
公开(公告)日：2023-10-05
申请号：US18205367
申请日：2023-06-02
申请人： Niantic, Inc.
CPC分类号： A63F13/30 , A63F13/216 , A63F13/65 , A63F13/79 , A63F13/87 , A63F13/40 , A63F2300/69 , A63F2300/5573 , A63F2300/406
摘要： The virtual location of a player in a location-based game is determined from the real-world location of the player's client device. The location-based game provides the player access to one or more chat room based on their location. To determine the locations of chat room, a server analyzes player locations in a geographic region, clusters player locations to identify centroids, and adjusts the clusters based on constraints. The server selects chat room locations (e.g., at points of interest) to more evenly balance the number of players in each chat room while complying with one or more restraints on the size of the geographic area served by each chat room.
-
公开(公告)号：US11748961B2
公开(公告)日：2023-09-05
申请号：US17747608
申请日：2022-05-18
申请人： Niantic, Inc.
发明人： Chihiro Kanno , Shigeru Miyamoto
IPC分类号： G06T7/50 , G06F3/04815 , G06T19/00
CPC分类号： G06T19/006 , G06F3/04815 , G06T7/50 , G06T2207/10016
摘要： A client device can display various augmented reality and virtual reality images to a user. For example, the client device captures images of an external environment and identifies objects in the environment. If an object satisfies a virtual environment criterion, the client device displays a window to a virtual environment at the location of the object in the environment. In another example, the client device includes a light assembly that can generate light. If the user turns the light assembly on, virtual objects displayed in the environment will gather to a region highlighted by the light from the light assembly. In another example, the client device estimates depth information of an object in the environment. The client device then displays a virtual object in the environment based on the depth information and may also display the virtual object interacting with an object in the external environment.
-
公开(公告)号：US11741675B2
公开(公告)日：2023-08-29
申请号：US17193878
申请日：2021-03-05
申请人： Niantic, Inc.
IPC分类号： G06T19/00 , G06N20/00 , G06T7/10 , G06T7/50 , G06T19/20 , G06T17/00 , G06V10/26 , G06V10/774 , G06V20/10
CPC分类号： G06T19/006 , G06N20/00 , G06T7/10 , G06T7/50 , G06T19/20 , G06V10/26 , G06V10/774 , G06V20/10 , G06T2207/20081 , G06T2219/2004
摘要： A model predicts the geometry of both visible and occluded traversable surfaces from input images. The model may be trained from stereo video sequences, using camera poses, per-frame depth, and semantic segmentation to form training data, which is used to supervise an image to image network. In various embodiments, the model is applied to a single RGB image depicting a scene to produce information describing traversable space of the scene that includes occluded traversable. The information describing traversable space can include a segmentation mask of traversable space (both visible and occluded) and non-traversable space and a depth map indicating an estimated depth to traversable surfaces corresponding to each pixel determined to correspond to traversable space.
-
公开(公告)号：US11711508B2
公开(公告)日：2023-07-25
申请号：US17696529
申请日：2022-03-16
申请人： Niantic, Inc.
IPC分类号： H04N13/268 , G06T7/593 , G06T7/80 , G06T7/73 , H04N13/00
CPC分类号： H04N13/268 , G06T7/593 , G06T7/73 , G06T7/85 , G06T2207/10021 , G06T2207/10028 , G06T2207/20081 , H04N2013/0081
摘要： A method for training a depth estimation model with depth hints is disclosed. For each image pair: for a first image, a depth prediction is determined by the depth estimation model and a depth hint is obtained; the second image is projected onto the first image once to generate a synthetic frame based on the depth prediction and again to generate a hinted synthetic frame based on the depth hint; a primary loss is calculated with the synthetic frame; a hinted loss is calculated with the hinted synthetic frame; and an overall loss is calculated for the image pair based on a per-pixel determination of whether the primary loss or the hinted loss is smaller, wherein if the hinted loss is smaller than the primary loss, then the overall loss includes the primary loss and a supervised depth loss between depth prediction and depth hint. The depth estimation model is trained by minimizing the overall losses for the image pairs.
-
公开(公告)号：US20230147561A1
公开(公告)日：2023-05-11
申请号：US17982365
申请日：2022-11-07
申请人： Niantic, Inc.
发明人： Erik Murphy-Chutorian , Nicholas Butko , Thomas Emrich , Joel Udwin , Rigel Gareth Benton , Christoph Michael Bartschat
IPC分类号： G06F3/04815 , G06T17/00 , G06F3/04883 , G02B27/01
CPC分类号： G06F3/04815 , G02B27/0172 , G06F3/04883 , G06T17/00
摘要： Implementations generally relate to metaverse content modality mapping. In some implementations, a method includes obtaining functionality developed for a first modality of a virtual environment. The method further includes mapping the functionality to a second modality of the virtual environment. The method further includes executing the functionality developed for the first modality based on user interaction associated with the second modality.
-
-
-
-
-
-
-
-
-
搜索结果
150 条记录 (耗时 0.033 秒)
