-
公开(公告)号:US10244164B1
公开(公告)日:2019-03-26
申请号:US15701062
申请日:2017-09-11
发明人: Sudipto Banerjee , Pushkar Gorur Sheshagiri , Pawan Kumar Baheti , Ajit Deepak Gupte , Ajit Venkat Rao
摘要: A method performed by an electronic device is described. The method includes receiving a plurality of images from a first camera with a first field of view and a second plurality of images from a second camera with a second field of view. An overlapping region exists between the first field of view and the second field of view. The method also includes predicting a disparity of a moving object present in a first image of the first plurality of images. The moving object is not present in a corresponding second image of the second plurality of images. The method further includes determining warp vectors based on the predicted disparity. The method additionally includes combining an image from the first plurality of images with an image from the second plurality of images based on the determined warp vectors.
-
公开(公告)号:US20190020802A1
公开(公告)日:2019-01-17
申请号:US15649229
申请日:2017-07-13
发明人: Vinay Melkote Krishnaprasad , Pushkar Gorur Sheshagiri , Pawan Kumar Baheti , Ajit Deepak Gupte , Ajit Venkat Rao
CPC分类号: H04N5/2327 , G06T3/4038 , G06T5/50 , G06T2207/20221 , H04N5/247
摘要: Techniques are described for addressing rolling shutter delay and in some cases rolling shutter delay and stabilization. Processing circuits may receive image content in overlapping portions of images, and may adjust the image content until there is overlap in the overlapping portions. Processing circuits may also receive information of deviation of the device from a common reference. Based on the overlapping image content, the deviation of the device from the common reference, and image content in non-overlapping portions, the processing circuits may determine mapping of coordinates to a rectangular mesh for generating an equirectangular image.
-
公开(公告)号:US11727625B2
公开(公告)日:2023-08-15
申请号:US17456370
申请日:2021-11-23
发明人: Pushkar Gorur Sheshagiri , Pawan Kumar Baheti , Ajit Deepak Gupte , Sandeep Kanakapura Lakshmikantha
IPC分类号: G06T15/20 , G06F3/01 , G06F3/04815 , G02B27/01 , G02B27/00 , G06F1/16 , G06F3/03 , G06F3/04842 , G06T7/70 , G06T13/40 , G06T19/00 , G06F3/16 , G06T3/20 , G06T7/60
CPC分类号: G06T15/20 , G02B27/0093 , G02B27/017 , G06F1/163 , G06F3/011 , G06F3/012 , G06F3/017 , G06F3/0304 , G06F3/04815 , G06F3/04842 , G06T7/70 , G06T13/40 , G06T19/006 , G02B2027/0187 , G06F3/167 , G06T3/20 , G06T7/60 , G06T2219/024
摘要: Methods, devices, and apparatuses are provided to facilitate a positioning of an item of virtual content in an extended reality environment. For example, a placement position for an item of virtual content can be transmitted to one or more of a first device and a second device. The placement position can be based on correlated map data generated based on first map data obtained from the first device and second map data obtained from the second device. In some examples, the first device can transmit the placement position to the second device.
-
公开(公告)号:US11144117B1
公开(公告)日:2021-10-12
申请号:US16876754
申请日:2020-05-18
发明人: Chiranjib Choudhuri , Ajit Deepak Gupte , Pushkar Gorur Sheshagiri , Gerhard Reitmayr , Tom Edward Botterill
IPC分类号: G06F3/01 , G06N20/00 , G06N3/04 , G06N3/08 , G06F3/0346
摘要: Methods, systems, and devices for deep learning based head motion prediction for extended reality are described. The head pose prediction may involve training one or more layers of a machine learning network based on application data and an estimated head motion range associated with the extended reality system. The network may receive one or more bias corrected inertial measurement unit (IMU) measurements based on a sensor. The network may model a relative head pose of the user as a polynomial of time over a prediction interval based on the bias corrected IMU measurements and the trained one or more layers of the machine learning network. The network may determine a future relative head pose of the user based on the polynomial (e.g., which may be used for virtual object generation, display, etc. within an extended reality system).
-
公开(公告)号:US20190082103A1
公开(公告)日:2019-03-14
申请号:US15701062
申请日:2017-09-11
发明人: Sudipto Banerjee , Pushkar Gorur Sheshagiri , Pawan Kumar Baheti , Ajit Deepak Gupte , Ajit Venkat Rao
摘要: A method performed by an electronic device is described. The method includes receiving a plurality of images from a first camera with a first field of view and a second plurality of images from a second camera with a second field of view. An overlapping region exists between the first field of view and the second field of view. The method also includes predicting a disparity of a moving object present in a first image of the first plurality of images. The moving object is not present in a corresponding second image of the second plurality of images. The method further includes determining warp vectors based on the predicted disparity. The method additionally includes combining an image from the first plurality of images with an image from the second plurality of images based on the determined warp vectors.
-
公开(公告)号:US11769258B2
公开(公告)日:2023-09-26
申请号:US17166957
申请日:2021-02-03
发明人: Ajit Deepak Gupte , Gerhard Reitmayr , Abhijeet Bisain , Pushkar Gorur Sheshagiri , Chayan Sharma , Ajit Venkat Rao
CPC分类号: G06T7/248 , G06T7/292 , G06T7/74 , G06F3/012 , G06T2207/10012 , G06T2207/10032 , G06T2207/30244 , G06T2207/30252
摘要: Systems and techniques are described herein for processing images. The systems and techniques can be implemented by various types of systems, such as by an extended reality (XR) system or device. In some cases, a first processor receives an image of an environment captured by an image sensor, identifies features depicted in the image, and generates descriptors for the features. The first processor sends the descriptors to a second processor, which may be more powerful than the first processor. The second processor receives the descriptors. The second processor associates the plurality of features with a map of the environment based on at least a subset of the plurality of descriptors. For example, the second processor can track at least a subset of the features based on at least a subset of the descriptors and based on feature information from one or more additional images of the environment.
-
公开(公告)号:US11756227B2
公开(公告)日:2023-09-12
申请号:US17307920
申请日:2021-05-04
发明人: Srujan Babu Nandipati , Pushkar Gorur Sheshagiri , Chiranjib Choudhuri , Ajit Deepak Gupte , Gerhard Reitmayr
CPC分类号: G06T7/73 , G02B27/0172 , G06T7/20 , G06T7/33 , G02B2027/014 , G02B2027/0138
摘要: Systems and techniques are provided for determining and applying corrected poses in digital content experiences. An example method can include receiving, from one or more sensors associated with an apparatus, inertial measurements and one or more frames of a scene; based on the one or more frames and the inertial measurements, determining, via a first filter, an angular and linear motion of the apparatus and a gravity vector indicating a direction of gravitational force interacting with the apparatus; when a motion of the apparatus is below a threshold, determining, via a second filter, an updated gravity vector indicating a direction of gravitational force interacting with the apparatus; determining, based on the updated gravity vector, parameters for aligning an axis of the scene with a gravity direction in a real-world spatial frame; and aligning, using the parameters, the axis of the scene with the gravity direction in the real-world spatial frame.
-
公开(公告)号:US11200729B2
公开(公告)日:2021-12-14
申请号:US17031315
申请日:2020-09-24
发明人: Pushkar Gorur Sheshagiri , Pawan Kumar Baheti , Ajit Deepak Gupte , Sandeep Kanakapura Lakshmikantha
IPC分类号: G06T15/20 , G06F3/01 , G06F3/0481 , G02B27/01 , G02B27/00 , G06F1/16 , G06F3/03 , G06F3/0484 , G06T7/70 , G06T13/40 , G06T19/00 , G06F3/16 , G06T3/20 , G06T7/60
摘要: Methods, devices, and apparatuses are provided to facilitate a positioning of an item of virtual content in an extended reality environment. For example, a placement position for an item of virtual content can be transmitted to one or more of a first device and a second device. The placement position can be based on correlated map data generated based on first map data obtained from the first device and second map data obtained from the second device. In some examples, the first device can transmit the placement position to the second device.
-
公开(公告)号:US10825237B2
公开(公告)日:2020-11-03
申请号:US16376857
申请日:2019-04-05
发明人: Pushkar Gorur Sheshagiri , Pawan Kumar Baheti , Ajit Deepak Gupte , Sandeep Kanakapura Lakshmikantha
IPC分类号: G06T15/20 , G06F3/01 , G06F3/0481 , G02B27/01 , G02B27/00 , G06F1/16 , G06F3/03 , G06F3/0484 , G06T7/70 , G06T13/40 , G06T19/00 , G06F3/16 , G06T3/20 , G06T7/60
摘要: Methods, devices, and apparatuses are provided to facilitate a positioning of an item of virtual content in an extended reality environment. For example, a first user may access the extended reality environment through a display of a mobile device, and in some examples, the methods may determine positions and orientations of the first user and a second user within the extended reality environment. The methods may also determine a position for placement of the item of virtual content in the extended reality environment based on the determined positions and orientations of the first user and the second user, and perform operations that insert the item of virtual content into the extended reality environment at the determined placement position.
-
公开(公告)号:US11010921B2
公开(公告)日:2021-05-18
申请号:US16414664
申请日:2019-05-16
发明人: Chiranjib Choudhuri , Pushkar Gorur Sheshagiri , Ajit Deepak Gupte , Vinay Melkote Krishnaprasad , Chayan Sharma , Ajit Venkat Rao
摘要: Systems, methods, and computer-readable media are provided for distributed tracking and mapping for extended reality experiences. An example method can include computing, at a device, a pose of the device at a future time, the future time being determined based on a communication latency between the device and a mapping backend system; sending, to the mapping backend system, the pose of the device; receiving, from the mapping backend system, a map slice including map points corresponding to a scene associated with the device, the map slice being generated based on the pose of the device, wherein the map points correspond to the predicted pose; and computing an updated pose of the device based on the map slice.
-
-
-
-
-
-
-
-
-