Full body virtual reality utilizing computer vision from a single camera and associated systems and methods

    公开(公告)号:US11568617B2

    公开(公告)日:2023-01-31

    申请号:US17741617

    申请日:2022-05-11

    申请人: NEX Team Inc.

    摘要: Methods and systems for constructing a three-dimensional (3D) model of a user in a virtual environment for full body virtual reality (VR) applications are described. The method includes receiving an image of the user captured using an RGB camera; detecting a body bounding box associated with the user using a first trained neural network; determining a segmentation map of the user, based on the body bounding box; determining a two-dimensional (2D) contour of the user from the segmentation map; forming a 3D extrusion model by extruding the 2D contour; and constructing the 3D model of the user in the virtual environment by applying a geometric transformation to the 3D extrusion model. Applications of full body VR include physical training and fitness sessions, games, control of computing devices, manipulation and display of data, interactive social media with VR, and the like.

    Systems and methods of data preprocessing and augmentation for neural network climate forecasting models

    公开(公告)号:US11537889B2

    公开(公告)日:2022-12-27

    申请号:US16878552

    申请日:2020-05-19

    申请人: ClimateAI, Inc.

    IPC分类号: G06N3/08 G06N3/04

    摘要: Methods and systems for training a neural network (NN)-based climate forecasting model on a pre-processed multi-model ensemble of global climate simulation data from a plurality of global climate simulation models (GCMs), are disclosed. The methods and systems perform steps of determining a common spatial scale and a common temporal scale for the multi-model ensemble of global climate simulation data; spatially re-gridding the multi-model ensemble to the common spatial scale; temporally homogenizing the multi-model ensemble to the common temporal scale; augmenting the spatially re-gridded, temporally homogenized multi-model ensemble with synthetic simulation data generated from the spatially re-gridded, temporally homogenized multi-model ensemble; and training the NN-based climate forecasting model using the spatially re-gridded, temporally homogenized, and augmented multi-model ensemble of global climate simulation data. Embodiments of the present invention enable accurate climate forecasting without the need to run new dynamical global climate simulations on supercomputers.

    Automatic hatch cover for a container and methods of operation thereof

    公开(公告)号:US11505220B1

    公开(公告)日:2022-11-22

    申请号:US17868787

    申请日:2022-07-20

    摘要: The present invention provides a system for automatic operation of a top hatch cover for a container, comprising a hatch cover, a cylinder mount, a main operating lever, a connecting link, and a hatch locking lever. The cylinder mount is configured for pivotally connecting a piston to the container. A lower portion of the main operating lever is connected to a cylinder rod of an air cylinder. A first extension of the connecting link is rotatably connected to an upper portion of the main operating lever and a second extension of the connecting link is coupled to the hatch cover. The main operating lever and the hatch locking lever are rotatably coupled to a main shaft mount, where the hatch locking lever is configured to pivot around the main shaft mount to move between a locked position and an unlocked position.

    Coupling and decoupling a detachable tool from a motion device on a robotic system

    公开(公告)号:US11498778B2

    公开(公告)日:2022-11-15

    申请号:US16511347

    申请日:2019-07-15

    摘要: Magnetic coupling mechanisms for robotic arm end effectors are disclosed. In particular, a magnetic coupling mechanism couples a detachable tool, such as a suction gripper, to a tool changer base of a robotic arm tool of an end effector. Magnetic coupling between the robotic arm tool and the detachable tool allows for breakaway when a sufficient force is applied to the robotic arm tool and/or the detachable tool to separate the two. The decoupling may be achieved via a tool rack. An exemplary system for coupling a detachable tool to a motion device includes a first magnetic ring affixed to a distal end of the motion device, where an inside of the first magnetic ring forms a first hollow chamber; and a second magnetic ring affixed to a proximal end of the detachable tool, where an inside of the detachable tool forms a second hollow chamber.

    Instant video trimming and stitching and associated methods and systems

    公开(公告)号:US11462247B2

    公开(公告)日:2022-10-04

    申请号:US17565156

    申请日:2021-12-29

    申请人: Loom, Inc.

    IPC分类号: G11B27/031 G11B27/34

    摘要: Systems and methods for combined video trimming and stitching are disclosed. In one embodiment, the method receives two video files, each including labeled video segments and a playlist. Each playlist includes segment labels providing a segment playback order. The method receives a trim request including a target time range to be removed from a first video file, and a stitch request including the playlists of the two video files. The target time range starts at a beginning bookend timestamp and ends at an ending bookend timestamp. The method identifies beginning and ending bookend segments based on the beginning and ending bookend timestamps, then executes the trim request by processing the beginning or the ending bookend segment, and modifying the first video's playlist. The method executes the stitch request by generating a combined playlist for a combined video file.

    Image processing system
    57.
    发明授权

    公开(公告)号:US11417082B2

    公开(公告)日:2022-08-16

    申请号:US16623323

    申请日:2018-06-15

    申请人: Markable, Inc.

    摘要: An image processing system identifies objects within images or video segments. To identify an object within an image, the system identifies one or more regions of an image that contain an object. In some examples, a tracklet is used to track an object though a plurality of image frames within a video segment allowing more than one image frame to be used in object detection, and thereby increasing detection accuracy. Various embodiments utilize a deep learning based object detection framework and similar object search framework that models the correlations present between various object categories. The system determines a category for each object detected using a hierarchical tree of categories to learn the visual similarities between various object categories. The hierarchical tree is estimated by analyzing the errors of an object detector which does not use any correlation between the object categories.

    Methods and systems for generating 3D datasets to train deep learning networks for measurements estimation

    公开(公告)号:US11010896B2

    公开(公告)日:2021-05-18

    申请号:US16697146

    申请日:2019-11-26

    申请人: Bodygram, Inc.

    摘要: Disclosed are systems and methods for generating data sets for training deep learning networks for key point annotations and measurements extraction from photos taken using a mobile device camera. The method includes the steps of receiving a 3D scan model of a 3D object or subject captured from a 3D scanner and a 2D photograph of the same 3D object or subject at a virtual workspace. The 3D scan model is rigged with one or more key points. A superimposed image of a pose-adjusted and aligned 3D scan model superimposed over the 2D photograph is captured by a virtual camera in the virtual workspace. Training data for a key point annotation DLN is generated by repeating the steps for a plurality of objects belonging to a plurality of object categories. The key point annotation DLN learns from the training data to produce key point annotations of objects from 2D photographs captured using any mobile device camera.

    Methods and systems for facilitating interactive training of body-eye coordination and reaction time

    公开(公告)号:US10930172B2

    公开(公告)日:2021-02-23

    申请号:US16792190

    申请日:2020-02-15

    申请人: NEX Team Inc.

    摘要: Methods and systems for virtual coaching and performance training using a mobile device are disclosed. The methods and systems perform the steps of capturing a training video of one or more players, using the camera on the mobile computing device; superimposing a visual cue onto the training video at a first location and for a cue period starting from a first time instant; determining whether at least one of the one or more players has responded to the visual cue at a second time instant within the cue period, by analyzing a body posture flow of each player between the first time instant and the second time instant, wherein each body posture flow is extracted from the training video by performing a computer vision algorithm on one or more frames of the training video; and in response to determining that at least one player has responded to the visual cue, generating a feedback to the one or more players.

    Systems and methods for selecting global climate simulation models for training neural network climate forecasting models

    公开(公告)号:US10909446B2

    公开(公告)日:2021-02-02

    申请号:US16869496

    申请日:2020-05-07

    申请人: ClimateAI, Inc.

    摘要: Methods and systems for generating a multi-model ensemble of global climate simulation data from a plurality of global climate simulation models (GCMs), to be used in training a neural network (NN)-based climate forecasting model, are disclosed. The methods and systems perform steps of computing a GCM validation measure for each GCM; selecting a validated subset of the GCMs, by comparing each computed GCM validation measure to a validation threshold determined based on observational historical climate data; computing a forecast skill score for each validated GCM, based on a first forecast function; selecting a validated and skillful subset of GCMs; generating one or more candidate ensembles by combining simulation data from at least two validated and skillful GCMs; computing an ensemble forecast skill score for each candidate ensemble, based on a second forecast function; and selecting a best-scored candidate ensemble. Embodiments of the present invention enable accurate climate forecasting without the need to run new dynamical global climate simulations on supercomputers.