Apparatus, system, and method for machine perception

    公开(公告)号:US11816886B1

    公开(公告)日:2023-11-14

    申请号:US16021900

    申请日:2018-06-28

    Abstract: A system may include a wearable apparatus dimensioned to be worn by a user about an axial region of the user’s body such that, when the wearable apparatus is worn by the user, the user’s field of view into a local environment is substantially free of a view of the wearable apparatus. The system may also include a machine-perception subsystem that is coupled to the wearable apparatus and that gathers information about the local environment by observing the local environment. Additionally, the system may include an experience-analysis subsystem that infers, based on the information about the local environment and information about the user, contextual information about an experience of the user in the local environment. Furthermore, the system may include a non-visual communication subsystem that outputs the contextual information about the experience of the user. Various other apparatuses, systems, and methods are also disclosed.

    OBJECT TRACKING USING SPARSE SENSOR CAPTURES

    公开(公告)号:US20230119703A1

    公开(公告)日:2023-04-20

    申请号:US18069896

    申请日:2022-12-21

    Abstract: In one embodiment, a computing system instructs, at a first time, a camera having a plurality of pixel sensors to use the plurality of pixel sensors to capture a first image of an environment comprising an object. The computing system predicts, using at least the first image, a projection of the object appearing in a virtual image plane associated with a predicted camera pose at a second time. The computing system determines, based on the predicted projection of the object, a first region of pixels and a second region of pixels. The computing system generates pixel-activation instructions for the first region of pixels and the second region of pixels. The computing system instructs the camera to capture a second image of the environment at the second time according to the pixel-activation instructions. The pixel-activation instructions are configured to cause a first subset of the plurality of pixel sensors to sample the first region of pixels and a second subset of the plurality of pixel sensors to sample the second region of pixels. The first subset of the plurality of pixel sensors used for sampling the first region of pixels is more dense than the second subset of the plurality of pixel sensors used for sampling the second region of pixels. The computing system tracks, based on the second image, the object at the second time.

    Visual inertial odometry localization using sparse sensors

    公开(公告)号:US12249092B2

    公开(公告)日:2025-03-11

    申请号:US17493620

    申请日:2021-10-04

    Abstract: In one embodiment, a computing system accesses a set of 3D locations associated with features in an environment previously captured by a camera from a previous camera pose. The computing system determines a predicted camera pose using the previous camera pose and motion measurements generated using a motion sensor associated with the camera. The computing system projects the set of 3D locations toward the predicted camera pose and onto a 2D image plane associated with the camera. The computing system generates, based on the projected set of 3D locations on the 2D image plane, an activation map specifying a subset of the pixel sensors of the camera that are to be activated. The computing system instructs, using the activation map, the camera to activate the subset of pixel sensors to capture a new image of the environment. The computing system reads pixel values of the new image.

    METHOD AND A SYSTEM FOR INTERACTING WITH PHYSICAL DEVICES VIA AN ARTIFICIAL-REALITY DEVICE

    公开(公告)号:US20240411364A1

    公开(公告)日:2024-12-12

    申请号:US18789518

    申请日:2024-07-30

    Abstract: A non-transitory, computer-readable storage medium including executable instructions that, when executed by one or more processors, allow a user to interact with physical devices via an artificial-reality (AR) device is described. In response to a command received from the user of a head-wearable device, the instructions cause the one or more processors to (i) obtain an image of a physical environment surrounding the user wearing the head-wearable device, (ii) determine a region of interest, including one or more available physical devices, in the image based at least on a gaze of an eye of the user, (iii) determine, by a machine-learning model, an intent of the user to interact with a particular physical device of the one or more available physical devices, and (iv), based on the intent of the user to interact with a particular physical device, send a representation of the command to the particular physical device.

    METHOD AND A SYSTEM FOR INTERACTING WITH PHYSICAL DEVICES VIA AN ARTIFICIAL-REALITY DEVICE

    公开(公告)号:US20230130770A1

    公开(公告)日:2023-04-27

    申请号:US18048411

    申请日:2022-10-20

    Abstract: An Artificial Reality (AR) device captures an image of a physical environment surrounding a user wearing the AR device. A three-dimensional map corresponding to the physical environment is accessed. Then, a pose of the AR device relative to the three-dimensional map is determined based on first features of physical objects captured in the image and second features of object representations in the three-dimensional map. The device determines, using an eye tracker, a gaze of an eye of the user. Based on the gaze and the pose, a region of interest is computed in the three-dimensional map. Representations of physical devices in the region of interest of the three-dimensional map are identified. The device determines an intent of the user to interact with a physical device. A command is issued to the physical device based on the determined intent.

    Mirror reconstruction
    6.
    发明授权

    公开(公告)号:US11625862B2

    公开(公告)日:2023-04-11

    申请号:US17072439

    申请日:2020-10-16

    Abstract: In one embodiment, a method includes accessing a digital image captured by a camera that is connected to a machine-detectable object, detecting a reflection of the machine-detectable object in the digital image, computing, in response to the detection, a plane that is coincident with a reflective surface associated with the reflection, determining a boundary of the reflective surface in the plane based on at least one of a plurality of cues, and storing information associated with the reflective surface, where the information includes a pose of the reflective surface and the boundary of the reflective surface in a 3D model of a physical environment, and where the information associated with the reflective surface and the 3D model are configured to be used to render a reconstruction of the physical environment.

    Self-localizing Wireless Communications
    9.
    发明公开

    公开(公告)号:US20240129846A1

    公开(公告)日:2024-04-18

    申请号:US17964631

    申请日:2022-10-12

    Abstract: In one embodiment, a method includes accessing a map of a building floor plan with locations of access points within the floor plan, the access points being capable of performing wireless communications with wireless devices. Determining a pose of a wireless device within the map using images captured by one or more cameras of the wireless device. Selecting a preferred access point based on the pose of the wireless device, the floor plan, and the locations of the plurality of access points within the floor plan. Configuring wireless communication settings of the wireless device to communicate with the preferred access point based on the pose of the wireless device and the location of the preferred access point within the floor plan.

Patent Agency Ranking