FACE DETECTION BASED ON FACIAL KEY-POINTS
    12.
    发明公开

    公开(公告)号:US20230177871A1

    公开(公告)日:2023-06-08

    申请号:US17542916

    申请日:2021-12-06

    发明人: Ramin Eslami

    摘要: An electronic device and method for face detection based on facial key-points is provided. The electronic device receives an image of an object of interest. The image may include a face of the object of interest. The electronic device detects a plurality of key-points associated with the face of the object of interest based on the received image and determines a first coordinate value in the received image based on the detected plurality of key-points. Thereafter, the electronic device determines a region in the received image that includes the face of the object of interest based on the determined first coordinate value and controls the display device to overlay a marker onto the determined region of the face. The marker indicates a location of the determined region in the image.

    METHODS FOR PREDEFINING VIRTUAL STAIRCASES CONNECTING PLATFORMS IN EXTENDED REALITY (XR) ENVIRONMENTS

    公开(公告)号:US20230103166A1

    公开(公告)日:2023-03-30

    申请号:US17488253

    申请日:2021-09-28

    IPC分类号: A63F13/525

    摘要: A method predefines a virtual staircase connecting real platforms in an XR space by: accessing a previously generated spatial mapping mesh (SMM); compiling a record from the SMM of available surfaces; identifying available platforms provided by the physical elements and available open spaces therebetween; selecting a first platform at a first level and a second platform at a significantly lower level; selecting a staircase start location at a first edge of the first platform, partly based on predetermined criteria; stacking virtual blocks linearly to form a virtual staircase, with a first virtual block contacting and extending outwards from the first platform, and a last virtual block contacting the second platform at a staircase end location; and performing a collision analysis. If the staircase end location satisfies the predetermined criteria, and if no collisions are detected, the current virtual staircase is displayed in subsequent user interactions with the XR space.

    METHOD FOR QUASI-RANDOM PLACEMENT OF VIRTUAL ITEMS IN AN EXTENDED REALITY (XR) SPACE

    公开(公告)号:US20230097571A1

    公开(公告)日:2023-03-30

    申请号:US17488250

    申请日:2021-09-28

    摘要: A method for quasi-random placement of a virtual item in an XR space includes: accessing a previously generated spatial mapping mesh (SMM) of the XR space; compiling a record from the SMM of open spaces between surfaces of physical elements in the XR space, with corresponding positions and dimensions; selecting from the open spaces: a spawn position for a virtual character, and a random set of other positions, filtering the random set to form a subset. The method then performs a collision analysis to assign a score to each position in the subset partly based on accessibility to that position for the virtual character beginning from the spawn position; and places the virtual item at a position in the subset having a score as high or higher than all other positions in the subset. The method is carried out before user interaction with any virtual element in the XR space.

    Method to use recognition of nearby physical surfaces to generate NPC reactions to events

    公开(公告)号:US11596866B1

    公开(公告)日:2023-03-07

    申请号:US17488249

    申请日:2021-09-28

    摘要: A method to generate an appropriate reaction, by an NPC in an XR game, to a significant event in the game includes: compiling a record from a previously generated SMM of surfaces in the XR space, categorizing the surfaces; after the game begins, tracking in real time physical surroundings of the NPC, allowing 3D positions of the NPC relative to nearby physical surfaces to be continuously determined; and events occurring in the game, allowing detection of any event deemed to be significant. For each detected event deemed significant, occurring at a corresponding event time, an appropriate action is determined for the NPC to carry out in response, partly based on whether the NPC is positioned close to a physical surface at the event time, and the NPC is directed to carry out the appropriate action.

    TASK-ORIENTED DYNAMIC MESH COMPRESSION USING OCCUPANCY NETWORKS

    公开(公告)号:US20230016302A1

    公开(公告)日:2023-01-19

    申请号:US17861033

    申请日:2022-07-08

    IPC分类号: G06T9/00

    摘要: Methods, systems and device for efficiently compressing task-oriented dynamic meshes using occupancy networks are described herein. A single trained occupancy network model is able to reconstruct a mesh video using a few additional points per input mesh frame. To optimize the compression of the model and points, the estimated rate to compress the occupancy network is able to be included in the loss function. This minimizes the number of bits to encode the model, while it tries to reproduce the meshes as well as possible. An adaptive subsampling per input mesh is added to optimize the mesh reconstruction and the N-point point clouds compression. To optimize the model to perform a particular task, a metric is added to the cost function that takes this task into account.

    CLINICAL ACTIVITY RECOGNITION WITH MULTIPLE CAMERAS

    公开(公告)号:US20220398396A1

    公开(公告)日:2022-12-15

    申请号:US17344730

    申请日:2021-06-10

    IPC分类号: G06K9/00 G06T7/73

    摘要: Implementations generally recognize clinical activity using multiple cameras. In some implementations, a method includes obtaining a plurality of videos of a plurality of objects in an environment. The method further includes determining one or more key points for each object of the plurality of objects. The method further includes recognizing activity information based on the one or more key points. The method further includes computing workflow information based on the activity information.