Method of controlling virtual content, terminal device and computer readable medium

    公开(公告)号:US11113849B2

    公开(公告)日:2021-09-07

    申请号:US16720015

    申请日:2019-12-19

    IPC分类号: G06T11/00 G06T7/70 G06K9/00

    摘要: A method of controlling virtual content, a terminal device and a computer readable medium are provided. The terminal device includes a display configured to display a virtual object, a camera configured to capture a target image including a marker, at least one processor, and a memory. The memory stores one or more programs configured to be executed by the at least one processor. The one or more programs includes instructions of acquiring the target image including the marker, where a plurality of sub-markers is distributed on the marker; determining a blocked target, wherein the blocked target is a blocked sub-marker of the plurality of sub-markers in the target image; generating a control instruction according to the blocked target; and controlling the displayed virtual object based on the control instruction.

    System, method, and terminal device for controlling virtual image by selecting user interface element

    公开(公告)号:US11100723B2

    公开(公告)日:2021-08-24

    申请号:US16731097

    申请日:2019-12-31

    发明人: Jingwen Dai Jie He

    IPC分类号: G06T19/20 G06T3/60

    摘要: The present application provides a method of controlling a virtual image. The method may includes acquiring relative spatial position between a terminal device and an interaction device; generating the virtual image based on the relative spatial position, wherein the virtual image includes one or more user interface elements, and a superimposing position of each user interface element in a real space correspond to the interaction device; generating in advance and acquiring a rotational vector corresponding to the interaction device, determining a spatial position of the rotational vector in a virtual space based on the relative spatial position, wherein a direction indicated by the rotational vector may be fixed; and when the spatial position is located with a region corresponding to any user interface element in the virtual space, performing a corresponded control operation based on the user interface element corresponding to the region.

    Augmented reality method for displaying virtual object and terminal device therefor

    公开(公告)号:US11087545B2

    公开(公告)日:2021-08-10

    申请号:US16535054

    申请日:2019-08-07

    发明人: Jingwen Dai Jie He

    IPC分类号: G06T19/00 G06T19/20 G06T7/70

    摘要: A method for displaying a virtual object includes: acquiring first spatial position information of a marker relative to a terminal device; acquiring second spatial position information of the marker relative to a target region of a physical object; determining, third spatial position information of the terminal device relative to the target region based on the first spatial position information and the second spatial position information; and displaying, based on the third spatial position information, the virtual object on the target region of the physical object.

    Method of displaying virtual content based on markers

    公开(公告)号:US11049324B2

    公开(公告)日:2021-06-29

    申请号:US16666429

    申请日:2019-10-29

    摘要: A method of generating a virtual object includes: capturing an image containing a target marker, wherein the target marker is at least one marker of a plurality of markers, and is within a visual range of the terminal device, and the plurality of markers are arranged at various positions dispersively; acquiring a target spatial position of the target marker relative to the terminal device, based on the image; reading a first spatial position relation between each of the plurality of markers, storing the same in the terminal device, and acquiring a second spatial position relation of a virtual object relative to the plurality of markers; determining a display position of the virtual object, based on the first spatial position relation, the second spatial position relation, and the target spatial position; and generating the virtual object based on the display position.

    Image processing apparatuses and methods

    公开(公告)号:US10402988B2

    公开(公告)日:2019-09-03

    申请号:US15839838

    申请日:2017-12-12

    摘要: Embodiments of the disclosure provide an image processing apparatus and an image processing method for positioning and identifying signals sources. The image processing apparatus includes an imaging device to capture an image containing a set of pixels, wherein the set of pixels comprises a first subset of pixels representing a plurality of stripes associated with the multiple signal sources; a memory to store the image; a positioning device to determine positions of the multiple signal sources according to the stripes; and an identity determining device to determine identities of the multiple signal sources.

    Electronic tracking device, electronic tracking system and electronic tracking method

    公开(公告)号:US10347002B2

    公开(公告)日:2019-07-09

    申请号:US15636432

    申请日:2017-06-28

    摘要: An electronic tracking device includes an image sensor and a processor is provided. The image sensor is configured for sensing a raw image of an object. The object emits a color visible light and an infrared light. The image sensor includes a color filter array so as to sense the color visible light and the infrared light through the color filter array to acquire the raw image. The color filter array includes at least one color filter channel and an infrared filter channel. The processor is configured for processing the raw image so that the identity and the spatial position of the object are determined in accordance with the raw image. An electronic tracking system and method are also provided. By electronic tracking device, system and method, the accurate identification and tracking of objects can be obtained, thereby generating reliable and timely input to VR systems and/or applications.

    Method and device for aligning coordinate of position device with coordinate of IMU

    公开(公告)号:US11248911B2

    公开(公告)日:2022-02-15

    申请号:US16236478

    申请日:2018-12-29

    IPC分类号: G01C21/18 G06F3/01

    摘要: An alignment method is provided. A first 3D position and a first IMU calculation 3D position of a position object with an IMU is determined when the IMU enters a steady state. A second 3D position and a second IMU calculation 3D position of the position object is determined when the IMU exits the steady state. A first relative vector is determined based on the first 3D position and the second 3D position. A second relative vector is determined based on the first IMU calculation 3D position and the second IMU calculation 3D position. A rotation matrix is determined based on the first relative vector and the second first relative vector. A coordinate system of the position device is aligned with a coordinate system of the IMU based on the rotation matrix. An electronic device and a non-transitory computer readable storage medium are also provided.

    Augmented reality method, system and terminal device of displaying and controlling virtual content via interaction device

    公开(公告)号:US11244511B2

    公开(公告)日:2022-02-08

    申请号:US16731055

    申请日:2019-12-31

    发明人: Jingwen Dai Jie He

    IPC分类号: G06T19/00 G06T7/73 G06F3/01

    摘要: The present application provides a method of displaying virtual content. The method includes: capturing a first image including a first marker; determining a display region corresponding to a first interaction device based on the first marker in the first image and displaying the first virtual object; displaying second virtual object corresponding to the first virtual object. The first marker is arranged on the first interaction device. A first display position of the first virtual object in a virtual space corresponds to the display region. A second display position of the second virtual object in the virtual space corresponds to a predefined superimposing region, and the second virtual object is at least a part of the first virtual object.