公开(公告)号：US11861061B2

公开(公告)日：2024-01-02

申请号：US18091434

申请日：2022-12-30

Applicant: MULTINARITY LTD

Inventor： Orit Dolev ,  Tomer Kahan ,  Tamir Berliner ,  Tomer Dvir

IPC: G10L15/22 ,  G06T11/60 ,  G06T7/70 ,  G06V40/20 ,  G06T19/20 ,  G06V40/10 ,  G08B7/00 ,  G06F3/01 ,  G06V20/20 ,  G06F3/023 ,  G06F3/16 ,  G09G3/00 ,  G06T19/00 ,  G06T7/73 ,  G06F40/169 ,  G06F3/14 ,  G02B27/01 ,  G06F1/16 ,  G06V10/74

CPC classification number: G06F3/012 ,  G02B27/0172 ,  G06F1/163 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0231 ,  G06F3/1423 ,  G06F3/1454 ,  G06F3/167 ,  G06F40/169 ,  G06T7/70 ,  G06T7/73 ,  G06T11/60 ,  G06T19/00 ,  G06T19/006 ,  G06T19/20 ,  G06V10/761 ,  G06V20/20 ,  G06V40/28 ,  G09G3/001 ,  G10L15/22 ,  G02B2027/014 ,  G02B2027/0143 ,  G02B2027/0178 ,  G06T2219/2004 ,  G06V40/10 ,  G06V40/20 ,  G08B7/00 ,  G09G2320/064 ,  G09G2320/0613 ,  G09G2320/0686 ,  G09G2330/021 ,  G09G2354/00 ,  G10L2015/223

Abstract: Methods, systems, apparatuses, and computer-readable media are provided for enabling collaboration between physical writers and virtual writers. In one implementation, the computer-readable medium includes instructions to cause a processor to receive, from an image sensor, image data representing a hand of a first physical writer holding a physical marking implement and engaging with a physical surface to create tangible markings. Information based on the image data is transmitted to a computing device associated with a second virtual writer, to thereby enable the second virtual writer to view the tangible markings created by the first physical writer. Annotation data are received from the computing device, and represent additional markings in relative locations with respect to the tangible markings created by the first physical writer. In response to receiving the annotation data, a wearable extended reality appliance overlays the physical surface with virtual markings in the relative locations.

公开(公告)号：US11797051B2

公开(公告)日：2023-10-24

申请号：US17711367

申请日：2022-04-01

Applicant: Multinarity Ltd

Inventor： Tamir Berliner ,  Tomer Kahan ,  Orit Dolev ,  Oded Noam

IPC: G06F1/16 ,  G02B27/01 ,  G06F3/01 ,  G06T19/00 ,  G06T7/70 ,  G06F3/0481 ,  G06F3/04815 ,  G06F3/04847 ,  G06F3/14 ,  G06F3/023 ,  G06Q10/0631 ,  G06F3/04886 ,  G06F3/0489 ,  H04N23/51 ,  H04N23/57 ,  H04N23/45 ,  G06F3/02

CPC classification number: G06F1/163 ,  G02B27/017 ,  G06F1/1616 ,  G06F1/1632 ,  G06F1/1656 ,  G06F1/1662 ,  G06F3/011 ,  G06F3/014 ,  G06F3/017 ,  G06F3/021 ,  G06F3/023 ,  G06F3/0231 ,  G06F3/0481 ,  G06F3/0489 ,  G06F3/04815 ,  G06F3/04847 ,  G06F3/04886 ,  G06F3/14 ,  G06F3/1423 ,  G06Q10/0631 ,  G06T7/70 ,  G06T19/006 ,  H04N23/45 ,  H04N23/51 ,  H04N23/57 ,  G02B2027/014 ,  G02B2027/0138 ,  G02B2027/0141 ,  G02B2027/0178 ,  G06T2200/24 ,  G06T2207/30196

Abstract: A system and method for operating a keyboard and wearable extended reality appliance combination to control a virtual display are disclosed. The system may include a processor configured to receive, from a first hand-position sensor associated with the wearable extended reality appliance, first signals representing first hand-movements; receive, from a second hand-position sensor associated with the keyboard, second signals representing second hand-movements, wherein the second hand-movements include actions other than interactions with a feedback component; and control the virtual display based on the first signals and the second signals.

公开(公告)号：US11627172B2

公开(公告)日：2023-04-11

申请号：US17658002

申请日：2022-04-05

Applicant: Multinarity Ltd

Inventor： Tamir Berliner ,  Tomer Kahan ,  Orit Dolev ,  Tomer Dvir

IPC: H04L65/401 ,  H04L9/40 ,  H04L12/18 ,  H04L65/403

Abstract: Methods, systems, apparatuses, and non-transitory computer-readable media are provided for tying virtual whiteboards to physical spaces. In one implementation, the computer-readable medium includes instructions to cause a processor to receive wirelessly, an indication of a location of a first wearable extended reality appliance; perform a lookup to determine that the location of the first wearable extended reality appliance corresponds to a location of a particular virtual whiteboard; transmit to the first wearable extended reality appliance, data corresponding to content of the particular virtual whiteboard; receive, during a first time period, virtual content added by a first user; receive wirelessly at a second time period an indication that a second wearable extended reality appliance is in the location of the particular virtual whiteboard; and transmit to the second wearable extended reality appliance, data corresponding to the content and the added content of the particular virtual whiteboard.

公开(公告)号：US11599148B2

公开(公告)日：2023-03-07

申请号：US17657479

申请日：2022-03-31

Applicant: Multinarity Ltd

Inventor： Tamir Berliner ,  Tomer Kahan ,  Eli Elhadad

IPC: G06F1/16 ,  G02B27/01 ,  G06F3/048 ,  G06F3/01 ,  G06T19/00 ,  G06T7/70 ,  G06F3/0481 ,  G06F3/04815 ,  G06F3/04847 ,  G06F3/14 ,  G06F3/023 ,  G06Q10/0631 ,  G06F3/04886 ,  G06F3/0489

Abstract: Consistent with disclosed embodiments, systems, methods, and computer readable media including instructions for implementing hybrid virtual keys in an extended reality environment are disclosed. Embodiments may include a processor to receive signals from a touch-sensitive surface, wherein a wearable extended reality appliance may virtually project a plurality of virtual activatable elements on the touch-sensitive surface. The plurality of virtual activatable elements virtually projected on the touch-sensitive surface may be a proper sub-set of a group of virtual activatable elements, based on the action of a user. The processor may receive touch inputs from the user via the touch-sensitive surface and identify one of the plurality of virtual activatable elements. The processor may cause a change in virtual content based on the identified virtual activatable element.

公开(公告)号：US11588897B2

公开(公告)日：2023-02-21

申请号：US17657968

申请日：2022-04-05

Applicant: Multinarity Ltd

Inventor： Tamir Berliner ,  Tomer Kahan ,  Orit Dolev

IPC: H04L67/131 ,  G06T19/20 ,  G02B27/00 ,  G02B27/01 ,  G06F3/01 ,  G06F3/04815 ,  H04L65/401 ,  H04L65/403 ,  G06T7/70 ,  G06V30/228 ,  G06V30/14 ,  G06T19/00 ,  G06K7/14 ,  G06T7/20 ,  G06T11/00 ,  H04W4/70 ,  H04W4/80 ,  H04W4/02 ,  G06F3/14 ,  G06T15/20

Abstract: Methods, systems, apparatuses, and computer-readable media are provided for simulating user interactions with shared content. In one implementation, the computer-readable medium includes instructions to cause a processor to establish a communication channel for sharing content and user interactions; transmit to at least one second wearable extended reality appliance, first data, representing an object associated with first wearable extended reality appliance, enabling a virtual representation of the object to be displayed through the at least one second wearable extended reality appliance; receive image data from an image sensor associated with the first wearable extended reality appliance; detect in the image data at least one user interaction including a human hand pointing to a specific portion of the object; and transmit to the at least one second wearable extended reality appliance second data indicating an area of the specific portion of the object.

公开(公告)号：US11580711B2

公开(公告)日：2023-02-14

申请号：US17712355

申请日：2022-04-04

Applicant: Multinarity Ltd

Inventor： Tamir Berliner ,  Tomer Kahan ,  Orit Dolev ,  Doron Assayas Terre

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/033 ,  G06F3/04812 ,  G06F3/04815 ,  G06T7/70 ,  G06F3/0488 ,  G06F3/04892 ,  G06F3/16 ,  G06T3/40 ,  G06V40/20 ,  G02B27/01 ,  G06F3/04817 ,  G06F3/14 ,  G09G5/10 ,  G06F3/041

Abstract: Systems, methods, and non-transitory computer readable media for controlling perspective in an extended reality environment are disclosed. In one embodiment, a non-transitory computer readable medium contains instructions to cause a processor to perform the steps of: outputting for presentation via a wearable extended reality appliance (WER-appliance), first display signals reflective of a first perspective of a scene; receiving first input signals caused by a first multi-finger interaction with the touch sensor; in response, outputting for presentation via the WER-appliance second display signals to modify the first perspective of the scene, causing a second perspective of the scene to be presented via the WER-appliance; receiving second input signals caused by a second multi-finger interaction with the touch sensor; and in response, outputting for presentation via the WER-appliance third display signals to modify the second perspective of the scene, causing a third perspective of the scene to be presented via the WER-appliance.

公开(公告)号：US11567535B2

公开(公告)日：2023-01-31

申请号：US17708699

申请日：2022-03-30

Applicant: Multinarity Ltd

Inventor： Oded Noam ,  Tamir Berliner ,  Tomer Kahan

IPC: G06F3/14 ,  G06F1/16 ,  G02B27/01 ,  G06F3/01 ,  G06T19/00 ,  G06T7/70 ,  G06F3/0481 ,  G06F3/04815 ,  G06F3/04847 ,  G06F3/023 ,  G06Q10/06 ,  G06F3/04886 ,  G06F3/0489

Abstract: Systems, methods, and non-transitory computer readable media containing instructions for causing at least one processor to perform operations for changing display of virtual content based on temperature are provided. In one implementation, the processor is configured to perform operations comprising displaying virtual content via a wearable extended reality appliance, wherein during displaying of the virtual content, heat is generated by at least one component of the wearable extended reality appliance; receiving information indicative of a temperature associated with the wearable extended reality appliance; determining a need to change display settings of the virtual content based on the received information; and based on the determination, changing the display settings of the virtual content to achieve a target temperature.

公开(公告)号：US20230018309A1

公开(公告)日：2023-01-19

申请号：US17947039

申请日：2022-09-16

Applicant: MULTINARITY LTD

Inventor： Tamir Berliner ,  Tomer Kahan ,  Orit Dolev

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/033 ,  G06F3/04812 ,  G06F3/04815 ,  G06T7/70 ,  G06F3/0488 ,  G06F3/04892 ,  G06F3/16 ,  G06T3/40 ,  G06V40/20 ,  G02B27/01 ,  G06F3/04817 ,  G06F3/14 ,  G09G5/10 ,  G06F3/041

Abstract: A method for facilitating an environmentally adaptive extended reality display in a physical environment includes virtually displaying content via a wearable extended reality appliance operating in the physical environment, wherein displaying content via the wearable extended reality appliance is associated with at least one adjustable extended reality display parameter. Image data is obtained from the wearable extended reality appliance and a specific environmental change unrelated to the virtually displayed content is detected in the image data. A group of rules associating environmental changes with changes in the at least one adjustable extended reality display parameter is accessed and a specific rule of the group of rules is determined, the specific rule corresponding to the specific environmental change. The specific rule is implemented to adjust the at least one adjustable extended reality display parameter based on the specific environmental change.

公开(公告)号：US11516297B2

公开(公告)日：2022-11-29

申请号：US17710189

申请日：2022-03-31

Applicant: Multinarity Ltd

Inventor： Tamir Berliner ,  Tomer Kahan ,  Orit Dolev

IPC: G06T19/00 ,  H04L67/131 ,  G06T19/20 ,  G02B27/00 ,  G02B27/01 ,  G06F3/01 ,  G06F3/04815 ,  H04L65/401 ,  H04L65/403 ,  G06T7/70 ,  G06V30/228 ,  G06V30/14 ,  G06K7/14 ,  G06T7/20 ,  G06T11/00 ,  H04W4/70 ,  H04W4/80 ,  H04W4/02 ,  G06F3/14 ,  G06T15/20

Abstract: Systems, methods, and non-transitory computer readable media configured for managing content placement in extended reality environments are provided. In one implementation, at least one processor associated with the non-transitory computer readable medium may receive a request from an entity to place virtual content at a specific geographic location in at least one shared extended reality environment that includes a plurality of virtual objects, wherein the virtual objects are viewable by a plurality of users. Different content placement rules may define where content may be placed. Based on the obtained information, the processor may determine that the request meets or does not meet the specific content placement rule. The at least one processor may implement the specific content placement rule to prevent content from being displayed when the specific content placement rule is not met and may enable content to be displayed when the specific content placement rule is met.

公开(公告)号：US11514656B2

公开(公告)日：2022-11-29

申请号：US17657771

申请日：2022-04-04

Applicant: MULTINARITY LTD

Inventor： Tamir Berliner ,  Tomer Kahan ,  Orit Dolev

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/04815 ,  G06T7/70 ,  G06V40/20 ,  G02B27/01 ,  G06F3/0488 ,  G06F3/033 ,  G06F3/04812 ,  G06F3/04892 ,  G06F3/16 ,  G06T3/40 ,  G06F3/04817 ,  G06F3/14 ,  G09G5/10 ,  G06F3/041

Abstract: Systems, methods, and non-transitory computer readable media containing instructions for selectively controlling display of virtual objects are provided. In one implementation, virtual objects may be virtually presented in an environment via a wearable extended reality appliance operable in a first and second display modes; in the first display mode, positions of the virtual objects are maintained in the environment regardless of detected movements of the wearable extended reality appliance, and in the second display mode, the virtual objects move in the environment in response to detected movements of the wearable extended reality appliance; movement of the wearable extended reality appliance may be detected; selection of the first or second display mode may be received; display signals configured to present the virtual objects in a manner consistent with the selected display mode may be outputted for presentation via the wearable extended reality appliance in response to the selected display mode.