公开(公告)号：WO2023049418A2

公开(公告)日：2023-03-30

申请号：PCT/US2022/044637

申请日：2022-09-24

申请人： APPLE INC.

发明人： PASTRANA VICENTE, Israel ,  APODACA, Gregory M. ,  BOESEL, Benjamin H. ,  CHIU, Shih-Sang ,  CLARKE, Graham R. ,  HOLDER, Wesley M. ,  LIN, Chia Yang ,  MANZARI, Behkish J. ,  OLSON, Earl M. ,  OWEN, James J. ,  RAVASZ, Jonathan ,  RODRIGUEZ ESTANY, Miquel ,  SORRENTINO III, William A.

IPC分类号： G06F3/01 ,  G06F3/0484 ,  G06T19/00 ,  G06F3/0482 ,  G06F3/04842 ,  G06F3/0483 ,  G06F2203/04806 ,  G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/04845

摘要： The present disclosure generally relates to user interfaces for electronic devices, including user interfaces for viewing and interacting with media items. The present disclosure also relates to user interfaces for providing an extended reality (XR) experience to a user, in accordance with some embodiments. The systems, methods, and graphical user interfaces (GUIs) described herein are directed to user interface interactions with virtual/augmented reality environments in multiple ways. In some embodiments, one or more visual characteristics of displayed content are modified based on where the gaze of a user is directed.

公开(公告)号：WO2023273191A1

公开(公告)日：2023-01-05

申请号：PCT/CN2021/137766

申请日：2021-12-14

申请人： 深圳先进技术研究院

发明人： 方鹏 ,  王迎英 ,  汤熙 ,  田岚 ,  李向新 ,  郑悦 ,  张浩诗 ,  李光林

IPC分类号： G06F3/01 ,  B25J13/00 ,  G06F1/163 ,  G06F3/017 ,  G06N3/063

摘要： 本发明公开了一种面向手势控制的人机交互系统，包括：腕带本体设置有微针阵列电极；在机械手的每个手指位置均安装压力传感器，用于检测机械手与物体之间的接触信号，经过无线通信方式将所检测到的接触信号传输至所述腕带本体内设置的数据处理与发送模块；数据处理与发送模块,与腕带本体内设置的微针阵列电极电连接，用于对所接收到的信号进行分析并判断感觉信息所属的类型，最后利用判断结果来编码电刺激参数，并将编码好的电流脉冲通过腕带本体上的微针阵列电极施加于使用者手部来刺激诱发和传导手部感觉信息。能够实现手势控制过程的真实自然的感觉反馈功能，将操作者的手从传统的力反馈数据手套中解放出来，可以进行更加灵活的手势操作。

公开(公告)号：WO2022271381A1

公开(公告)日：2022-12-29

申请号：PCT/US2022/030612

申请日：2022-05-24

申请人： MICROSOFT TECHNOLOGY LICENSING, LLC

发明人： BANSAL, Saurabh

IPC分类号： G09B21/00 ,  G06F3/011 ,  G06F3/017 ,  G06V40/28 ,  G09B21/009

摘要： Systems and methods may be used for sign language and gesture identification and capture. A method may include capturing a series of images of a user and determining whether there are regions of interest in an image of the series of images. In response to determining that there is a region of interest in a particular image of the series of images, the method may include determining whether the region of interest includes a gesture movement by the user and determining whether the region of interest includes a sign language sign movement by the user. An image representation of a gesture or a sign may be generated.

公开(公告)号：WO2022266209A2

公开(公告)日：2022-12-22

申请号：PCT/US2022/033607

申请日：2022-06-15

申请人： APPLE INC.

发明人： AKMAL, Shiraz ,  BURNS, Aaron, Mackay ,  HERMAN, Brad, Kenneth

IPC分类号： G06F40/30 ,  G10L15/26 ,  G06F3/01 ,  G06Q10/10 ,  G06F16/33 ,  G06V20/20 ,  G06F3/013 ,  G06F3/017 ,  G06F3/167 ,  G10L15/1822

摘要： Systems and processes for transcriptions and transcription assistance are provided. For example, a textual representation of a conversation between a user and at least one conversation participant is obtained. Based on the textual representation, content associated with the conversation is identified, wherein the content includes at least one of a first input from the user and a second input from the at least one conversation participant. In response to a determination that the content is associated with predefined content, a portion of the textual representation is identified based on the content. Based on the identified portion, an output responsive to the at least one of the first input and the second input is provided.

公开(公告)号：WO2022261008A2

公开(公告)日：2022-12-15

申请号：PCT/US2022/032363

申请日：2022-06-06

申请人： APPLE INC.

发明人： WESKAMP, Marcos, A. ,  LEMAY, Stephen, O. ,  SEPULVEDA, Raymond, S.

IPC分类号： G06F16/954 ,  G06F3/0483 ,  G06F3/01 ,  G06F16/953 ,  G06F16/955 ,  G06F3/0485 ,  G06F3/04883 ,  G06F16/9566 ,  G06F3/017

摘要： The method for web browsing on a portable device displays a web-browser user interface that includes a currently displayed webpage and an associated tab in a tab row. The currently displayed webpage forms part of a group of webpages. In response to receiving a swipe gesture, it is then determined that the swipe gesture occurs at a location corresponding to the associated tab in the tab row. In response to the swipe gesture occurs at a location corresponding to the associated tab, the currently displayed webpage is no longer displayed, and the tab row is scrolled to display an additional webpage and its associated additional tab. If, however, the swipe gesture occurs at a location on the currently displayed webpage, a webpage navigation function is performed.

公开(公告)号：WO2022237383A1

公开(公告)日：2022-11-17

申请号：PCT/CN2022/084747

申请日：2022-04-01

申请人： INTERNATIONAL BUSINESS MACHINES CORPORATION ,  IBM (CHINA) CO., LIMITED

发明人： WU, Bo ,  GAN, Chuang ,  WANG, Dakuo ,  QIAN, Kaizhi

IPC分类号： G06K9/00 ,  G06N3/04 ,  G06F3/011 ,  G06F3/017 ,  G06K9/6239 ,  G06T2207/10016 ,  G06T2207/20076 ,  G06T2207/20084 ,  G06T2207/30196 ,  G06T7/246 ,  G06V20/46 ,  G06V2201/07 ,  G06V40/23

摘要： A bi-directional spatial-temporal transformer neural network (BDSTT) is trained to predict original coordinates of a skeletal joint in a specific frame through relative relationships of the skeletal joint to other joints and to the state of the skeletal joint in other frames. A plurality of frames comprising coordinates of the skeletal joint and coordinates of other joints are obtained. A spatially masked frame is produced by masking the original coordinates of the skeletal joint. The specific frame, the spatially masked frame, and at least one more frame are provided to a coordinate prediction head of the BDSTT. A prediction of coordinates for the skeletal joint is obtained from the coordinate prediction head. Parameters of the BDSTT are adjusted until a mean-squared error, between the prediction of coordinates for the skeletal joint and the original coordinates of the skeletal joint, converges.

公开(公告)号：WO2022237268A1

公开(公告)日：2022-11-17

申请号：PCT/CN2022/077198

申请日：2022-02-22

申请人： 青岛小鸟看看科技有限公司

发明人： 吴涛

IPC分类号： G06F3/01 ,  G06K9/00 ,  G06F2203/012 ,  G06F3/016 ,  G06F3/017 ,  G06V40/28

摘要： 本申请公开了一种头戴式显示设备的信息输入方法、装置及头戴式显示设备。头戴式显示设备的显示界面中展示有至少一个虚拟键盘，该方法包括：实时获取手势图像；利用手势识别模型对手势图像进行识别，得到手势识别结果；判断手势识别结果是否满足预设输入条件；若手势识别结果满足预设输入条件，则根据手势动作在手势图像中的位置信息，确定手势动作触发的虚拟键盘中的虚拟按键，以作为头戴式显示设备的输入。本申请的头戴式显示设备的信息输入方法可以大大降低用户为了提供用户输入而持有外部控制设备的需要，从而提高了用户的虚拟办公效率，并且提高了各种不便于手持外部控制设备的用户的可访问性，提高了用户的虚拟办公体验。

公开(公告)号：WO2022188974A1

公开(公告)日：2022-09-15

申请号：PCT/EP2021/056126

申请日：2021-03-11

申请人： AUDI AG

发明人： PFALLER, Daniel ,  WEIGAND, Christoph

IPC分类号： B60K37/06 ,  G01C21/26 ,  G06F3/01 ,  G08G1/16 ,  H04L29/08 ,  B60K2370/177 ,  B60K2370/5915 ,  B60K2370/592 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0141 ,  G02B2027/0183 ,  G02B2027/0187 ,  G02B27/0172 ,  G06F3/011 ,  G06F3/017 ,  G06Q10/10 ,  G06Q30/0265 ,  G06Q50/01 ,  G06Q50/30 ,  G06T19/006 ,  G06T2219/024 ,  G06V20/20 ,  G06V40/28 ,  H04L67/12 ,  H04L67/52 ,  H04N21/2146 ,  H04N21/816 ,  H04N21/85406 ,  H04N7/15 ,  H04W4/021 ,  H04W4/40

摘要： The invention is concerned with a method for presenting a shared virtual environment (16) to several users (45) residing in different vehicles (12) while the respective vehicle (12) is driving in a real-world environment (18). In at least one of the vehicles (12) a respective interactive user device (13) of that vehicle (12) receives definition data (47) from the respective user (45) residing in that vehicle (12), wherein the definition data (47) describe a new virtual event (20) for the virtual environment (16), and a position sensor of the vehicle (12) generates position data (34) of the vehicle (12) while the user (45) generates the definition data (47), wherein the position data (34) describe a current position of the vehicle (12) in the real-world environment (18). A stationary server unit (11 ) receives the definition data (47) and the corresponding position data (34) and generates corresponding event data (30) of a new virtual event (20), wherein in dependence on the position data (34) a trigger region (19) is defined that defines where in the real-world environment (18) the virtual event (20) shall be triggered for the users (45) in their respective vehicle.

公开(公告)号：WO2022067083A2

公开(公告)日：2022-03-31

申请号：PCT/US2021/052027

申请日：2021-09-24

申请人： APPLE INC.

发明人： ROCKEL, Philipp ,  LEMAY, Stephen O. ,  SORRENTINO III, William A. ,  YERKES, Giancarlo ,  HENDERSON, Nicholas W. ,  BUTCHER, Gary I. ,  DELLINGER, Richard R. ,  IVE, Jonathan ,  DYE, Alan C. ,  JAEDE, Julian ,  HOENIG, Julian ,  HANKEY, M. Evans ,  WAN, Si Wan

IPC分类号： G06F3/01 ,  A63F13/428 ,  G06F3/04842 ,  A63B71/06 ,  G06F3/04815 ,  G06T19/00 ,  A63F13/213 ,  A63F13/426 ,  A63F13/655 ,  G06F3/011 ,  G06F3/017 ,  G06T15/10 ,  G06T19/006

摘要： A computer system displays a first user interface object with a first appearance at a first position in a first view of a three-dimensional environment that is at least partially shared between a first and second user. While displaying the first user interface object, the computer system detects a first user input by the first user. In response to detecting the first user input: in accordance with a determination that the second user is not currently interacting with the first user interface object, the computer system performs a first operation; and in accordance with a determination that the second user is currently interacting with the first user interface object, the computer system displays a visual indication, that the first user interface object is not available for interaction, including changing an appearance or position of the first user interface object, and forgoes performing the first operation.

公开(公告)号：WO2022005720A1

公开(公告)日：2022-01-06

申请号：PCT/US2021/036720

申请日：2021-06-10

申请人： SNAP INC.

发明人： CANBERK, Ilteris ,  KANG, Shin, Hwun ,  KUCHER, Dmytro

IPC分类号： G02B27/01 ,  G06F3/0481 ,  G06T19/00 ,  A63F13/00 ,  A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/26 ,  A63F13/428 ,  A63F13/5255 ,  A63F13/655 ,  A63F13/98 ,  G02B2027/0178 ,  G02B27/017 ,  G02B27/0172 ,  G06F1/163 ,  G06F3/011 ,  G06F3/017 ,  G06F3/04815 ,  G06F3/04883 ,  G06F3/1454 ,  G06T19/006 ,  G06T2219/024

摘要： Eyewear providing an interactive augmented reality experience between two users of eyewear devices to perform a shared group task. During a shared group task session, each eyewear user can manipulate virtual objects displayed in a respective virtual scene that is viewable to each user to perform collaboration. The virtual objects can include many different types of objects, such as a building structure that can be jointly created and edited by the eyewear users.