-
公开(公告)号:US20230306709A1
公开(公告)日:2023-09-28
申请号:US18200822
申请日:2023-05-23
Applicant: Apple Inc.
Inventor: Oliver Thomas Ruepp , Jai Prakash , Johan Hedborg , Rahul Raguram , Michele Stoppa
Abstract: In one implementation, a method of estimating the heading of a device is performed by the device including a processor, non-transitory memory, and an image sensor. The method includes determining a geographic location of the device. The method includes capturing, using the image sensor, an image at the geographic location. The method includes detecting one or more lines within the image. The method includes determining a heading of the device based on the one or more lines and the geographic location.
-
公开(公告)号:US20230083758A1
公开(公告)日:2023-03-16
申请号:US17476312
申请日:2021-09-15
Applicant: Apple Inc.
Inventor: Paolo Di Febbo , Anthony Ghannoum , Michele Stoppa , Kiranjit Dhaliwal
Abstract: A tracked device may be used in an extended reality system in coordination with a tracking device. The tracked device may be ordinarily difficult to track, for example due to changing appearances or relatively small surface areas of unchanging features, as may be the case with an electronic device with a relatively large display surrounded by a thin physical outer boundary. In these cases, the tracked device may periodically present an image to the tracking device that the tracking device stores as an indication to permit tracking of a known, unchanging feature despite the image not being presented continuously on the display of the tracked device. The image may include a static image, designated tracking data overlaid on an image frame otherwise scheduled for presentation, or extracted image features from the image frame otherwise scheduled for presentation. Additional power saving methods and known marker generation methods are also described.
-
公开(公告)号:US20220092331A1
公开(公告)日:2022-03-24
申请号:US17448456
申请日:2021-09-22
Applicant: Apple Inc.
Inventor: Michele Stoppa , Mohamed Selim Ben Himane , Raffi A. Bedikian
Abstract: Methods, systems, and computer readable media for providing personalized saliency models, e.g., for use in mixed reality environments, are disclosed herein, comprising: obtaining, from a server, a first saliency model for the characterization of captured images, wherein the first saliency model represents a global saliency model; capturing a first plurality of images by a first device; obtaining information indicative of a reaction of a first user of the first device to the capture of one or more images of the first plurality images; updating the first saliency model based, at least in part, on the obtained information to form a personalized, second saliency model; and transmitting at least a portion of the second saliency model to the server for inclusion into the global saliency model. In some embodiments, a user's personalized (i.e., updated) saliency model may be used to modify one or more characteristics of at least one subsequently captured image.
-
公开(公告)号:US12216833B1
公开(公告)日:2025-02-04
申请号:US18355006
申请日:2023-07-19
Applicant: Apple Inc.
Inventor: Michele Stoppa , Waleed Abdulla , Henning Tjaden , Sree Harsha Kalli , Senem E. Emgin , John B. Morrell , Seung Wook Kim
Abstract: A physical keyboard can be used to collect user input in a typing mode or in a tracking mode. To use a tracking mode, first movement data is detected for a hand of a user in relation to a physical keyboard at a first location. A determination is made that the first movement data is associated with a tracking movement. In response to determining that the movement type is associated with the tracking movement, a tracking mode is initiated. User input is provided based on the movement data and in accordance with the tracking mode. Contact data and non-contact data is used to determine a user intent, and a user instruction is processed based on the user intent.
-
公开(公告)号:US11699279B1
公开(公告)日:2023-07-11
申请号:US16909014
申请日:2020-06-23
Applicant: Apple Inc.
Inventor: Oliver Thomas Ruepp , Jai Prakash , Johan Hedborg , Rahul Raguram , Michele Stoppa
Abstract: In one implementation, a method of estimating the heading of a device is performed by the device including a processor, non-transitory memory, and an image sensor. The method includes determining a geographic location of the device. The method includes capturing, using the image sensor, an image at the geographic location. The method includes detecting one or more lines within the image. The method includes determining a heading of the device based on the one or more lines and the geographic location.
-
公开(公告)号:US20240193810A1
公开(公告)日:2024-06-13
申请号:US18581251
申请日:2024-02-19
Applicant: Apple Inc.
Inventor: Paolo Di Febbo , Anthony Ghannoum , Michele Stoppa , Kiranjit Dhaliwal
CPC classification number: G06T7/74 , G06F3/14 , G06T13/00 , H04N23/651 , H04N23/66 , G01S5/02585 , G01S5/16
Abstract: A tracked device may be used in an extended reality system in coordination with a tracking device. The tracked device may be ordinarily difficult to track, for example due to changing appearances or relatively small surface areas of unchanging features, as may be the case with an electronic device with a relatively large display surrounded by a thin physical outer boundary. In these cases, the tracked device may periodically present an image to the tracking device that the tracking device stores as an indication to permit tracking of a known, unchanging feature despite the image not being presented continuously on the display of the tracked device. The image may include a static image, designated tracking data overlaid on an image frame otherwise scheduled for presentation, or extracted image features from the image frame otherwise scheduled for presentation. Additional power saving methods and known marker generation methods are also described.
-
公开(公告)号:US11854242B2
公开(公告)日:2023-12-26
申请号:US17448456
申请日:2021-09-22
Applicant: Apple Inc.
Inventor: Michele Stoppa , Mohamed Selim Ben Himane , Raffi A. Bedikian
IPC: G06V10/46 , G06V30/262 , G06F18/21 , G06V10/40
CPC classification number: G06V10/462 , G06F18/21 , G06V10/40 , G06V30/274
Abstract: Methods, systems, and computer readable media for providing personalized saliency models, e.g., for use in mixed reality environments, are disclosed herein, comprising: obtaining, from a server, a first saliency model for the characterization of captured images, wherein the first saliency model represents a global saliency model; capturing a first plurality of images by a first device; obtaining information indicative of a reaction of a first user of the first device to the capture of one or more images of the first plurality images; updating the first saliency model based, at least in part, on the obtained information to form a personalized, second saliency model; and transmitting at least a portion of the second saliency model to the server for inclusion into the global saliency model. In some embodiments, a user's personalized (i.e., updated) saliency model may be used to modify one or more characteristics of at least one subsequently captured image.
-
公开(公告)号:US11755124B1
公开(公告)日:2023-09-12
申请号:US17448807
申请日:2021-09-24
Applicant: Apple Inc.
Inventor: Michele Stoppa , Waleed Abdulla , Henning Tjaden , Sree Harsha Kalli , Senem E. Emgin , John B. Morrell , Seung Wook Kim
CPC classification number: G06F3/0219 , G06F3/013 , G06F3/017 , G06F3/0213
Abstract: A physical keyboard can be used to collect user input in a typing mode or in a tracking mode. To use a tracking mode, first movement data is detected for a hand of a user in relation to a physical keyboard at a first location. A determination is made that the first movement data is associated with a tracking movement. In response to determining that the movement type is associated with the tracking movement, a tracking mode is initiated. User input is provided based on the movement data and in accordance with the tracking mode. Contact data and non-contact data is used to determine a user intent, and a user instruction is processed based on the user intent.
-
公开(公告)号:US11954885B2
公开(公告)日:2024-04-09
申请号:US17476312
申请日:2021-09-15
Applicant: Apple Inc.
Inventor: Paolo Di Febbo , Anthony Ghannoum , Michele Stoppa , Kiranjit Dhaliwal
CPC classification number: G06T7/74 , G06F3/14 , G06T13/00 , H04N23/651 , H04N23/66 , G01S5/02585 , G01S5/16
Abstract: A tracked device may be used in an extended reality system in coordination with a tracking device. The tracked device may be ordinarily difficult to track, for example due to changing appearances or relatively small surface areas of unchanging features, as may be the case with an electronic device with a relatively large display surrounded by a thin physical outer boundary. In these cases, the tracked device may periodically present an image to the tracking device that the tracking device stores as an indication to permit tracking of a known, unchanging feature despite the image not being presented continuously on the display of the tracked device. The image may include a static image, designated tracking data overlaid on an image frame otherwise scheduled for presentation, or extracted image features from the image frame otherwise scheduled for presentation. Additional power saving methods and known marker generation methods are also described.
-
-
-
-
-
-
-
-