-
公开(公告)号:US20210090323A1
公开(公告)日:2021-03-25
申请号:US17028887
申请日:2020-09-22
申请人: Apple Inc.
发明人: Siddharth S. Hazra , William J. Dobbie , Moinul H. Khan , Yanli Zhang , Yohan Rajan , Arthur Y. Zhang
摘要: Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.
-
公开(公告)号:US20240107183A1
公开(公告)日:2024-03-28
申请号:US18369399
申请日:2023-09-18
申请人: Apple Inc.
发明人: Joseph Cheung , Kaushik Raghunath , Michael Bekerman , Moinul H. Khan , Vivaan Bahl , Yung-Chin Chen , Yuqing Su
CPC分类号: H04N23/86 , H04N23/665 , H04N23/83
摘要: In some implementations, a method of synchronizing a content generation and delivery architecture to reduce the latency associated with image passthrough. The method includes: determining a temporal offset associated with the content generation and delivery architecture to reduce a photon-to-photon latency across the content generation and delivery architecture; obtaining a first reference rate associated with a portion of the content generation and delivery architecture; generating, via synchronization circuitry, a synchronization signal for the content generation and delivery architecture based at least in part on the first reference rate; and operating the content generation and delivery architecture according to the synchronization signal and the temporal offset.
-
公开(公告)号:US11048082B1
公开(公告)日:2021-06-29
申请号:US16377500
申请日:2019-04-08
申请人: Apple Inc.
发明人: Aleksandr M. Movshovich , Yanli Zhang , Paul V. Johnson , Holly E. Gerhard , Arthur Y. Zhang , Moinul H. Khan
IPC分类号: G02B27/01 , H04N13/385 , H04L1/00 , G06F3/01 , G02B27/00
摘要: One exemplary implementation involves performing operations at an electronic device with one or more processors and a computer-readable storage medium. The device establishes a wireless communication link with a host device. The device receives, from the host device, a left eye frame and a right eye frame via a sequence of interleaved left eye frame transmissions and right eye frame transmissions. The device loads the left eye frame into a left eye display device and loads the right eye frame into a right eye display device on the electronic device, where the loading includes sequentially loading left eye frame portions and right eye frame portions as the sequence of interleaved left eye frame transmissions and right eye frame transmissions is received. The device then concurrently displays the left eye frame and the right eye frame at the electronic device. The device switches data transmissions schemes according to wireless communication link quality and eye gaze tracking.
-
公开(公告)号:US10748340B1
公开(公告)日:2020-08-18
申请号:US15989756
申请日:2018-05-25
申请人: Apple Inc.
发明人: Sheng Zhang , Aleksandr M. Movshovich , Arthur Y. Zhang , Chaohao Wang , Moinul H. Khan , Paolo Sacchetto , Yunhui Hou
摘要: An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.
-
公开(公告)号:US11695977B2
公开(公告)日:2023-07-04
申请号:US16586452
申请日:2019-09-27
申请人: Apple Inc.
发明人: Moinul H. Khan , Jim C. Chou , Sorin C. Cismas
IPC分类号: H04N21/2662 , H04N19/59 , H04W72/08 , H04L1/00
CPC分类号: H04N21/2662 , H04L1/0003 , H04L1/0009 , H04N19/59 , H04W72/085
摘要: An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.
-
公开(公告)号:US11308685B2
公开(公告)日:2022-04-19
申请号:US17028887
申请日:2020-09-22
申请人: Apple Inc.
发明人: Siddharth S. Hazra , William J. Dobbie , Moinul H. Khan , Yanli Zhang , Yohan Rajan , Arthur Y. Zhang
摘要: Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.
-
公开(公告)号:US11064387B1
公开(公告)日:2021-07-13
申请号:US16411302
申请日:2019-05-14
申请人: Apple Inc.
发明人: Aleksandr M. Movshovich , Arthur Y. Zhang , Hao Pan , Holly E. Gerhard , Jim C. Chou , Moinul H. Khan , Paul V. Johnson , Sorin C. Cismas , Sreeraman Anantharaman , William W. Sprague
IPC分类号: H04W28/06 , H04W24/08 , H04N13/398 , H04N13/344 , H04N13/194
摘要: One exemplary implementation involves performing operations at an electronic device with one or more processors and a computer-readable storage medium. The device establishes a wireless communication link with a host device. The device receives, from the host device, a left eye frame and a right eye frame via a sequence of left eye frame transmissions and right eye frame transmissions. The device switches data transmissions schemes according to wireless commination link quality or eye gaze tracking. Adjusting transmission format based on transmission quality of the wireless communication link allows the devices to take advantage of greater bandwidth when available to save power. An additional transmission format is based on alternately transmitting left eye and right eye frames for very low bandwidth.
-
8.
公开(公告)号:US20230396824A1
公开(公告)日:2023-12-07
申请号:US18329040
申请日:2023-06-05
申请人: Apple Inc.
发明人: Moinul H. Khan , Jim C. Chou , Sorin C. Cismas
IPC分类号: H04N21/2662 , H04N19/59 , H04L1/00 , H04W72/542
CPC分类号: H04N21/2662 , H04N19/59 , H04L1/0009 , H04L1/0003 , H04W72/542
摘要: An electronic device includes a wireless transceiver configured to receive content primitives via a wireless communication channel. The electronic device also includes control circuitry control circuitry coupled to the wireless transceiver, and configured to perform content provisioning operations based on the received content primitives, wherein the content provisioning operations comprise generating content image data and transmitting the content image data to the wireless communication channel using the wireless transceiver. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that decrease an amount of content image data conveyed by the wireless transceiver to the wireless communication channel.
-
公开(公告)号:US11818419B2
公开(公告)日:2023-11-14
申请号:US16586522
申请日:2019-09-27
申请人: Apple Inc.
发明人: Moinul H. Khan , Katharina Buckl , Venu M. Duggineni , Aleksandr M. Movshovich , Sreeraman Anantharaman , Phillip N. Smith
IPC分类号: H04N21/435 , H04N21/431 , H04N21/44 , H04W28/02 , H04N21/442 , H04N21/462 , H04N21/4402
CPC分类号: H04N21/4355 , H04N21/431 , H04N21/4402 , H04N21/44008 , H04N21/44209 , H04N21/4621 , H04W28/0215 , H04W28/0268
摘要: A mobile device includes a display, at least one sensor, and a wireless transceiver. The mobile device also includes control circuitry coupled to the display, the at least one sensor, and the wireless transceiver. The control circuitry is configured to obtain content primitives from the at least one sensor, to perform content provisioning operations to obtain content based at least in part on the content primitives, and to display the obtained content on the display, wherein at least some of the content is virtual content. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that involve increasing an amount of image processing operations performed by the mobile device to obtain the content.
-
公开(公告)号:US20200342678A1
公开(公告)日:2020-10-29
申请号:US16926113
申请日:2020-07-10
申请人: Apple Inc.
发明人: Sheng Zhang , Aleksandr M. Movshovich , Arthur Y. Zhang , Chaohao Wang , Moinul H. Khan , Paolo Sacchetto , Yunhui Hou
摘要: An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.
-
-
-
-
-
-
-
-
-