-
公开(公告)号:US12198276B2
公开(公告)日:2025-01-14
申请号:US16926113
申请日:2020-07-10
Applicant: Apple Inc.
Inventor: Sheng Zhang , Aleksandr M. Movshovich , Arthur Y. Zhang , Chaohao Wang , Moinul H. Khan , Paolo Sacchetto , Yunhui Hou
IPC: G06T19/00 , G02B27/01 , H04N5/232 , H04N23/667 , H04N23/951
Abstract: An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.
-
公开(公告)号:US12057089B2
公开(公告)日:2024-08-06
申请号:US18101779
申请日:2023-01-26
Applicant: Apple Inc.
Inventor: Siddharth Shankar Hazra , Ralf Habel , Anselm Grundhoefer , Aleksandr M. Movshovich , Moinul Khan , Marwan Hussein
CPC classification number: G09G5/10 , G02B27/017 , G06T19/006 , G01J1/4204 , G02B2027/0118 , G02B27/0172 , G09G3/22 , G09G2360/14
Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.
-
公开(公告)号:US20230388468A1
公开(公告)日:2023-11-30
申请号:US18231648
申请日:2023-08-08
Applicant: Apple Inc.
Inventor: Yung-Chin Chen , Michael Bekerman , Guy Côté , Aleksandr M. Movshovich , D. Amnon Silverstein , David R. Pope
IPC: H04N13/111 , H04N13/178 , G06T19/00 , G06T15/00 , H04N13/122
CPC classification number: H04N13/111 , H04N13/178 , G06T19/006 , G06T15/005 , H04N13/122
Abstract: In one embodiment, a system includes a first device rendering image data, a second device storing the image data, and a display panel that displays the image data stored in the memory. The first device renders multiple frames of the image data, compresses the multiple frames into a single superframe, and transports the single superframe. The second device receives the single superframe, decompresses the single superframe into the multiple frames of image data, and stores the image data on a memory of the second device.
-
24.
公开(公告)号:US11818419B2
公开(公告)日:2023-11-14
申请号:US16586522
申请日:2019-09-27
Applicant: Apple Inc.
Inventor: Moinul H. Khan , Katharina Buckl , Venu M. Duggineni , Aleksandr M. Movshovich , Sreeraman Anantharaman , Phillip N. Smith
IPC: H04N21/435 , H04N21/431 , H04N21/44 , H04W28/02 , H04N21/442 , H04N21/462 , H04N21/4402
CPC classification number: H04N21/4355 , H04N21/431 , H04N21/4402 , H04N21/44008 , H04N21/44209 , H04N21/4621 , H04W28/0215 , H04W28/0268
Abstract: A mobile device includes a display, at least one sensor, and a wireless transceiver. The mobile device also includes control circuitry coupled to the display, the at least one sensor, and the wireless transceiver. The control circuitry is configured to obtain content primitives from the at least one sensor, to perform content provisioning operations to obtain content based at least in part on the content primitives, and to display the obtained content on the display, wherein at least some of the content is virtual content. In response to a bandwidth condition of the wireless communication channel being less than a threshold, the control circuitry is configured to perform adjusted content provisioning operations that involve increasing an amount of image processing operations performed by the mobile device to obtain the content.
-
公开(公告)号:US11770619B2
公开(公告)日:2023-09-26
申请号:US17235175
申请日:2021-04-20
Applicant: Apple Inc.
Inventor: Aleksandr M. Movshovich , Arthur Yasheng Zhang
Abstract: In accordance with some embodiments, a method is performed at an image processing device with a processor and non-transitory memory. The method includes triggering light emission, over a first emission duration, having a characterizing intensity as a function of time. The method further includes obtaining respective pixel events, from an event camera, corresponding to reflections of the light emission during the first emission duration, each respective pixel event corresponding to a breach of a respective comparator threshold indicative of a brightness level, each respective pixel event characterized by a respective electrical threshold value and a timestamp at which the respective electrical threshold value was breached. The method also includes generating a static image by determining a plurality of luminance estimation values from the respective pixel events, wherein the plurality of luminance estimation values respectively correspond to an amount of reflected light received by portions of the event camera.
-
公开(公告)号:US11743440B2
公开(公告)日:2023-08-29
申请号:US17234510
申请日:2021-04-19
Applicant: Apple Inc.
Inventor: Yung-Chin Chen , Michael Bekerman , Guy Côté , Aleksandr M. Movshovich , D. Amnon Silverstein , David R. Pope
IPC: H04N13/111 , H04N13/178 , G06T19/00 , G06T15/00 , H04N13/122
CPC classification number: H04N13/111 , G06T15/005 , G06T19/006 , H04N13/122 , H04N13/178
Abstract: In one embodiment, a system includes a first device rendering image data, a second device storing the image data, and a display panel that displays the image data stored in the memory. The first device renders multiple frames of the image data, compresses the multiple frames into a single superframe, and transports the single superframe. The second device receives the single superframe, decompresses the single superframe into the multiple frames of image data, and stores the image data on a memory of the second device.
-
公开(公告)号:US20220337799A1
公开(公告)日:2022-10-20
申请号:US17234510
申请日:2021-04-19
Applicant: Apple Inc.
Inventor: Yung-Chin Chen , Michael Bekerman , Guy Côté , Aleksandr M. Movshovich , D. Amnon Silverstein , David R. Pope
IPC: H04N13/111 , H04N13/178 , H04N13/122 , G06T15/00 , G06T19/00
Abstract: In one embodiment, a system includes a first device rendering image data, a second device storing the image data, and a display panel that displays the image data stored in the memory. The first device renders multiple frames of the image data, compresses the multiple frames into a single superframe, and transports the single superframe. The second device receives the single superframe, decompresses the single superframe into the multiple frames of image data, and stores the image data on a memory of the second device.
-
公开(公告)号:US11308696B2
公开(公告)日:2022-04-19
申请号:US16533053
申请日:2019-08-06
Applicant: Apple Inc.
Inventor: Ranjit Desai , Venu M. Duggineni , Perry A. Caro , Aleksandr M. Movshovich , Gurjeet S. Saund
Abstract: One implementation forms a composited stream of computer-generated reality (CGR) content using multiple data streams related to a CGR experience to facilitate recording or streaming. A media compositor obtains a first data stream of rendered frames and a second data stream of additional data. The rendered frame content (e.g., 3D models) represents real and virtual content rendered during a CGR experience at a plurality of instants in time. The additional data of the second data stream relates to the CGR experience, for example, relating to audio, audio sources, metadata identifying detected attributes of the CGR experience, image data, data from other devices involved in the CGR experience, etc. The media compositor forms a composited stream that aligns the rendered frame content with the additional data for the plurality of instants in time, for example, by forming time-stamped, n-dimensional datasets (e.g., images) corresponding to individual instants in time.
-
公开(公告)号:US20210241676A1
公开(公告)日:2021-08-05
申请号:US17158402
申请日:2021-01-26
Applicant: Apple Inc.
Inventor: Siddharth Shankar Hazra , Ralf Habel , Anselm Grundhoefer , Aleksandr M. Movshovich , Moinul Khan , Marwan Hussein
Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.
-
公开(公告)号:US20210211592A1
公开(公告)日:2021-07-08
申请号:US17205385
申请日:2021-03-18
Applicant: Apple Inc.
Inventor: Aleksandr M. Movshovich
Abstract: In some embodiments, a method is performed at a device with a processor, non-transitory memory, and an event camera including pixel sensors distributed across an area. The method includes converting an event stream from a pixel sensor over a first time period into event frames by dividing the first time period into sub-periods, and binning pixel events of the event stream, where each of the sub-periods is associated with a frame sub-period identifier. The method further includes addressing the pixel sensors by sub-dividing the area into tiles, where each of the tiles includes a grouping of the pixel sensors, and a tile address of a particular pixel sensor is a combination of a tile identifier and a position locator of the particular pixel sensor. The method further includes encoding the pixel events as a function of a tile address, a frame sub-period identifier, and a brightness indicator value.
-
-
-
-
-
-
-
-
-