-
公开(公告)号:US11611715B2
公开(公告)日:2023-03-21
申请号:US17509354
申请日:2021-10-25
Applicant: Apple Inc.
Inventor: Aleksandr M. Movshovich
Abstract: In some embodiments, a method is performed at a device with a processor, non-transitory memory, and an event camera including pixel sensors distributed across an area. The method includes converting an event stream from a pixel sensor over a first time period into event frames by dividing the first time period into sub-periods, and binning pixel events of the event stream, where each of the sub-periods is associated with a frame sub-period identifier. The method further includes addressing the pixel sensors by sub-dividing the area into tiles, where each of the tiles includes a grouping of the pixel sensors, and a tile address of a particular pixel sensor is a combination of a tile identifier and a position locator of the particular pixel sensor. The method further includes encoding the pixel events as a function of a tile address, a frame sub-period identifier, and a brightness indicator value.
-
公开(公告)号:US20200252533A1
公开(公告)日:2020-08-06
申请号:US16649005
申请日:2018-06-28
Applicant: Apple Inc.
Inventor: Aleksandr M. Movshovich , Arthur Yasheng Zhang
IPC: H04N5/235
Abstract: In accordance with some embodiments, a method is performed at an image processing device with a processor and non-transitory memory. The method includes triggering light emission, over a first emission duration, having a characterizing intensity as a function of time. The method further includes obtaining respective pixel events, from an event camera, corresponding to reflections of the light emission during the first emission duration, each respective pixel event corresponding to a breach of a respective comparator threshold indicative of a brightness level, each respective pixel event characterized by a respective electrical threshold value and a timestamp at which the respective electrical threshold value was breached. The method also includes generating a static image by determining a plurality of luminance estimation values from the respective pixel events, wherein the plurality of luminance estimation values respectively correspond to an amount of reflected light received by portions of the event camera.
-
公开(公告)号:US20200043237A1
公开(公告)日:2020-02-06
申请号:US16533053
申请日:2019-08-06
Applicant: Apple Inc.
Inventor: Ranjit Desai , Venu M. Duggineni , Perry A. Caro , Aleksandr M. Movshovich , Gurjeet S. Saund
Abstract: One implementation forms a composited stream of computer-generated reality (CGR) content using multiple data streams related to a CGR experience to facilitate recording or streaming. A media compositor obtains a first data stream of rendered frames and a second data stream of additional data. The rendered frame content (e.g., 3D models) represents real and virtual content rendered during a CGR experience at a plurality of instants in time. The additional data of the second data stream relates to the CGR experience, for example, relating to audio, audio sources, metadata identifying detected attributes of the CGR experience, image data, data from other devices involved in the CGR experience, etc. The media compositor forms a composited stream that aligns the rendered frame content with the additional data for the plurality of instants in time, for example, by forming time-stamped, n-dimensional datasets (e.g., images) corresponding to individual instants in time.
-
公开(公告)号:US12212729B2
公开(公告)日:2025-01-28
申请号:US18231648
申请日:2023-08-08
Applicant: Apple Inc.
Inventor: Yung-Chin Chen , Michael Bekerman , Guy Côté , Aleksandr M. Movshovich , D. Amnon Silverstein , David R. Pope
IPC: H04N13/111 , G06T15/00 , G06T19/00 , H04N13/122 , H04N13/178
Abstract: In one embodiment, a system includes a first device rendering image data, a second device storing the image data, and a display panel that displays the image data stored in the memory. The first device renders multiple frames of the image data, compresses the multiple frames into a single superframe, and transports the single superframe. The second device receives the single superframe, decompresses the single superframe into the multiple frames of image data, and stores the image data on a memory of the second device.
-
公开(公告)号:US11064387B1
公开(公告)日:2021-07-13
申请号:US16411302
申请日:2019-05-14
Applicant: Apple Inc.
Inventor: Aleksandr M. Movshovich , Arthur Y. Zhang , Hao Pan , Holly E. Gerhard , Jim C. Chou , Moinul H. Khan , Paul V. Johnson , Sorin C. Cismas , Sreeraman Anantharaman , William W. Sprague
IPC: H04W28/06 , H04W24/08 , H04N13/398 , H04N13/344 , H04N13/194
Abstract: One exemplary implementation involves performing operations at an electronic device with one or more processors and a computer-readable storage medium. The device establishes a wireless communication link with a host device. The device receives, from the host device, a left eye frame and a right eye frame via a sequence of left eye frame transmissions and right eye frame transmissions. The device switches data transmissions schemes according to wireless commination link quality or eye gaze tracking. Adjusting transmission format based on transmission quality of the wireless communication link allows the devices to take advantage of greater bandwidth when available to save power. An additional transmission format is based on alternately transmitting left eye and right eye frames for very low bandwidth.
-
公开(公告)号:US11019273B2
公开(公告)日:2021-05-25
申请号:US16649005
申请日:2018-06-28
Applicant: Apple Inc.
Inventor: Aleksandr M. Movshovich , Arthur Yasheng Zhang
IPC: H04N5/235
Abstract: In accordance with some embodiments, a method is performed at an image processing device with a processor and non-transitory memory. The method includes triggering light emission, over a first emission duration, having a characterizing intensity as a function of time. The method further includes obtaining respective pixel events, from an event camera, corresponding to reflections of the light emission during the first emission duration, each respective pixel event corresponding to a breach of a respective comparator threshold indicative of a brightness level, each respective pixel event characterized by a respective electrical threshold value and a timestamp at which the respective electrical threshold value was breached. The method also includes generating a static image by determining a plurality of luminance estimation values from the respective pixel events, wherein the plurality of luminance estimation values respectively correspond to an amount of reflected light received by portions of the event camera.
-
公开(公告)号:US20250148730A1
公开(公告)日:2025-05-08
申请号:US19016230
申请日:2025-01-10
Applicant: Apple Inc.
Inventor: Sheng Zhang , Aleksandr M. Movshovich , Arthur Y. Zhang , Chaohao Wang , Moinul H. Khan , Paolo Sacchetto , Yunhui Hou
IPC: G06T19/00 , G02B27/01 , H04N23/667 , H04N23/951
Abstract: An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.
-
公开(公告)号:US20250076672A1
公开(公告)日:2025-03-06
申请号:US18952845
申请日:2024-11-19
Applicant: Apple Inc.
Inventor: Tushar Gupta , Aleksandr M. Movshovich , Arthur Y. Zhang , Ray L. Chang , Fletcher R. Rothkopf
Abstract: Fiducial patterns that produce 2D Barker code-like diffraction patterns at a camera sensor are etched or otherwise provided on a cover glass in front of a camera. 2D Barker code kernels, when cross-correlated with the diffraction patterns captured in images by the camera, provide sharp cross-correlation peaks. Misalignment of the cover glass with respect to the camera can be derived by detecting shifts in the location of the detected peaks with respect to calibrated locations. Devices that include multiple cameras behind a cover glass with one or more fiducials on the cover glass in front of each camera are also described. The diffraction patterns caused by the fiducials at the various cameras may be analyzed to detect movement or distortion of the cover glass in multiple degrees of freedom.
-
公开(公告)号:US20230314828A1
公开(公告)日:2023-10-05
申请号:US18331045
申请日:2023-06-07
Applicant: Apple Inc.
Inventor: Tushar Gupta , Aleksandr M. Movshovich , Arthur Y. Zhang , Ray L. Chang , Fletcher R. Rothkopf
CPC classification number: G02B27/36 , G02B27/4227 , G02B27/0172 , G02B7/14 , H04N23/55 , H04N23/663 , G02B2027/0138
Abstract: Fiducial patterns that produce 2D Barker code-like diffraction patterns at a camera sensor are etched or otherwise provided on a cover glass in front of a camera. 2D Barker code kernels, when cross-correlated with the diffraction patterns captured in images by the camera, provide sharp cross-correlation peaks. Misalignment of the cover glass with respect to the camera can be derived by detecting shifts in the location of the detected peaks with respect to calibrated locations. Devices that include multiple cameras behind a cover glass with one or more fiducials on the cover glass in front of each camera are also described. The diffraction patterns caused by the fiducials at the various cameras may be analyzed to detect movement or distortion of the cover glass in multiple degrees of freedom.
-
公开(公告)号:US20230290321A1
公开(公告)日:2023-09-14
申请号:US18101779
申请日:2023-01-26
Applicant: Apple Inc.
Inventor: Siddharth Shankar Hazra , Ralf Habel , Anselm Grundhoefer , Aleksandr M. Movshovich , Moinul Khan , Marwan Hussein
CPC classification number: G09G5/10 , G02B27/017 , G06T19/006
Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.
-
-
-
-
-
-
-
-
-