-
公开(公告)号:US20220180473A1
公开(公告)日:2022-06-09
申请号:US17437298
申请日:2020-03-19
Applicant: Apple Inc.
Inventor: Tobias Eble , Nitin Nandakumar , Hariprasad Puthukkootil Rajagopol , Thomas Post
Abstract: In one implementation, a method of frame rate extrapolation is performed by a device including one or more processors, non-transitory memory, a scene camera, and a display. The method includes capturing, using the scene camera, an image of a scene. The method includes displaying, on the display, the image of the scene at a first time. The method includes generating an extrapolated image by transforming, using the one or more processors, the image of the scene based on movement of the device, wherein the extrapolated image includes a first area including a first plurality of pixels having respective first pixel values based on a single depth and a second area including a second plurality of pixels having respective second pixel values based on a plurality of depths. The method includes displaying, on the display, the extrapolated image at a second time after the first time.
-
公开(公告)号:US11057614B1
公开(公告)日:2021-07-06
申请号:US16555279
申请日:2019-08-29
Applicant: Apple Inc.
Inventor: Tobias Eble
IPC: H04N13/383 , G09G3/20 , H04N13/351 , H04N13/344
Abstract: In one implementation, a method of compensating for motion blur while presenting content on a display of an electronic device through display actuation is disclosed. The method involves detecting movement of the electronic device using a sensor of the electronic device while presenting content on a display of the electronic device. An inter-frame movement of the electronic device is determined based on the movement of the electronic device. The display is moved using an actuator of the electronic device that is coupled to the display such that movement of the display opposes the inter-frame movement of the electronic device.
-
公开(公告)号:US11043018B2
公开(公告)日:2021-06-22
申请号:US16662952
申请日:2019-10-24
Applicant: Apple Inc.
Inventor: Arthur Y Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
公开(公告)号:US20200082498A1
公开(公告)日:2020-03-12
申请号:US16681631
申请日:2019-11-12
Applicant: Apple Inc.
Inventor: Tobias Eble , Jim C. Chou , Jian Zhou , Moinul Khan , Hariprasad Puthukkootil Rajagopal
Abstract: In various implementations, a method includes obtaining a first frame that is characterized by a first resolution associated with a first memory allocation. In some implementations, the method includes down-converting the first frame from the first resolution to a second resolution that is lower than the first resolution initially defining the first frame in order to produce a reference frame. In some implementations, the second resolution is associated with a second memory allocation that is less than a target memory allocation derived from the first memory allocation. In some implementations, the method includes storing the reference frame in a non-transitory memory. In some implementations, the method includes obtaining a second frame that is characterized by the first resolution. In some implementations, the method includes performing an error correction operation on the second frame based on the reference frame stored in the non-transitory memory.
-
公开(公告)号:US20200058152A1
公开(公告)日:2020-02-20
申请号:US16662952
申请日:2019-10-24
Applicant: Apple Inc.
Inventor: Arthur Y. Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
公开(公告)号:US12002132B1
公开(公告)日:2024-06-04
申请号:US17687015
申请日:2022-03-04
Applicant: Apple Inc.
Inventor: Tobias Eble , William J. Dobbie
CPC classification number: G06T11/203 , G06T1/20 , G06T15/005
Abstract: Various implementations disclosed herein include devices, systems, and methods that use an analytic approach to determine signed distance field (SDF) representations that represent one or more curves (e.g., glyphs that represent text) and cache the SDF representations for reuse in rendering the curves in similar rendering conditions. For example, the SDF representation may be re-used, based on determining that text is going to occupy a similar-sized portion of the device's display in multiple views. An SDF representation is recalculated if different conditions (e.g., substantial zooming in on the text) occur in different views.
-
公开(公告)号:US20240095879A1
公开(公告)日:2024-03-21
申请号:US18369638
申请日:2023-09-18
Applicant: Apple Inc.
Inventor: Andreas Gapel , Nitin Nandakumar , Sabine Webel , Tobias Eble
CPC classification number: G06T3/40 , G06F3/013 , G06T11/00 , G06T2200/16 , G06T2210/08
Abstract: In one implementation, a method of generating an image is performed by a device including one or more processors and non-transitory memory. The method includes generating a first resolution function based on a formula with a set of variables having a first set of values. The method includes generating a first image based on first content and the first resolution function. The method includes detecting a resolution constraint. The method includes generating a second resolution function based on the formula with the set of variables having a second set of values, wherein the second resolution function has a summation value that satisfies the resolution constraint. The method includes generating a second image based on second content and the second resolution function.
-
公开(公告)号:US11915349B1
公开(公告)日:2024-02-27
申请号:US17694959
申请日:2022-03-15
Applicant: Apple Inc.
Inventor: Nitin Nandakumar , Tobias Eble , Shenyao Ke
CPC classification number: G06T11/40 , G06T1/20 , G06T7/50 , G06T7/64 , G06T7/73 , G06T2200/12 , G06T2200/28
Abstract: Various implementations disclosed herein interpret data that define curves to display the curves in a 2D or 3D environment. In some implementations, vertices are used to represent control points that specify the geometry of a curve. These vertices are changed in an extrusion process that moves and/or adds vertices to ensure that sufficient pixels are available for anti-aliasing during rasterization, while also providing changed vertices that can be interpreted to accurately render the curve's geometry.
-
公开(公告)号:US20230419439A1
公开(公告)日:2023-12-28
申请号:US18244513
申请日:2023-09-11
Applicant: Apple Inc.
Inventor: Tobias Eble , Pedro Manuel Da Silva Quelhas , Raffi A. Bedikian
CPC classification number: G06T3/0093 , G06T11/00 , G06T7/50 , G06T2207/20084
Abstract: Various implementations disclosed herein include a method performed at an electronic device including one or more processors, a non-transitory memory, an image sensor, and a display device. The method includes obtaining, via the image sensor, an input image that includes an object. The method includes obtaining depth information characterizing the object, wherein the depth information characterizes a first distance between the image sensor and a portion of the object. The method includes determining a distance warp map for the input image based on a function of the depth information and a first offset value characterizing an estimated distance between eyes of a user and the display device. The method includes setting an operational parameter for the electronic device based on the distance warp map and generating, by the electronic device set to the operational parameter, a warped image from the input image.
-
公开(公告)号:US11727619B2
公开(公告)日:2023-08-15
申请号:US17352080
申请日:2021-06-18
Applicant: Apple Inc.
Inventor: Arthur Y Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
CPC classification number: G06T15/005 , G06F3/012 , G06T3/0093 , G06T9/00 , H04W76/10 , H04W88/08
Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
-
-
-
-
-
-
-
-