-
公开(公告)号:US11727619B2
公开(公告)日:2023-08-15
申请号:US17352080
申请日:2021-06-18
申请人: Apple Inc.
发明人: Arthur Y Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
CPC分类号: G06T15/005 , G06F3/012 , G06T3/0093 , G06T9/00 , H04W76/10 , H04W88/08
摘要: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
公开(公告)号:US11243734B2
公开(公告)日:2022-02-08
申请号:US16833230
申请日:2020-03-27
申请人: Apple Inc.
摘要: A first device coupled with a first display and an image sensor receives output data from a second device having a second display different from the first display. The output data represents content displayable by the second device on the second display. The first device determines, using the image sensor, a position of the second display relative to the first device and causes the first display to display content based on the output data received from the second device and the determined position of the second display relative to the first device.
-
公开(公告)号:US11022802B2
公开(公告)日:2021-06-01
申请号:US16586664
申请日:2019-09-27
申请人: Apple Inc.
摘要: An apparatus includes a transceiver and a controller in communication with the transceiver. The controller is configured to determine a target lighting condition in a room relative to a current lighting condition in the room. The controller is also configured to generate a control signal with instructions to adjust an ambient lighting peripheral in the room based on the determined target lighting condition. The control signal is provided to the transceiver for transmission.
-
公开(公告)号:US20170358057A1
公开(公告)日:2017-12-14
申请号:US15263261
申请日:2016-09-12
申请人: Apple Inc.
CPC分类号: G06T3/4038 , A63F13/63 , G06T11/001 , G06T11/60 , G06T2207/10024 , G06T2207/20021
摘要: A method of assembling a tile map can include assigning each tile in a plurality of tiles to one or more color groups in correspondence with a measure of a color profile of the respective tile: A position of each tile in relation to one or more neighboring tiles can be determined from a position of a silhouette corresponding to each respective tile in relation to one or more neighboring silhouettes within a set containing a plurality of silhouettes. The plurality of tiles can be automatically assembled into a tile map, with a position of each tile in the tile map being determined from the color group to which the respective tile belongs and the determined position of the respective tile in relation to the one or more neighboring tiles. Tangible, non-transitory computer-readable media can include computer executable instructions that, when executed, cause a computing environment to implement disclosed methods.
-
公开(公告)号:US20170148131A1
公开(公告)日:2017-05-25
申请号:US15425598
申请日:2017-02-06
申请人: Apple Inc.
CPC分类号: G06T1/20 , G06T1/60 , G06T13/80 , G06T15/005 , G06T15/04 , G06T2210/61
摘要: A set of tools, in the form of a software developers kit (SDK) for a graphics rendering system, is provided to improve overall graphics operations. In general, the tools are directed to analyzing a scene tree and optimizing its presentation to one or more graphics processing units (GPUs) so as to improve rendering operations. This overall goal is provided through a number of different capabilities, each of which is presented to software developers through a new applications programming interface (API).
-
公开(公告)号:US20160358485A1
公开(公告)日:2016-12-08
申请号:US14732746
申请日:2015-06-07
申请人: Apple Inc.
CPC分类号: G08G9/02 , B60W30/09 , G01C21/00 , G05D1/0212
摘要: Systems, methods, and computer readable media to improve the operation of graphics systems are described. In general, collision avoidance techniques are disclosed that operate even when the agent lacks a priori knowledge of its environment and is, further, agnostic as to whether the environment is two-dimensional (2D) or three-dimensional (3D), whether the obstacles are convex or concave, or whether the obstacles are moving or stationary. More particularly, techniques disclosed herein use simple geometry to identify which edges of which obstacles an agent is most likely to collide. With this known, the direction of an avoidance force is also known. The magnitude of the force may be fixed, based on the agent's maximum acceleration, and modulated by weighting agents
摘要翻译: 描述了用于改进图形系统的操作的系统,方法和计算机可读介质。 通常,公开了避免碰撞的技术,即使在代理人缺乏对其环境的先验知识的情况下也可以进行操作,而且还不知道环境是二维的还是三维的(3D) 是凸的还是凹的,还是障碍物是移动还是静止。 更具体地,本文公开的技术使用简单的几何来识别代理最可能发生碰撞的障碍物的哪些边缘。 就此而言,避免力的方向也是已知的。 力的大小可以基于代理的最大加速度而被固定,并由加权代理进行调制
-
公开(公告)号:US20150348315A1
公开(公告)日:2015-12-03
申请号:US14292636
申请日:2014-05-30
申请人: Apple Inc.
CPC分类号: G06T1/20 , G06K9/4652 , G06T15/04
摘要: Systems, methods and program storage devices are disclosed, which comprise instructions to cause one or more processing units to dynamically render 3D lighting effects for a supplied 2D texture map—without the need for a programmer to supply a normal map along with the 2D texture map. According to some embodiments, an algorithm may inspect the pixel values (e.g., RGB values) of each individual pixel of the texture map, and, based on the pixel values, can accurately estimate where the lighting and shadow effects should be applied to the source 2D texture file to simulate 3D lighting. Further, because these effects are being rendered dynamically by the rendering and animation infrastructure, the techniques described herein work especially well for “dynamic content,” e.g., user-downloaded data, in-application user-created content, operating system (OS) icons, and other user interface (UI) elements for which programmers do not have access to normal maps a priori.
摘要翻译: 公开了系统,方法和程序存储设备,其包括使一个或多个处理单元动态地渲染所提供的2D纹理映射的3D照明效果的指令,而不需要编程人员与2D纹理贴图一起提供法线贴图 。 根据一些实施例,算法可以检查纹理贴图的每个单独像素的像素值(例如,RGB值),并且基于像素值可以精确地估计应该将光照和阴影效应应用于源 2D纹理文件来模拟3D照明。 此外,由于这些效果通过渲染和动画基础设施动态地呈现,所以本文所描述的技术特别适用于“动态内容”,例如用户下载的数据,应用内用户创建的内容,操作系统(OS)图标 ,以及程序员先前无法访问法线贴图的其他用户界面(UI)元素。
-
公开(公告)号:US20220245906A1
公开(公告)日:2022-08-04
申请号:US17727311
申请日:2022-04-22
申请人: Apple Inc.
摘要: Various implementations disclosed herein include devices, systems, and methods that enable a device to provide a view of virtual elements and a physical environment where the presentation of the virtual elements is based on positioning relative to the physical environment. In one example, a device is configured to detect a change in positioning of a virtual element, for example, when a virtual element is added, moved, or the physical environment around the virtual element is changed. The location of the virtual element in the physical environment is used to detect an attribute of the physical environment upon which the presentation of the virtual element depends. Thus, the device is further configured to detect an attribute (e.g., surface, table, mid-air, etc.) of the physical environment based on the placement of the virtual element and present the virtual element based on the detected attribute.
-
公开(公告)号:US11379033B2
公开(公告)日:2022-07-05
申请号:US17019856
申请日:2020-09-14
申请人: Apple Inc.
IPC分类号: G06F3/04815 , G06F3/04886 , G06F3/01 , G06F3/0354 , G06F3/0489
摘要: Implementations use a first device (e.g., an HMD) to provide a CGR environment that augments the input and output capabilities of a second device, e.g., a laptop, smart speaker, etc. In some implementations, the first device communicates with a second device in its proximate physical environment to exchange input or output data. For example, an HMD may capture an image of a physical environment that includes a laptop. The HMD may detect the laptop, send a request the laptop's content, receive content from the laptop (e.g., the content that the laptop is currently displaying and additional content), identify the location of the laptop, and display a virtual object with the received content in the CGR environment on or near the laptop. The size, shape, orientation, or position of the virtual object (e.g., a virtual monitor or monitor extension) may also be configured to provide a better user experience.
-
公开(公告)号:US11308686B1
公开(公告)日:2022-04-19
申请号:US17100685
申请日:2020-11-20
申请人: Apple Inc.
摘要: The present disclosure relates generally to for displaying a set of images based on captured image data. In some embodiments, a system displays a first set of images corresponding to a first perspective in a virtual reality (VR) (or mixed reality (MR)) environment. The system receives a request while displaying the first set of images. The system captures image data corresponding to a second perspective in the VR (or MR) environment in response to receiving the request. The system displays a second set of images based on the captured image data.
-
-
-
-
-
-
-
-
-