-
公开(公告)号:US12039106B2
公开(公告)日:2024-07-16
申请号:US17991586
申请日:2022-11-21
Applicant: Rockwell Automation Technologies, Inc.
Inventor: Thong T. Nguyen , Paul D. Schmirler , Timothy T. Duffy
IPC: G06T19/00 , G06F1/16 , G06F3/01 , G06F3/04815 , G06F3/0482 , G06F3/04842 , G06F3/04845 , G06T13/20
CPC classification number: G06F3/017 , G06F1/163 , G06F3/011 , G06F3/013 , G06F3/04815 , G06F3/0482 , G06F3/04842 , G06F3/04845 , G06T13/20 , G06T19/006
Abstract: A method may include receiving, via a processor, image data associated with a user's surrounding and generating, via the processor, a visualization that may include a virtual industrial automation device. The virtual industrial automation device may depict a virtual object within image data, and the virtual object may correspond to a physical industrial automation device. The method may include displaying, via the processor, the visualization via an electronic display and detecting, via the processor, a gesture in image data that may include the user's surrounding and the visualization. The gesture may be indicative of a request to move the virtual industrial automation device. The method may include tracking, via the processor, a user's movement, generating, via the processor, a visualization that may include an animation of the virtual industrial automation device moving based on the user's movement, and displaying, via the processor, the visualization via the electronic display.
-
12.
公开(公告)号:US20230092938A1
公开(公告)日:2023-03-23
申请号:US17482205
申请日:2021-09-22
Applicant: Rockwell Automation Technologies, Inc.
Inventor: Thong T. Nguyen , Paul D. Schmirler , Timothy T. Duffy , Kristopher J. Holley , Susan J. Lovas
IPC: G05B19/418
Abstract: A non-transitory computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive sensory datasets associated with an industrial automation system from sensors, receive positioning data via an extended reality device associated with a user, determine a first virtual positioning of the user in a virtual coordinate system based on the positioning data, determine a second virtual positioning of an industrial automation system in the virtual coordinate system based on the sensory datasets, determine output representative data to be presented by the extended reality device based on the plurality of sensory datasets and in accordance to the first virtual positioning relative to the second virtual positioning, and instruct the extended reality device to present the output representative data.
-
公开(公告)号:US20230091359A1
公开(公告)日:2023-03-23
申请号:US17991586
申请日:2022-11-21
Applicant: Rockwell Automation Technologies, Inc.
Inventor: Thong T. Nguyen , Paul D. Schmirler , Timothy T. Duffy
IPC: G06F3/01 , G06F3/04815 , G06F3/04842 , G06T13/20 , G06T19/00 , G06F1/16 , G06F3/04845 , G06F3/0482
Abstract: A method may include receiving, via a processor, image data associated with a user's surrounding and generating, via the processor, a visualization that may include a virtual industrial automation device. The virtual industrial automation device may depict a virtual object within image data, and the virtual object may correspond to a physical industrial automation device. The method may include displaying, via the processor, the visualization via an electronic display and detecting, via the processor, a gesture in image data that may include the user's surrounding and the visualization. The gesture may be indicative of a request to move the virtual industrial automation device. The method may include tracking, via the processor, a user's movement, generating, via the processor, a visualization that may include an animation of the virtual industrial automation device moving based on the user's movement, and displaying, via the processor, the visualization via the electronic display.
-
公开(公告)号:US11829126B2
公开(公告)日:2023-11-28
申请号:US17482205
申请日:2021-09-22
Applicant: Rockwell Automation Technologies, Inc.
Inventor: Thong T. Nguyen , Paul D. Schmirler , Timothy T. Duffy , Kristopher J. Holley , Susan J. Lovas
IPC: G05B19/418
CPC classification number: G05B19/41885 , G05B2219/32014 , G05B2219/32342
Abstract: A non-transitory computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive sensory datasets associated with an industrial automation system from sensors, receive positioning data via an extended reality device associated with a user, determine a first virtual positioning of the user in a virtual coordinate system based on the positioning data, determine a second virtual positioning of an industrial automation system in the virtual coordinate system based on the sensory datasets, determine output representative data to be presented by the extended reality device based on the plurality of sensory datasets and in accordance to the first virtual positioning relative to the second virtual positioning, and instruct the extended reality device to present the output representative data.
-
15.
公开(公告)号:US20230092405A1
公开(公告)日:2023-03-23
申请号:US17482165
申请日:2021-09-22
Applicant: Rockwell Automation Technologies, Inc.
Inventor: Thong T. Nguyen , Paul D. Schmirler , Timothy T. Duffy , Kristopher J. Holley , Susan J. Lovas
IPC: G05B19/418 , G06F16/23 , G06F3/0482 , G06T11/00 , G06F3/01
Abstract: A tangible, non-transitory, computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive user input indicative of a selection of a user experience of a plurality of user experiences. The plurality of user experiences include a first user experience associated with a first event that occurred in an industrial automation system at a first time prior to receiving the user input and a second user experience associated with a second event expected to occur in the industrial automation system at a second time after receiving the user input. When executed, the instructions also cause the processing circuitry to determine, based on the user input, output representative data associated with the industrial automation system and instruct an extended reality device to present the output representative data.
-
公开(公告)号:US11507195B2
公开(公告)日:2022-11-22
申请号:US17184254
申请日:2021-02-24
Applicant: Rockwell Automation Technologies, Inc.
Inventor: Thong T. Nguyen , Paul D. Schmirler , Timothy T. Duffy
IPC: G06T19/00 , G06F3/01 , G06F3/04815 , G06F3/04842 , G06T13/20 , G06F1/16 , G06F3/04845 , G06F3/0482
Abstract: A method may include receiving, via a processor, image data associated with a user's surrounding and generating, via the processor, a visualization that may include a virtual industrial automation device. The virtual industrial automation device may depict a virtual object within image data, and the virtual object may correspond to a physical industrial automation device. The method may include displaying, via the processor, the visualization via an electronic display and detecting, via the processor, a gesture in image data that may include the user's surrounding and the visualization. The gesture may be indicative of a request to move the virtual industrial automation device. The method may include tracking, via the processor, a user's movement, generating, via the processor, a visualization that may include an animation of the virtual industrial automation device moving based on the user's movement, and displaying, via the processor, the visualization via the electronic display.
-
公开(公告)号:US11500915B2
公开(公告)日:2022-11-15
申请号:US16560696
申请日:2019-09-04
Applicant: Rockwell Automation Technologies, Inc.
Inventor: Thong T. Nguyen , Paul D. Schmirler , Timothy T. Duffy , Hannah M. Schermerhorn , Jingbo Liu
IPC: G06F16/41 , G06F16/438 , G06F16/432 , G09B19/00
Abstract: A non-transitory computer-readable medium includes computer-executable instructions that, when executed by at least one processor, may cause the at least one processor to retrieve a first training profile of a plurality of training profiles from a database, identify a plurality of index keywords in a respective training content of the first training profile, in which the respective training content includes audio data, video data, or both, and divide the first training profile into a plurality of sections based on the plurality of index keywords. Each of the plurality of sections is selectable for playback.
-
公开(公告)号:US10964104B2
公开(公告)日:2021-03-30
申请号:US16287828
申请日:2019-02-27
Applicant: Rockwell Automation Technologies, Inc.
Inventor: Timothy T. Duffy , Paul D. Schmirler , Thong T. Nguyen
Abstract: A system for monitoring an industrial system may have a computing device that generates a first three-dimensional (3D) visualization based on 3D video associated with an industrial system. The first 3D visualization may have one or more 3D device visualizations of industrial automation devices, and each 3D device visualization of the industrial automation devices that may depict a 3D object that corresponds to an industrial automation device in the industrial system. The computing device may display the first 3D visualization via an electronic display and detect a gesture in a first set of image data comprising the surrounding of the user and the first 3D visualization. The gesture is indicative of a modification associated with the first 3D visualization. The computing device may receive additional 3D video associated with the industrial system, generate a second 3D visualization based on the modification and the additional 3D video, and display the second 3D visualization via the electronic display.
-
19.
公开(公告)号:US11688107B2
公开(公告)日:2023-06-27
申请号:US17482145
申请日:2021-09-22
Applicant: Rockwell Automation Technologies, Inc.
Inventor: Thong T. Nguyen , Paul D. Schmirler , Timothy T. Duffy , Kristopher J. Holley , Susan J. Lovas
Abstract: A tangible, non-transitory, computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive sensory datasets associated with an industrial automation system, determine context information based on a sensory dataset and representative of an environmental condition, predict an intent of a user to complete a task associated with the industrial automation system based on the sensory datasets and the context information, present first output representative data via an extended reality device based on the intent and a setting, the setting including a data presentation format for presenting the sensory datasets, receive inputs indicative of changes to the data presentation format, present second output representative data via the extended reality device in response to receiving the inputs, and update the setting based on the inputs and historical data indicative of users changing the data presentation format of the first output representative data.
-
20.
公开(公告)号:US20230093660A1
公开(公告)日:2023-03-23
申请号:US17482097
申请日:2021-09-22
Applicant: Rockwell Automation Technologies, Inc.
Inventor: Thong T. Nguyen , Paul D. Schmirler , Timothy T. Duffy , Kristopher J. Holley , Susan J. Lovas
Abstract: A tangible, non-transitory, computer-readable medium includes instructions. The instructions, when executed by processing circuitry, are configured to cause the processing circuitry to receive a plurality of sensory datasets associated with an industrial automation system from a plurality of sensors, categorize each sensory dataset of the plurality of sensory datasets into one or more sensory dataset categories of a plurality of sensory dataset categories, determine context information associated with the plurality of sensory datasets, the context information being representative of an environmental condition associated with an extended reality device, the industrial automation system, or both, determine a priority of each sensor dataset category of the plurality of sensory dataset categories based on the context information, determine output representative data to be presented by the extended reality device based on the plurality of sensory datasets and the priority, and instruct the extended reality device to present the output representative data.
-
-
-
-
-
-
-
-
-