公开(公告)号：US20180130260A1

公开(公告)日：2018-05-10

申请号：US15718907

申请日：2017-09-28

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Paul D. Schmirler ,  Thong T. Nguyen ,  Alex L. Nicoll ,  David Vasko

IPC: G06T19/00 ,  G06Q10/06 ,  G06F3/147

CPC classification number: G06T19/006 ,  G05B23/0216 ,  G05B2219/32014 ,  G06F3/017 ,  G06F3/04815 ,  G06F3/147 ,  G06F3/167 ,  G06Q10/0633 ,  G06Q10/06393 ,  G06Q10/20 ,  G06T2219/024 ,  H04L63/08

Abstract: An industrial visualization system generates and delivers virtual reality (VR) and augmented reality (AR) presentations of industrial facilities to wearable appliances to facilitate remote or enhanced interaction with automation systems within the facility. VR presentations can comprise three-dimensional (3D) holographic views of a plant facility or a location within a plant facility. The system can selectively render a scaled down view that renders the facility as a 3D scale model, or as a first-person view that renders the facility as a full-scale rendition that simulates the user's presence on the plant floor. Camera icons rendered in the VR presentation can be selected to switch to a live video stream generated by 360-degree cameras within the plant. The system can also render workflow presentations that guide users through the process of correcting detected maintenance issues.

公开(公告)号：US20180129276A1

公开(公告)日：2018-05-10

申请号：US15807247

申请日：2017-11-08

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Thong T. Nguyen ,  John M. Van Hecke ,  Alex L. Nicoll ,  Paul D. Schmirler ,  Mark Bjerke

IPC: G06F3/01 ,  G06T11/60 ,  G09B9/00

CPC classification number: G06F3/011 ,  G06F3/016 ,  G06F3/0482 ,  G06T11/00 ,  G06T11/60 ,  G06T2200/24 ,  G09B9/00 ,  G09B19/00

Abstract: Techniques for employing augmented reality or virtual reality information are presented. An information management component (IMC) of an augmented reality device (ARD) can monitor and detect user activities and conditions in area in proximity to ARD. Based on user activities and conditions, IMC can determine augmented reality information that can enhance user experience, performance of user activities, or security and safety of user. IMC can present, via an interface component of ARD, the augmented reality information to the user. The augmented reality information can relate to user location; navigation by the user; tasks to be performed by the user; product assembly; maintenance work; system or product design or configuration; remote control of assembly, maintenance, design, or configuration; environmental and/or hazardous conditions; security, identification, and authentication of users; or training the user to perform tasks. IMC can translate information from a language to a different language of the user.

公开(公告)号：US09731421B2

公开(公告)日：2017-08-15

申请号：US15196782

申请日：2016-06-29

Applicant: ROCKWELL AUTOMATION TECHNOLOGIES, INC.

Inventor： Steven J. Scott ,  Thong T. Nguyen ,  David D. Brandt ,  Tony Gibart ,  Gary D. Dotson

IPC: G08B21/00 ,  B25J9/16 ,  G06K9/62 ,  G06K9/22 ,  G05B15/02

CPC classification number: B25J9/1697 ,  B25J9/1694 ,  G05B15/02 ,  G05B19/409 ,  G05B2219/2614 ,  G05B2219/2642 ,  G06K9/228 ,  G06K9/6293

Abstract: The present disclosure generally relates to a method for performing industrial automation control in an industrial automation system may include detecting, via a sensor system, positions and/or motions of one or more humans and/or one or more objects in an industrial automation system and distinguishing, via a programmed computer system, between one or more humans and one or more objects based upon the detected positions and/or motions. The method may then include implementing a control and/or notification action based upon the distinction.

公开(公告)号：US11829126B2

公开(公告)日：2023-11-28

申请号：US17482205

申请日：2021-09-22

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Thong T. Nguyen ,  Paul D. Schmirler ,  Timothy T. Duffy ,  Kristopher J. Holley ,  Susan J. Lovas

IPC: G05B19/418

CPC classification number: G05B19/41885 ,  G05B2219/32014 ,  G05B2219/32342

Abstract: A non-transitory computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive sensory datasets associated with an industrial automation system from sensors, receive positioning data via an extended reality device associated with a user, determine a first virtual positioning of the user in a virtual coordinate system based on the positioning data, determine a second virtual positioning of an industrial automation system in the virtual coordinate system based on the sensory datasets, determine output representative data to be presented by the extended reality device based on the plurality of sensory datasets and in accordance to the first virtual positioning relative to the second virtual positioning, and instruct the extended reality device to present the output representative data.

公开(公告)号：US20230092405A1

公开(公告)日：2023-03-23

申请号：US17482165

申请日：2021-09-22

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Thong T. Nguyen ,  Paul D. Schmirler ,  Timothy T. Duffy ,  Kristopher J. Holley ,  Susan J. Lovas

IPC: G05B19/418 ,  G06F16/23 ,  G06F3/0482 ,  G06T11/00 ,  G06F3/01

Abstract: A tangible, non-transitory, computer-readable medium includes instructions that, when executed by processing circuitry, are configured to cause the processing circuitry to receive user input indicative of a selection of a user experience of a plurality of user experiences. The plurality of user experiences include a first user experience associated with a first event that occurred in an industrial automation system at a first time prior to receiving the user input and a second user experience associated with a second event expected to occur in the industrial automation system at a second time after receiving the user input. When executed, the instructions also cause the processing circuitry to determine, based on the user input, output representative data associated with the industrial automation system and instruct an extended reality device to present the output representative data.

公开(公告)号：US11507195B2

公开(公告)日：2022-11-22

申请号：US17184254

申请日：2021-02-24

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Thong T. Nguyen ,  Paul D. Schmirler ,  Timothy T. Duffy

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/04815 ,  G06F3/04842 ,  G06T13/20 ,  G06F1/16 ,  G06F3/04845 ,  G06F3/0482

Abstract: A method may include receiving, via a processor, image data associated with a user's surrounding and generating, via the processor, a visualization that may include a virtual industrial automation device. The virtual industrial automation device may depict a virtual object within image data, and the virtual object may correspond to a physical industrial automation device. The method may include displaying, via the processor, the visualization via an electronic display and detecting, via the processor, a gesture in image data that may include the user's surrounding and the visualization. The gesture may be indicative of a request to move the virtual industrial automation device. The method may include tracking, via the processor, a user's movement, generating, via the processor, a visualization that may include an animation of the virtual industrial automation device moving based on the user's movement, and displaying, via the processor, the visualization via the electronic display.

公开(公告)号：US11500915B2

公开(公告)日：2022-11-15

申请号：US16560696

申请日：2019-09-04

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Thong T. Nguyen ,  Paul D. Schmirler ,  Timothy T. Duffy ,  Hannah M. Schermerhorn ,  Jingbo Liu

IPC: G06F16/41 ,  G06F16/438 ,  G06F16/432 ,  G09B19/00

Abstract: A non-transitory computer-readable medium includes computer-executable instructions that, when executed by at least one processor, may cause the at least one processor to retrieve a first training profile of a plurality of training profiles from a database, identify a plurality of index keywords in a respective training content of the first training profile, in which the respective training content includes audio data, video data, or both, and divide the first training profile into a plurality of sections based on the plurality of index keywords. Each of the plurality of sections is selectable for playback.

公开(公告)号：US20220253044A1

公开(公告)日：2022-08-11

申请号：US17168805

申请日：2021-02-05

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Natalie A. Tremblay ,  Kristopher J. Holley ,  Louisa A. Wood ,  Thong T. Nguyen ,  Paul D. Schmirler

IPC: G05B19/418

Abstract: A system may include audio devices that output sound waves. The system also includes a control system having a processor. The control system may receive a first plurality of operation parameters associated with a plurality of components in an industrial automation system from one or more sensors. The control system may also determine a plurality of audio tones based on the plurality of operation parameters. Further still, the control system may send one or more control signals to one or more audio devices in response to detecting the plurality of operation parameters, wherein the one or more audio devices are configured to produce the plurality of audio tones in response to receiving of the one or more control signals.

公开(公告)号：US20210263168A1

公开(公告)日：2021-08-26

申请号：US16796641

申请日：2020-02-20

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Thong T. Nguyen ,  Paul D. Schmirler ,  Alex L. Nicoll

IPC: G01S19/51 ,  G01S19/39 ,  G06F16/29 ,  G06F16/248

Abstract: A system includes a computing system configured to communicatively couple to a database configured to store a virtual coordinate system and a plurality of features associated with a representative environment associated with the virtual coordinate system. The computing system is configured to receive a first input indicative of a physical positioning of a user in a physical environment, determine a virtual positioning of the user in the virtual coordinate system based on the first input, receive a second input indicative of an updated physical positioning of the user in the physical environment, determine an updated virtual positioning of the user in the virtual coordinate system based on the second input, and output a first signal to a computing device in response to determining the updated virtual positioning of the user in the virtual coordinate system.

公开(公告)号：US10964104B2

公开(公告)日：2021-03-30

申请号：US16287828

申请日：2019-02-27

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Timothy T. Duffy ,  Paul D. Schmirler ,  Thong T. Nguyen

IPC: G06T17/10 ,  G06T7/80 ,  G06K9/00 ,  G06F30/23

Abstract: A system for monitoring an industrial system may have a computing device that generates a first three-dimensional (3D) visualization based on 3D video associated with an industrial system. The first 3D visualization may have one or more 3D device visualizations of industrial automation devices, and each 3D device visualization of the industrial automation devices that may depict a 3D object that corresponds to an industrial automation device in the industrial system. The computing device may display the first 3D visualization via an electronic display and detect a gesture in a first set of image data comprising the surrounding of the user and the first 3D visualization. The gesture is indicative of a modification associated with the first 3D visualization. The computing device may receive additional 3D video associated with the industrial system, generate a second 3D visualization based on the modification and the additional 3D video, and display the second 3D visualization via the electronic display.