公开(公告)号：US11586946B2

公开(公告)日：2023-02-21

申请号：US16560593

申请日：2019-09-04

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Paul D. Schmirler ,  Thong T. Nguyen ,  Hannah M. Schermerhorn ,  Timothy T. Duffy ,  Alex L. Nicoll ,  Jingbo Liu

IPC: G06N5/04 ,  G06F16/9035 ,  G06N20/00 ,  G06K9/62

Abstract: A non-transitory computer-readable medium includes computer-executable instructions that, when executed by at least one processor, are configured to cause the at least one processor to receive an inquiry from a training system, in which the inquiry includes a request for assistance to perform a first operation, retrieve a training profile for the first operation from a database based on the inquiry, and transmit the training profile to the training system, in which the training system is configured to present image data, audio data, or both regarding the first operation based on the training profile. The computer-executable instructions are also configured to cause the at least one processor to receive variant feedback from the training system, generate an updated training profile based on the variant feedback, store the updated training profile in the database.

公开(公告)号：US11586852B2

公开(公告)日：2023-02-21

申请号：US16560612

申请日：2019-09-04

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Thong T. Nguyen ,  Paul D. Schmirler ,  Timothy T. Duffy ,  Hannah M. Schermerhorn ,  Jingbo Liu

IPC: G06K9/62 ,  G06N5/022 ,  G06V30/32

Abstract: A system includes a training system configured to display first image data and a remote expert system configured to display second image data that corresponds to the first image data, receive feedback data associated with the second image data, and transmit a command to the training system based on the feedback data. The command is configured to modify the first image data presented via the training system.

公开(公告)号：US20210181856A1

公开(公告)日：2021-06-17

申请号：US17184254

申请日：2021-02-24

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Thong T. Nguyen ,  Paul D. Schmirler ,  Timothy T. Duffy

IPC: G06F3/01 ,  G06F3/0481 ,  G06F3/0484 ,  G06T13/20 ,  G06T19/00 ,  G06F1/16 ,  G06F3/0482

Abstract: A method may include receiving, via a processor, image data associated with a user's surrounding and generating, via the processor, a visualization that may include a virtual industrial automation device. The virtual industrial automation device may depict a virtual object within image data, and the virtual object may correspond to a physical industrial automation device. The method may include displaying, via the processor, the visualization via an electronic display and detecting, via the processor, a gesture in image data that may include the user's surrounding and the visualization. The gesture may be indicative of a request to move the virtual industrial automation device. The method may include tracking, via the processor, a user's movement, generating, via the processor, a visualization that may include an animation of the virtual industrial automation device moving based on the user's movement, and displaying, via the processor, the visualization via the electronic display.

公开(公告)号：US20200273243A1

公开(公告)日：2020-08-27

申请号：US16287828

申请日：2019-02-27

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Timothy T. Duffy ,  Paul D. Schmirler ,  Thong T. Nguyen

IPC: G06T17/10 ,  G06K9/00 ,  G06T7/80 ,  G06F17/50

Abstract: A system for monitoring an industrial system may have a computing device that generates a first three-dimensional (3D) visualization based on 3D video associated with an industrial system. The first 3D visualization may have one or more 3D device visualizations of industrial automation devices, and each 3D device visualization of the industrial automation devices that may depict a 3D object that corresponds to an industrial automation device in the industrial system. The computing device may display the first 3D visualization via an electronic display and detect a gesture in a first set of image data comprising the surrounding of the user and the first 3D visualization. The gesture is indicative of a modification associated with the first 3D visualization. The computing device may receive additional 3D video associated with the industrial system, generate a second 3D visualization based on the modification and the additional 3D video, and display the second 3D visualization via the electronic display.

公开(公告)号：US20200097077A1

公开(公告)日：2020-03-26

申请号：US16143087

申请日：2018-09-26

Applicant: Rockwell Automation Technologies, Inc.

Inventor： Thong T. Nguyen ,  Paul D. Schmirler ,  Timothy T. Duffy

IPC: G06F3/01 ,  G06F3/0484 ,  G06F3/0481 ,  G06T13/20 ,  G06T19/00

Abstract: A method may include receiving, via a processor, image data associated with a user's surrounding and generating, via the processor, a visualization that may include a virtual industrial automation device. The virtual industrial automation device may depict a virtual object within image data, and the virtual object may correspond to a physical industrial automation device. The method may include displaying, via the processor, the visualization via an electronic display and detecting, via the processor, a gesture in image data that may include the user's surrounding and the visualization. The gesture may be indicative of a request to move the virtual industrial automation device. The method may include tracking, via the processor, a user's movement, generating, via the processor, a visualization that may include an animation of the virtual industrial automation device moving based on the user's movement, and displaying, via the processor, the visualization via the electronic display.