公开(公告)号：US20180267619A1

公开(公告)日：2018-09-20

申请号：US15760275

申请日：2017-02-08

Applicant: NEC Corporation

Inventor： Shin NORIEDA ,  Makoto YOSHIMOTO ,  Yoshinori SAIDA ,  Hiroki KOSUGE

IPC: G06F3/01 ,  G06T7/20 ,  G06K9/00

CPC classification number: G06F3/017 ,  G06F3/01 ,  G06F3/0346 ,  G06F3/0425 ,  G06K9/00355 ,  G06T7/20 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2207/30204

Abstract: A marker (3020) is any part of a user's body or is any mark attached to the user. A sensor (3040) is attached to the user. An operation region calculation unit (2020) calculates an operation region included in a captured image on the basis of a position of the marker (3020) included in the captured image generated by a camera. A recognition unit (2040) calculates a position or motion of an operation body captured in the operation region, and recognizes an input operation on the basis of the calculated position or motion of the operation body. Note that the recognition unit (2040) calculates a position of the operation body captured in the operation region at a timing based on a result of detection by the sensor (3040). The recognition unit (2040) calculates motion of the operation body captured in the operation region in a period including a timing based on a result of detection by the sensor (3040).

公开(公告)号：US20180260033A1

公开(公告)日：2018-09-13

申请号：US15759997

申请日：2016-09-20

Applicant: NEC Corporation

Inventor： Shin NORIEDA ,  Makoto YOSHIMOTO ,  Yoshinori SAIDA

IPC: G06F3/01 ,  G06T7/246 ,  G06K9/00

CPC classification number: G06F3/011 ,  G06F3/01 ,  G06F3/017 ,  G06F3/0481 ,  G06K9/00355 ,  G06T7/20 ,  G06T7/248 ,  G06T2207/30196 ,  G06T2207/30204

Abstract: An input apparatus (2000) includes a motion detection unit (2020) and an input recognition unit (2040). The motion detection unit (2020) detects motion of an object by using a captured image including the object. Here, the detected motion of the object is motion of the object in a period defined based on a result of detection by a sensor attached to the body of a user of the input apparatus (2000). The input recognition unit (2040) recognizes input to an information processing apparatus based on the detected motion of the object.

公开(公告)号：US20180253149A1

公开(公告)日：2018-09-06

申请号：US15759941

申请日：2016-09-20

Applicant: NEC Corporation

Inventor： Shin NORIEDA ,  Makoto YOSHIMOTO ,  Yoshinori SAIDA ,  Hiroki KOSUGE

IPC: G06F3/01 ,  G06K9/00 ,  G06T7/73 ,  G06T7/20

CPC classification number: G06F3/017 ,  G06F3/011 ,  G06F3/03547 ,  G06F3/042 ,  G06F3/0482 ,  G06F3/04842 ,  G06F3/04847 ,  G06F3/04883 ,  G06F3/04886 ,  G06K9/00375 ,  G06K9/3216 ,  G06T7/20 ,  G06T7/73 ,  G06T2207/10004 ,  G06T2207/30204

Abstract: An information processing system (3000) includes a marker (3020). The marker (3020) is any part of the body of a user of the information processing system (3000), or is any object attached to the user of the information processing system (3000). An information processing apparatus (2000) includes an operation region extraction unit (2020) and a recognition unit (2040). The operation region extraction unit (2020) extracts an operation region from a captured image on the basis of a position of the marker (3020). The recognition unit (2040) calculates a position or motion of an operation body in the operation region on a captured image. The recognition unit (2040) recognizes an input operation on the basis of the calculated position or motion of the operation body.

公开(公告)号：US20180150186A1

公开(公告)日：2018-05-31

申请号：US15575186

申请日：2016-04-18

Applicant: NEC CORPORATION

Inventor： Shin NORIEDA ,  Makoto YOSHIMOTO ,  Yoshinori SAIDA

IPC: G06F3/042 ,  G06K9/00 ,  G02B27/01

Abstract: An interface control system (2000) includes a first marker detection unit (2020) and a display control unit (2040). The first marker detection unit (2020) detects a first marker (50) attached to the body of a user based on a captured image obtained from a camera (20) worn by the user. The display control unit (2040) displays an operation image on a display screen (32) of a head mounted display 30 mounted on the user based on the first marker detected by the first marker detection unit (2020). The display control unit (2040) displays the operation image so that the operation image is viewed to be superimposed on the arm portion of the user when viewed with the eyes of the user.

公开(公告)号：US20170255838A1

公开(公告)日：2017-09-07

申请号：US15276953

申请日：2016-09-27

Applicant: NEC Corporation

Inventor： Shin NORIEDA ,  Makoto YOSHIMOTO ,  Yoshinori SAIDA ,  Hiroki KOSUGE

IPC: G06K9/46 ,  G06T7/00

CPC classification number: G06K9/4671 ,  G06K9/00671 ,  G06K2209/17 ,  G06T2207/10004

Abstract: According to an embodiment, an information processing system includes a display device and an information processing apparatus. The information processing apparatus includes a product recognition unit, a display control unit, and an operation recognition unit. The product recognition unit recognizes product. The display control unit acquires product information regarding the product recognized by the product recognition unit. Further, the display control unit displays an operation screen including the acquired product information on a display device. The operation recognition unit recognizes an input operation with respect to the operation screen on the basis of the position or movement of an operation body in a captured image.

公开(公告)号：US20190156118A1

公开(公告)日：2019-05-23

申请号：US15759560

申请日：2016-09-07

Applicant: NEC Corporation

Inventor： Yoshinori SAIDA ,  Shin NORIEDA ,  Makoto YOSHIMOTO ,  Kota IWAMOTO ,  Takami SATO ,  Ruihan BAO

IPC: G06K9/00 ,  G06F3/14 ,  G02B27/01

Abstract: An image acquisition unit (2020) acquires a captured image containing an inspection target instrument. An inspection information acquisition unit (2040) acquires inspection information regarding the instrument contained in the captured image. The inspection information is information indicating an inspection item of the instrument. A first display control unit (2060) displays an indication representing an inspection spot corresponding to the inspection item indicated by the inspection information on the display device (10). For example, the first display control unit (2060) displays the indication representing the inspection spot so that the indication is superimposed on the inspection spot on a display device (10). For example, the first display control unit (2060) displays the indication in the inspection spot on the display device (10) or near the instrument.

公开(公告)号：US20180260032A1

公开(公告)日：2018-09-13

申请号：US15759323

申请日：2016-09-20

Applicant: NEC Corporation

Inventor： Shin NORIEDA ,  Makoto YOSHIMOTO ,  Yoshinori SAIDA

IPC: G06F3/01 ,  G06F3/0488 ,  G06T7/70 ,  G06T7/20 ,  G06T7/11 ,  G02B27/01 ,  G06F3/0482

CPC classification number: G06F3/017 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/0178 ,  G06F3/01 ,  G06F3/0482 ,  G06F3/0484 ,  G06F3/04886 ,  G06T7/11 ,  G06T7/20 ,  G06T7/60 ,  G06T7/70 ,  G06T2207/30204

Abstract: An input apparatus (2000) includes a position calculation unit (2020) and an input recognition unit (2040). The position calculation unit (2020) calculates a position of a marker included in a captured image. The marker is attached to the body of a user or is a part of the body of the user. The captured image is generated by a camera at a timing based on a result of detection by a sensor attached to the body of the user. The input recognition unit (2040) recognizes input specifying a location separated from the marker on the captured image on the basis of the calculated position of the marker. The location specified by the input is a location separated from the marker.