公开(公告)号：US20220335242A1

公开(公告)日：2022-10-20

申请号：US17528157

申请日：2021-11-16

Applicant: Apple Inc.

Inventor： Lukas A. BOSSARD ,  Matthias DANTONE ,  Pulah J. SHAH ,  Wentao WU ,  Yang ZHAO

IPC: G06K9/00 ,  G06T11/00 ,  G06K9/32 ,  H04N5/232 ,  G06K9/62 ,  G06Q30/06 ,  G06N20/00

Abstract: The subject technology provides visual search systems and methods that can be used to efficiently perform visual searches on an electronic device. The subject technology provides systems and methods for presenting one or more visual indicators corresponding to the searchable portions of digital content. A visual search may include identifying, at an electronic device, an element of interest in an image. A visual indicator for the element of interest may be overlaid on the image at a location corresponding to the element of interest. The visual indicator may be selectable to cause a display of information associated with the element of interest responsive to the selection.

公开(公告)号：US20240096319A1

公开(公告)日：2024-03-21

申请号：US18227884

申请日：2023-07-28

Applicant: Apple Inc.

Inventor： Kenneth M. KARAKOTSIOS ,  James BYUN ,  Pulah J. SHAH

IPC: G10L15/22 ,  G06F3/01 ,  G06F16/332 ,  G06V20/62

CPC classification number: G10L15/22 ,  G06F3/013 ,  G06F3/017 ,  G06F16/3329 ,  G06V20/62 ,  G10L2015/223

Abstract: Aspects of the subject technology provide improved techniques for human-computer interactions including disambiguation of a human user's linguistic command. The improved techniques may include integrating linguistic input from a user with additional input from sensors relating to the user and the user's environment. In an aspect, imagery of a user's environment may be first analyzed to identify objects in the environment. Input regarding the user, such as a user's gaze location, may trigger a second analysis of a subset of the identified objects in the environment. The results of these analyses may then be used to resolve an ambiguity in linguistic user input from the user.

公开(公告)号：US20230350941A1

公开(公告)日：2023-11-02

申请号：US17973500

申请日：2022-10-25

Applicant: Apple Inc.

Inventor： Ryan S. DIXON ,  Pulah J. SHAH ,  Yang ZHAO

IPC: G06F16/583 ,  G06F16/538

CPC classification number: G06F16/5846 ,  G06F16/538

Abstract: The subject technology provides for contextual text lookup for images. When a request is received by an electronic device to perform a lookup or search for text in an image that is displayed at the electronic device, the electronic device may obtain one or more search results, based on the text itself and based on contextual information derived, by the electronic device, from the image. In one or more implementations, application information associated with an application that displays the image may also be used as contextual metadata for enhancing the results of the search for the text from the image.

公开(公告)号：US20240256100A1

公开(公告)日：2024-08-01

申请号：US18611216

申请日：2024-03-20

Applicant: Apple Inc.

Inventor： Grant R. PAUL ,  Steven D. BAKER ,  Brandon J. COREY ,  Neil G. CRANE ,  Matthias DANTONE ,  Nathan DE VRIES ,  Craig M. FEDERIGHI ,  James N. JONES ,  Xishuo LIU ,  Johnnie B. MANZARI ,  Sebastien V. MARINEAU-MES ,  Pulah J. SHAH ,  Andre SOUZA DOS SANTOS ,  Srinivasan VENKATACHARY ,  Yang ZHAO

IPC: G06F3/0481 ,  G06F3/04847 ,  G06F40/58 ,  G06V30/19

CPC classification number: G06F3/0481 ,  G06F3/04847 ,  G06V30/19 ,  G06F40/58

Abstract: The present disclosure generally relates to methods and user interfaces for managing visual content at a computer system. In some embodiments, methods and user interfaces for managing visual content in media are described. In some embodiments, methods and user interfaces for managing visual indicators for visual content in media are described. In some embodiments, methods and user interfaces for inserting visual content in media are described. In some embodiments, methods and user interfaces for identifying visual content in media are described. In some embodiments, methods and user interfaces for translating visual content in media are described. In some embodiments, methods and user interfaces for translating visual content in media are described. In some embodiments, methods and user interfaces for managing user interface objects for visual content in media are described.

公开(公告)号：US20240242499A1

公开(公告)日：2024-07-18

申请号：US18618931

申请日：2024-03-27

Applicant: Apple Inc.

Inventor： Lukas A. BOSSARD ,  Matthias DANTONE ,  Pulah J. SHAH ,  Wentao WU ,  Yang ZHAO

IPC: G06V20/20 ,  G06F18/40 ,  G06N20/00 ,  G06Q30/0601 ,  G06T11/00 ,  G06V10/25 ,  H04N23/617 ,  H04N23/63 ,  H04N23/80

CPC classification number: G06V20/20 ,  G06F18/40 ,  G06N20/00 ,  G06Q30/0625 ,  G06T11/00 ,  G06V10/25 ,  H04N23/617 ,  H04N23/635 ,  H04N23/80

Abstract: The subject technology provides visual search systems and methods that can be used to efficiently perform visual searches on an electronic device. The subject technology provides systems and methods for presenting one or more visual indicators corresponding to the searchable portions of digital content. A visual search may include identifying, at an electronic device, an element of interest in an image. A visual indicator for the element of interest may be overlaid on the image at a location corresponding to the element of interest. The visual indicator may be selectable to cause a display of information associated with the element of interest responsive to the selection.