-
公开(公告)号:US20220286604A1
公开(公告)日:2022-09-08
申请号:US17195520
申请日:2021-03-08
Applicant: Apple Inc.
Inventor: David R. Pope , Liran Fishel , Assaf Metuki , Muge Wang
Abstract: Embodiments relate to extracting features from images, such as by identifying keypoints and generating keypoint descriptors of the keypoints. An apparatus includes a pyramid image generator circuit, a keypoint descriptor generator circuit, and a pyramid image buffer. The pyramid image generator circuit generates an image pyramid from an input image. The keypoint descriptor generator circuit processes the pyramid images for keypoint descriptor generation. The pyramid image buffer stores different portions of the pyramid images generated by the pyramid image generator circuit at different times and provides the stored portions of the pyramid images to the keypoint descriptor generator circuit for keypoint descriptor generation. When first portions of the pyramid images are no longer needed for the keypoint descriptor generation, the first portions are removed from the pyramid image buffer to provide space for second portions of the pyramid images that are needed for the keypoint descriptor generation.
-
公开(公告)号:US20250094565A1
公开(公告)日:2025-03-20
申请号:US18790895
申请日:2024-07-31
Applicant: Apple Inc.
Inventor: Peter A. Lisherness , Assaf Menachem , Assaf Metuki , Benjamin Biron , D J Capelis , Husam Khashiboun , Jacques Fortier
Abstract: Techniques are disclosed relating to securing hardware accelerators used by a computing device. In some embodiments, a computing device includes user interface and user interface pipeline circuitry coupled to the user interface. The user interface pipeline circuitry is configured to process a set of data received from a first source to produce an output for the user interface of the computing device, receive, from a second source, an indication that a component of the computing device has been activated, and, prior to presenting the output via the user interface, insert, into the output, an indicator of the component being activated.
-
3.
公开(公告)号:US20230298302A1
公开(公告)日:2023-09-21
申请号:US17695038
申请日:2022-03-15
Applicant: Apple Inc.
Inventor: Assaf Metuki , Danny Gal , Liran Fishel
CPC classification number: G06V10/46 , G06V10/751 , G06V10/761
Abstract: Embodiments of the present disclosure relate to sequentially loading keypoint descriptors of a previous image and comparing them with a plurality of keypoint descriptors of a current image. The keypoint descriptors of the previous image are stored and accessed from a system memory while the keypoint descriptors of the current image are stored and accessed from a local memory. Hence, the keypoint descriptors of the previous image are received only once at a descriptor match circuit while the keypoint descriptors of the current image are received multiple times for comparison against different keypoint descriptors of the previous image.
-
公开(公告)号:US20250094564A1
公开(公告)日:2025-03-20
申请号:US18790765
申请日:2024-07-31
Applicant: Apple Inc.
Inventor: Peter A. Lisherness , Assaf Menachem , Assaf Metuki , Benjamin Biron , D J Capelis , Husam Khashiboun , Jacques Fortier
Abstract: Techniques are disclosed relating to securing hardware accelerators used by a computing device. In some embodiments, a computing device includes a sensor and sensor processor circuitry coupled to the sensor. The sensor processor circuitry is configured to process sensor data received from a sensor of the computing device. In response to a first indication that a first consumer is trustworthy, the sensor processor circuitry is configured to provide a first data set of the processed sensor data to the first consumer. In response to a second indication that a second consumer is untrustworthy, the sensor processor circuitry is configured to negotiate one or more conditions in which the second consumer is permitted to receive a second data set of the processed sensor data.
-
公开(公告)号:US12169959B2
公开(公告)日:2024-12-17
申请号:US17693007
申请日:2022-03-11
Applicant: Apple Inc.
Inventor: Assaf Metuki , Lukas Polok , Danny Gal , Liran Fishel
Abstract: Embodiments of the present disclosure relate to selecting a subset of keypoint descriptors of two images for match operation based on their orientation angles indicated in headers of the keypoint descriptors. The keypoint descriptors in the two images are matched by first comparing their headers and then performing vector distance determination. During the header comparison operation, a header of a descriptor of a first image is compared only with headers of keypoint descriptors of a second image in a discrete orientation angle range corresponding to an orientation angle indicated by the header of the first image descriptor or keypoint descriptors of the second image in adjacent discrete orientation angle ranges. After the headers of the keypoint descriptors satisfying one or more matching criteria are determined, distance determination operations are performed between the keypoint descriptors while the remaining keypoint descriptors are discarded without determining their distances.
-
公开(公告)号:US11494880B2
公开(公告)日:2022-11-08
申请号:US17206772
申请日:2021-03-19
Applicant: Apple Inc.
Inventor: David R. Pope , Assaf Metuki , Muge Wang
Abstract: Embodiments relate to generating an image pyramid for feature extraction. A pyramid image generator circuit includes a first image buffer that stores image data at a first octave, a first blur filter circuit, a first spatial filter circuit, and a first decimator circuit. The first blur filter circuit generates a first pyramid image for a first scale of the first octave by applying a first amount of smoothing to the first image data stored in the first image buffer. The first spatial filter circuit and the first decimator generate second image data of a second octave that is higher than the first octave by applying a smoothing and a decimation to the first image data stored in the first image buffer. The first spatial filter circuit begins processing the first image data before the first blur filter circuit begins to process the first image data.
-
公开(公告)号:US20220301110A1
公开(公告)日:2022-09-22
申请号:US17206772
申请日:2021-03-19
Applicant: Apple Inc.
Inventor: David R. Pope , Assaf Metuki , Muge Wang
Abstract: Embodiments relate to generating an image pyramid for feature extraction. A pyramid image generator circuit includes a first image buffer that stores image data at a first octave, a first blur filter circuit, a first spatial filter circuit, and a first decimator circuit. The first blur filter circuit generates a first pyramid image for a first scale of the first octave by applying a first amount of smoothing to the first image data stored in the first image buffer. The first spatial filter circuit and the first decimator generate second image data of a second octave that is higher than the first octave by applying a smoothing and a decimation to the first image data stored in the first image buffer. The first spatial filter circuit begins processing the first image data before the first blur filter circuit begins to process the first image data.
-
公开(公告)号:US20220300749A1
公开(公告)日:2022-09-22
申请号:US17206901
申请日:2021-03-19
Applicant: Apple Inc.
Inventor: Liran Fishel , Assaf Metuki , Chuhan Min , Wai Yu Trevor Tsang
Abstract: Embodiments relate to generating keypoint descriptors of the keypoints. An apparatus includes a pyramid image generator circuit and a keypoint descriptor generator circuit. The pyramid image generator circuit generates an image pyramid from an input image. The keypoint descriptor generator circuit determines intensity values of sample points in the pyramid images for a keypoint and determines comparison results of comparisons between the intensity values of pairs of the sample points. The keypoint descriptor generator circuit generate bit values defining the comparison results for the keypoint, each bit value corresponding with one of the comparison results, and generate a sequence of the bit values defining an ordering of the comparison results based on importance levels of the comparisons, where the importance level of each comparison defines how much the comparison is representative of features. Bit values for comparisons having the lowest importance levels may be excluded from the sequence.
-
公开(公告)号:US20250094563A1
公开(公告)日:2025-03-20
申请号:US18790529
申请日:2024-07-31
Applicant: Apple Inc.
Inventor: Peter A. Lisherness , Assaf Menachem , Assaf Metuki , Benjamin Biron , D J Capelis , Husam Khashiboun , Jacques Fortier , Kenneth W. Waters
Abstract: Techniques are disclosed relating to securing hardware accelerators used by a computing device. In some embodiments, a computing device includes one or more processors configured to co-execute trusted processes and untrusted processes in an isolated manner that includes implementing a secure environment in which a set of security criteria is enforced for data of the trusted processes. The computing device further includes multiple heterogenous hardware accelerators configured to implement exclaves of the secure environment that extend enforcement of one or more of the set of security criteria within the hardware accelerators for data distributed to the hardware accelerators for performance of tasks associated with the trusted processes.
-
公开(公告)号:US11968471B2
公开(公告)日:2024-04-23
申请号:US17195520
申请日:2021-03-08
Applicant: Apple Inc.
Inventor: David R. Pope , Liran Fishel , Assaf Metuki , Muge Wang
CPC classification number: H04N5/76 , G06T1/60 , G06T7/251 , H04N1/2141 , G06T2207/20016
Abstract: Embodiments relate to extracting features from images, such as by identifying keypoints and generating keypoint descriptors of the keypoints. An apparatus includes a pyramid image generator circuit, a keypoint descriptor generator circuit, and a pyramid image buffer. The pyramid image generator circuit generates an image pyramid from an input image. The keypoint descriptor generator circuit processes the pyramid images for keypoint descriptor generation. The pyramid image buffer stores different portions of the pyramid images generated by the pyramid image generator circuit at different times and provides the stored portions of the pyramid images to the keypoint descriptor generator circuit for keypoint descriptor generation. When first portions of the pyramid images are no longer needed for the keypoint descriptor generation, the first portions are removed from the pyramid image buffer to provide space for second portions of the pyramid images that are needed for the keypoint descriptor generation.
-
-
-
-
-
-
-
-
-