Invention Grant
- Patent Title: Integrating binary inference engines and model data for efficiency of inference tasks
-
Application No.: US16215540Application Date: 2018-12-10
-
Publication No.: US11657124B2Publication Date: 2023-05-23
- Inventor: Peter Zatloukal , Matthew Weaver , Alexander Kirchhoff , Dmitry Belenko , Ali Farhadi , Mohammad Rastegari , Andrew Luke Chronister , Keith Patrick Wyss , Chenfan Sun
- Applicant: Apple Inc.
- Applicant Address: US CA Cupertino
- Assignee: Apple Inc.
- Current Assignee: Apple Inc.
- Current Assignee Address: US CA Cupertino
- Agency: Bakerhostetler
- Main IPC: G06F21/10
- IPC: G06F21/10 ; G06N3/08 ; G06N3/10 ; H04L9/30 ; H04L9/08 ; G06F21/12

Abstract:
In one embodiment, a method includes receiving a user request from a client device associated with a user, accessing an instructional file comprising one or more binary inference engines and one or more encrypted model data corresponding to the one or more binary inference engines, respectively, selecting a binary inference engine from the one or more binary inference engines in the accessed instructional file based on the user request, sending a validation request for a permission to execute the binary inference engine to a licensing server, receiving the permission from the licensing server, decrypting the encrypted model data corresponding to the binary inference engine by a decryption key, executing the binary inference engine based on the user request and the decrypted model data, and sending one or more execution results responsive to the execution of the binary inference engine to the client device.
Public/Granted literature
- US20200184037A1 Integrating Binary Inference Engines and Model Data for Efficiency of Inference Tasks Public/Granted day:2020-06-11
Information query