You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+13-11Lines changed: 13 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,19 +1,21 @@
1
-
# AI AppBuilder
1
+
# QAI AppBuilder (Quick AI Application Building)
2
2
3
3
## Introduction
4
+
5
+
#### QAI AppBuilder
6
+
Quick AI Application Building(this repository) is also referred to as *QAI AppBuilder* in the source and documentation. QAI AppBuilder is extension for Qualcomm® AI Runtime SDK. We need some libraries in Qualcomm® AI Runtime SDK for using QAI AppBuilder. <br>
7
+
QAI AppBuilder is designed for developer to using Qualcomm® AI Runtime SDK to execute model on Windows on Snapdragon(WoS) and Linux platforms easily. We encapsulated Qualcomm® AI Runtime SDK APIs to several simple APIs for loading the models to CPU or HTP and executing inference.
8
+
4
9
#### Qualcomm® AI Runtime SDK
10
+
5
11
Qualcomm® AI Runtime SDK is designed to provide unified, low-level APIs for AI development. It can be downloaded from Qualcomm software center:<br>
AI Engine Direct Helper(this repository) is also referred to as *AI AppBuilder* in the source and documentation. AI AppBuilder is extension for Qualcomm® AI Runtime SDK. We need some libraries in Qualcomm® AI Runtime SDK for using AI AppBuilder. <br>
12
-
AI AppBuilder is designed for developer to using Qualcomm® AI Runtime SDK to execute model on Windows on Snapdragon(WoS) platforms easily. We encapsulated Qualcomm® AI Runtime SDK APIs to several simple APIs for loading the models to CPU or HTP and executing inference.
13
-
14
16
## Advantage
15
17
16
-
Developers can use AI AppBuilder in both C++ and Python projects <br>
18
+
Developers can use QAI AppBuilder in both C++ and Python projects <br>
17
19
18
20
• Support both C++ & Python <br>
19
21
• Support both Windows & Linux. <br>
@@ -30,14 +32,14 @@ Using the Python extensions with ARM64 Python will make it easier for developers
30
32
**Support ARM64 Windows, Linux and Ubuntu (e.g.: X Elite Windows, QCS8550 Linux and QCM6490 Ubuntu)*
31
33
32
34
## Components
33
-
There're two ways to use AI AppBuilder:
34
-
### 1. Using the AI AppBuilder C++ libraries to develop C++ based AI application.
35
+
There're two ways to use QAI AppBuilder:
36
+
### 1. Using the QAI AppBuilder C++ libraries to develop C++ based AI application.
35
37
Download prebuild binary package *QAI_AppBuilder-win_arm64-{Qualcomm® AI Runtime SDK version}-Release.zip* to get these files: https://github.com/quic/ai-engine-direct-helper/releases
36
38
37
39
**libappbuilder.dll {libappbuilder.lib, LibAppBuilder.hpp}** –– C++ projects can use this lib to run models in HTP.
38
40
**QAIAppSvc.exe** –– Due to HTP limitations, we can only load models smaller than 4GB in one process. This app is used to help us load the models in new processes(Multiple processes can be created) and inference to avoid HTP restrictions. [*Depress: the above limitation has been fixed.*]
39
41
40
-
### 2. Using the AI AppBuilder Python binding extension to develop Python based AI application.
42
+
### 2. Using the QAI AppBuilder Python binding extension to develop Python based AI application.
41
43
Download Python extension *qai_appbuilder-{version}-cp312-cp312-win_arm64.whl* and install it with the command below:
0 commit comments