Skip to content

Commit 8277c88

Browse files
Update GPULlama3 docs with detailed TornadoVM installation steps
1 parent 12adb9d commit 8277c88

File tree

1 file changed

+27
-8
lines changed

1 file changed

+27
-8
lines changed

docs/modules/ROOT/pages/gpullama3-chat-model.adoc

Lines changed: 27 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -12,23 +12,42 @@ This extension allows Quarkus applications to use locally hosted Llama3 and othe
1212
1313
=== Java Version and TornadoVM
1414
15-
GPULlama3.java requires *Java 21 or later* due to its use of the https://openjdk.org/jeps/448[Java Vector API] and TornadoVM integration.
15+
GPULlama3.java requires TornadoVM and *Java 21 or later* due to its use of the https://openjdk.org/jeps/448[Java Vector API].
1616
17-
Install TornadoVM locally as follows:
17+
Download and Install TornadoVM locally as follows:
18+
19+
*Linux (x86_64)*
20+
21+
[source,shell]
22+
----
23+
wget https://github.com/beehive-lab/TornadoVM/releases/download/v2.1.0/tornadovm-2.1.0-opencl-linux-amd64.zip
24+
unzip tornadovm-2.1.0-opencl-linux-amd64.zip
25+
# Replace <path-to-sdk> manually with the absolute path of the extracted folder
26+
export TORNADO_SDK="<path-to-sdk>/tornadovm-2.1.0-opencl"
27+
export PATH=$TORNADO_SDK/bin:$PATH
28+
29+
tornado --devices
30+
tornado --version
31+
----
32+
33+
*macOS (Apple Silicon)*
1834
1935
[source,shell]
2036
----
21-
cd ~
22-
git clone [email protected]:beehive-lab/TornadoVM.git
23-
cd ~/TornadoVM
24-
./bin/tornadovm-installer --jdk jdk21 --backend opencl
25-
source setvars.sh
37+
wget https://github.com/beehive-lab/TornadoVM/releases/download/v2.1.0/tornadovm-2.1.0-opencl-mac-aarch64.zip
38+
unzip tornadovm-2.1.0-opencl-mac-aarch64.zip
39+
# Replace <path-to-sdk> manually with the absolute path of the extracted folder
40+
export TORNADO_SDK="<path-to-sdk>/tornadovm-2.1.0-opencl"
41+
export PATH=$TORNADO_SDK/bin:$PATH
42+
43+
tornado --devices
44+
tornado --version
2645
----
2746
2847
The above steps:
2948
3049
- Set the `TORNADOVM_SDK` environment variable to the TornadoVM SDK path.
31-
- Create a `tornado-argfile` under `~/TornadoVM` containing the JVM arguments required to enable TornadoVM.
50+
- `TORNADO_SDK` contains the `tornado-argfile` with all the JVM arguments required to enable TornadoVM.
3251
- ⚠️ The `tornado-argfile` should be used for *building* and *running* the Quarkus application (see section Building & Running the Quarkus Application).
3352
3453
== Using GPULlama3.java

0 commit comments

Comments
 (0)