Deployed d37ee87 to 0.6 with MkDocs 1.6.0 and mike 2.1.3

Author: gitlawr

0.6/cli-reference/chat/index.html

@@ -2445,7 +2445,8 @@
 
 <h1 id="gpustack-chat">gpustack chat</h1>
 <p>Chat with a large language model.</p>
-<pre class="highlight"><code class="language-bash">gpustack chat model [prompt]</code></pre>
+<div class="highlight"><pre><span></span><code>gpustack<span class="w"> </span>chat<span class="w"> </span>model<span class="w"> </span><span class="o">[</span>prompt<span class="o">]</span>
+</code></pre></div>
 <h2 id="positional-arguments">Positional Arguments</h2>
 <table>
 <thead>
@@ -2467,27 +2468,30 @@ <h2 id="positional-arguments">Positional Arguments</h2>
 </table>
 <h2 id="one-time-chat-with-a-prompt">One-time Chat with a Prompt</h2>
 <p>If a prompt is provided, it performs a one-time inference. For example:</p>
-<pre class="highlight"><code class="language-bash">gpustack chat llama3 "tell me a joke."</code></pre>
+<div class="highlight"><pre><span></span><code>gpustack<span class="w"> </span>chat<span class="w"> </span>llama3<span class="w"> </span><span class="s2">&quot;tell me a joke.&quot;</span>
+</code></pre></div>
 <p>Example output:</p>
-<pre class="highlight"><code>Why couldn't the bicycle stand up by itself?
+<div class="highlight"><pre><span></span><code>Why couldn&#39;t the bicycle stand up by itself?
 
-Because it was two-tired!</code></pre>
+Because it was two-tired!
+</code></pre></div>
 <h2 id="interactive-chat">Interactive Chat</h2>
 <p>If the <code>prompt</code> argument is not provided, you can chat with the large language model interactively. For example:</p>
-<pre class="highlight"><code class="language-bash">gpustack chat llama3</code></pre>
+<div class="highlight"><pre><span></span><code>gpustack<span class="w"> </span>chat<span class="w"> </span>llama3
+</code></pre></div>
 <p>Example output:</p>
-<pre class="highlight"><code>&gt;tell me a joke.
-Here's one:
+<div class="highlight"><pre><span></span><code>&gt;tell me a joke.
+Here&#39;s one:
 
-Why couldn't the bicycle stand up by itself?
+Why couldn&#39;t the bicycle stand up by itself?
 
 (wait for it...)
 
 Because it was two-tired!
 
 Hope that made you smile!
 &gt;Do you have a better one?
-Here's another one:
+Here&#39;s another one:
 
 Why did the scarecrow win an award?
 
@@ -2498,13 +2502,15 @@ <h2 id="interactive-chat">Interactive Chat</h2>
 Hope that one stuck with you!
 
 Do you want to hear another one?
-&gt;\quit</code></pre>
+&gt;\quit
+</code></pre></div>
 <h3 id="interactive-commands">Interactive Commands</h3>
 <p>Followings are available commands in interactive chat:</p>
-<pre class="highlight"><code>Commands:
+<div class="highlight"><pre><span></span><code>Commands:
   \q or \quit - Quit the chat
   \c or \clear - Clear chat context in prompt
-  \? or \h or \help - Print this help message</code></pre>
+  \? or \h or \help - Print this help message
+</code></pre></div>
 <h2 id="connect-to-external-gpustack-server">Connect to External GPUStack Server</h2>
 <p>If you are not running <code>gpustack chat</code> on the server node, or if you are serving on a custom host or port, you should provide the following environment variables:</p>
 <table>

0.6/cli-reference/download-tools/index.html

@@ -2359,7 +2359,8 @@
 
 <h1 id="gpustack-download-tools">gpustack download-tools</h1>
 <p>Download dependency tools, including llama-box, gguf-parser, and fastfetch.</p>
-<pre class="highlight"><code class="language-bash">gpustack download-tools [OPTIONS]</code></pre>
+<div class="highlight"><pre><span></span><code>gpustack<span class="w"> </span>download-tools<span class="w"> </span><span class="o">[</span>OPTIONS<span class="o">]</span>
+</code></pre></div>
 <h2 id="configurations">Configurations</h2>
 <table>
 <thead>

0.6/cli-reference/draw/index.html

@@ -2379,7 +2379,8 @@
 
 <h1 id="gpustack-draw">gpustack draw</h1>
 <p>Generate an image with a diffusion model.</p>
-<pre class="highlight"><code class="language-bash">gpustack draw [model] [prompt]</code></pre>
+<div class="highlight"><pre><span></span><code>gpustack<span class="w"> </span>draw<span class="w"> </span><span class="o">[</span>model<span class="o">]</span><span class="w"> </span><span class="o">[</span>prompt<span class="o">]</span>
+</code></pre></div>
 <h2 id="positional-arguments">Positional Arguments</h2>
 <table>
 <thead>

0.6/cli-reference/start/index.html

@@ -2463,7 +2463,8 @@
 
 <h1 id="gpustack-start">gpustack start</h1>
 <p>Run GPUStack server or worker.</p>
-<pre class="highlight"><code class="language-bash">gpustack start [OPTIONS]</code></pre>
+<div class="highlight"><pre><span></span><code>gpustack<span class="w"> </span>start<span class="w"> </span><span class="o">[</span>OPTIONS<span class="o">]</span>
+</code></pre></div>
 <h2 id="configurations">Configurations</h2>
 <h3 id="common-options">Common Options</h3>
 <table>
@@ -2735,54 +2736,55 @@ <h3 id="available-environment-variables">Available Environment Variables</h3>
 </table>
 <h2 id="config-file">Config File</h2>
 <p>You can configure start options using a YAML-format config file when starting GPUStack server or worker. Here is a complete example:</p>
-<pre class="highlight"><code class="language-yaml"># Common Options
-debug: false
-data_dir: /path/to/data_dir
-cache_dir: /path/to/cache_dir
-token: mytoken
-ollama_library_base_url: https://registry.mycompany.com
-enable_ray: false
-ray_args: ["--port=6379", "--verbose"]
-
-# Server Options
-host: 0.0.0.0
-port: 80
-disable_worker: false
-database_url: postgresql://user:password@hostname:port/db_name
-ssl_keyfile: /path/to/keyfile
-ssl_certfile: /path/to/certfile
-force_auth_localhost: false
-bootstrap_password: myadminpassword
-disable_update_check: false
-model_catalog_file: /path_or_url/to/model_catalog_file
-ray_port: 40096
-ray_client_server_port: 40097
-enable_cors: false
-allow_origins: ["*"]
-allow_credentials: false
-allow_methods: ["GET", "POST"]
-allow_headers: ["Authorization", "Content-Type"]
-
-# Worker Options
-server_url: http://your_gpustack_server_url
-worker_name: myworker
-worker_ip: 192.168.1.101
-disable_metrics: false
-disable_rpc_servers: false
-metrics_port: 10151
-worker_port: 10150
-service_port_range: 40000-40063
-rpc_server_port_range: 40064-40095
-ray_node_manager_port: 40098
-ray_object_manager_port: 40099
-ray_worker_port_range: 40100-40131
-log_dir: /path/to/log_dir
-rpc_server_args: ["--verbose"]
-system_reserved:
-  ram: 2
-  vram: 1
-tools_download_base_url: https://mirror.mycompany.com
-enable_hf_transfer: false</code></pre>
+<div class="highlight"><pre><span></span><code><span class="c1"># Common Options</span>
+<span class="nt">debug</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">false</span>
+<span class="nt">data_dir</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">/path/to/data_dir</span>
+<span class="nt">cache_dir</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">/path/to/cache_dir</span>
+<span class="nt">token</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">mytoken</span>
+<span class="nt">ollama_library_base_url</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">https://registry.mycompany.com</span>
+<span class="nt">enable_ray</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">false</span>
+<span class="nt">ray_args</span><span class="p">:</span><span class="w"> </span><span class="p p-Indicator">[</span><span class="s">&quot;--port=6379&quot;</span><span class="p p-Indicator">,</span><span class="w"> </span><span class="s">&quot;--verbose&quot;</span><span class="p p-Indicator">]</span>
+
+<span class="c1"># Server Options</span>
+<span class="nt">host</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">0.0.0.0</span>
+<span class="nt">port</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">80</span>
+<span class="nt">disable_worker</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">false</span>
+<span class="nt">database_url</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">postgresql://user:password@hostname:port/db_name</span>
+<span class="nt">ssl_keyfile</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">/path/to/keyfile</span>
+<span class="nt">ssl_certfile</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">/path/to/certfile</span>
+<span class="nt">force_auth_localhost</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">false</span>
+<span class="nt">bootstrap_password</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">myadminpassword</span>
+<span class="nt">disable_update_check</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">false</span>
+<span class="nt">model_catalog_file</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">/path_or_url/to/model_catalog_file</span>
+<span class="nt">ray_port</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">40096</span>
+<span class="nt">ray_client_server_port</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">40097</span>
+<span class="nt">enable_cors</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">false</span>
+<span class="nt">allow_origins</span><span class="p">:</span><span class="w"> </span><span class="p p-Indicator">[</span><span class="s">&quot;*&quot;</span><span class="p p-Indicator">]</span>
+<span class="nt">allow_credentials</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">false</span>
+<span class="nt">allow_methods</span><span class="p">:</span><span class="w"> </span><span class="p p-Indicator">[</span><span class="s">&quot;GET&quot;</span><span class="p p-Indicator">,</span><span class="w"> </span><span class="s">&quot;POST&quot;</span><span class="p p-Indicator">]</span>
+<span class="nt">allow_headers</span><span class="p">:</span><span class="w"> </span><span class="p p-Indicator">[</span><span class="s">&quot;Authorization&quot;</span><span class="p p-Indicator">,</span><span class="w"> </span><span class="s">&quot;Content-Type&quot;</span><span class="p p-Indicator">]</span>
+
+<span class="c1"># Worker Options</span>
+<span class="nt">server_url</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">http://your_gpustack_server_url</span>
+<span class="nt">worker_name</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">myworker</span>
+<span class="nt">worker_ip</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">192.168.1.101</span>
+<span class="nt">disable_metrics</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">false</span>
+<span class="nt">disable_rpc_servers</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">false</span>
+<span class="nt">metrics_port</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">10151</span>
+<span class="nt">worker_port</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">10150</span>
+<span class="nt">service_port_range</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">40000-40063</span>
+<span class="nt">rpc_server_port_range</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">40064-40095</span>
+<span class="nt">ray_node_manager_port</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">40098</span>
+<span class="nt">ray_object_manager_port</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">40099</span>
+<span class="nt">ray_worker_port_range</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">40100-40131</span>
+<span class="nt">log_dir</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">/path/to/log_dir</span>
+<span class="nt">rpc_server_args</span><span class="p">:</span><span class="w"> </span><span class="p p-Indicator">[</span><span class="s">&quot;--verbose&quot;</span><span class="p p-Indicator">]</span>
+<span class="nt">system_reserved</span><span class="p">:</span>
+<span class="w">  </span><span class="nt">ram</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">2</span>
+<span class="w">  </span><span class="nt">vram</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">1</span>
+<span class="nt">tools_download_base_url</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">https://mirror.mycompany.com</span>
+<span class="nt">enable_hf_transfer</span><span class="p">:</span><span class="w"> </span><span class="l l-Scalar l-Scalar-Plain">false</span>
+</code></pre></div>
 
 
 

0.6/development/index.html

@@ -2349,18 +2349,24 @@ <h1 id="development-guide">Development Guide</h1>
 <h2 id="prerequisites">Prerequisites</h2>
 <p>Install Python (version 3.10 to 3.12).</p>
 <h2 id="set-up-environment">Set Up Environment</h2>
-<pre class="highlight"><code class="language-bash">make install</code></pre>
+<div class="highlight"><pre><span></span><code>make<span class="w"> </span>install
+</code></pre></div>
 <h2 id="run">Run</h2>
-<pre class="highlight"><code class="language-bash">poetry run gpustack</code></pre>
+<div class="highlight"><pre><span></span><code>poetry<span class="w"> </span>run<span class="w"> </span>gpustack
+</code></pre></div>
 <h2 id="build">Build</h2>
-<pre class="highlight"><code class="language-bash">make build</code></pre>
+<div class="highlight"><pre><span></span><code>make<span class="w"> </span>build
+</code></pre></div>
 <p>And check artifacts in <code>dist</code>.</p>
 <h2 id="test">Test</h2>
-<pre class="highlight"><code class="language-bash">make test</code></pre>
+<div class="highlight"><pre><span></span><code>make<span class="w"> </span><span class="nb">test</span>
+</code></pre></div>
 <h2 id="update-dependencies">Update Dependencies</h2>
-<pre class="highlight"><code class="language-bash">poetry add &lt;something&gt;</code></pre>
+<div class="highlight"><pre><span></span><code>poetry<span class="w"> </span>add<span class="w"> </span>&lt;something&gt;
+</code></pre></div>
 <p>Or</p>
-<pre class="highlight"><code class="language-bash">poetry add --group dev &lt;something&gt;</code></pre>
+<div class="highlight"><pre><span></span><code>poetry<span class="w"> </span>add<span class="w"> </span>--group<span class="w"> </span>dev<span class="w"> </span>&lt;something&gt;
+</code></pre></div>
 <p>For dev/testing dependencies.</p>