Skip to content

Commit 0b82af1

Browse files
fedinskiyfedinskiy
committed
Add Guardrails functionality and tests to the 'tool-guardrails' sample
- Add the functionality - Rename `tool-guardrails` to `guardrails` - Change the README - Add an ability to run with the platform BOMs
1 parent 2a94f69 commit 0b82af1

File tree

18 files changed

+218
-40
lines changed

18 files changed

+218
-40
lines changed

‎samples/chatbot/src/test/java/io/quarkiverse/langchain4j/tests/rag/RAGTest.java‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -119,7 +119,8 @@ public void documentBasedAnswer() throws InterruptedException, URISyntaxExceptio
119119
boolean second = line.contains("""
120120
gen_ai_token_type="output"
121121
""".trim());
122-
return first && second;
122+
boolean third = line.contains("Bot");
123+
return first && second && third;
123124
})
124125
.orElseThrow(() -> new AssertionError("There is no metric for output tokens!"));
125126
assertTrue(outputTokensMetric.contains("ai_service_class_name=\"io.quarkiverse.langchain4j.sample.chatbot.Bot\""));

samples/tool-guardrails/README.md renamed to samples/guardrails/README.md

Lines changed: 22 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,14 @@
11
# Tool Guardrails Demo
22

3-
This demo showcases the implementation of **guardrails for tool/function calling** in Quarkus LangChain4j.
3+
This demo showcases the implementation of **guardrails** in Quarkus LangChain4j, including tool/function calling.
44
Guardrails provide a mechanism to validate and control tool invocations at both input and output stages.
55

6-
## What are Tool Guardrails?
6+
## What are Guardrails?
77

8-
Tool guardrails are validation and transformation mechanisms that:
8+
Guardrails are validation and transformation mechanisms that:
99

10-
- **Input Guardrails**: Validate parameters and context before tool execution
11-
- **Output Guardrails**: Validate, filter, or transform tool results before returning to the LLM
10+
- **Input Guardrails**: Validate parameters and context before execution
11+
- **Output Guardrails**: Validate, filter, or transform results before returning to the LLM
1212

1313
This enables:
1414
- Security controls (authorization, authentication)
@@ -19,7 +19,7 @@ This enables:
1919

2020
## Demo Overview
2121

22-
This demo includes 6 different guardrails demonstrating various use cases:
22+
This demo includes 7 different guardrails demonstrating various use cases:
2323

2424
### Input Guardrails
2525

@@ -53,13 +53,17 @@ This demo includes 6 different guardrails demonstrating various use cases:
5353
6. **Combined Guardrails** - Multiple guardrails on one tool
5454
- Demonstrates guardrail chaining
5555
- Ordered execution
56+
57+
7. **Profanity Guardrail** - Validation of AI output.
58+
- The simplest use case to show the basics
59+
- Checks chat AI output, fails if it contains prohibited word
5660

5761
## Running the Demo
5862

5963
### Start the application in dev mode:
6064

6165
```bash
62-
mvn quarkus:dev
66+
mvn quarkus:dev -Dquarkus.langchain4j.openai.api-key=$API_KEY
6367
```
6468

6569
The application will start on http://localhost:8080
@@ -99,3 +103,14 @@ done
99103
# Large result set will be truncated
100104
curl "http://localhost:8080/email?request=Search%20for%20all%20customers"
101105
```
106+
107+
108+
#### 4. Chat with the assistant (with output moderation)
109+
110+
```bash
111+
$ curl -X POST localhost:8080/chatbot/moderated -w "\n" -d 'Hello, my name is Meatbag'
112+
[The AI answered with expletive]
113+
# The similar but non-prohibited name will not be flagged
114+
$ curl -X POST localhost:8080/chatbot/moderated -w "\n" -d 'Hello, my name is Fleabag'
115+
Hello Fleabag! How can I assist you today?
116+
```

samples/tool-guardrails/pom.xml renamed to samples/guardrails/pom.xml

Lines changed: 73 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -3,8 +3,8 @@
33
<modelVersion>4.0.0</modelVersion>
44

55
<groupId>io.quarkiverse.langchain4j</groupId>
6-
<artifactId>quarkus-langchain4j-sample-tool-guardrails</artifactId>
7-
<name>Quarkus LangChain4j - Sample - Tool Guardrails</name>
6+
<artifactId>quarkus-langchain4j-sample-guardrails</artifactId>
7+
<name>Quarkus LangChain4j - Sample - Guardrails</name>
88
<version>1.0-SNAPSHOT</version>
99

1010
<properties>
@@ -18,50 +18,28 @@
1818
<quarkus.platform.version>3.27.1</quarkus.platform.version>
1919
<skipITs>true</skipITs>
2020
<surefire-plugin.version>3.2.5</surefire-plugin.version>
21-
<quarkus-langchain4j.version>999-SNAPSHOT</quarkus-langchain4j.version>
2221
</properties>
2322

24-
<dependencyManagement>
25-
<dependencies>
26-
<dependency>
27-
<groupId>${quarkus.platform.group-id}</groupId>
28-
<artifactId>${quarkus.platform.artifact-id}</artifactId>
29-
<version>${quarkus.platform.version}</version>
30-
<type>pom</type>
31-
<scope>import</scope>
32-
</dependency>
33-
</dependencies>
34-
</dependencyManagement>
35-
3623
<dependencies>
3724
<dependency>
3825
<groupId>io.quarkus</groupId>
3926
<artifactId>quarkus-rest-jackson</artifactId>
4027
</dependency>
4128
<dependency>
42-
<groupId>io.quarkiverse.langchain4j</groupId>
43-
<artifactId>quarkus-langchain4j-openai</artifactId>
44-
<version>${quarkus-langchain4j.version}</version>
29+
<groupId>io.quarkus</groupId>
30+
<artifactId>quarkus-security</artifactId>
4531
</dependency>
4632
<dependency>
4733
<groupId>io.quarkus</groupId>
48-
<artifactId>quarkus-security</artifactId>
34+
<artifactId>quarkus-junit5</artifactId>
35+
<scope>test</scope>
4936
</dependency>
50-
51-
<!-- Minimal dependencies to constrain the build -->
5237
<dependency>
53-
<groupId>io.quarkiverse.langchain4j</groupId>
54-
<artifactId>quarkus-langchain4j-openai-deployment</artifactId>
55-
<version>${quarkus-langchain4j.version}</version>
38+
<groupId>io.rest-assured</groupId>
39+
<artifactId>rest-assured</artifactId>
5640
<scope>test</scope>
57-
<type>pom</type>
58-
<exclusions>
59-
<exclusion>
60-
<groupId>*</groupId>
61-
<artifactId>*</artifactId>
62-
</exclusion>
63-
</exclusions>
6441
</dependency>
42+
6543
</dependencies>
6644

6745
<build>
@@ -96,6 +74,70 @@
9674
</build>
9775

9876
<profiles>
77+
<profile>
78+
<id>default-project-deps</id>
79+
<activation>
80+
<property>
81+
<name>!platform-deps</name>
82+
</property>
83+
</activation>
84+
<properties>
85+
<quarkus-langchain4j.version>999-SNAPSHOT</quarkus-langchain4j.version>
86+
</properties>
87+
<dependencyManagement>
88+
<dependencies>
89+
<dependency>
90+
<groupId>${quarkus.platform.group-id}</groupId>
91+
<artifactId>${quarkus.platform.artifact-id}</artifactId>
92+
<version>${quarkus.platform.version}</version>
93+
<type>pom</type>
94+
<scope>import</scope>
95+
</dependency>
96+
</dependencies>
97+
</dependencyManagement>
98+
<dependencies>
99+
<dependency>
100+
<groupId>io.quarkiverse.langchain4j</groupId>
101+
<artifactId>quarkus-langchain4j-openai</artifactId>
102+
<version>${quarkus-langchain4j.version}</version>
103+
</dependency>
104+
</dependencies>
105+
</profile>
106+
<profile>
107+
<id>platform-deps</id>
108+
<activation>
109+
<property>
110+
<name>platform-deps</name>
111+
</property>
112+
</activation>
113+
<properties>
114+
<quarkus.platform.group-id>io.quarkus.platform</quarkus.platform.group-id>
115+
</properties>
116+
<dependencyManagement>
117+
<dependencies>
118+
<dependency>
119+
<groupId>${quarkus.platform.group-id}</groupId>
120+
<artifactId>${quarkus.platform.artifact-id}</artifactId>
121+
<version>${quarkus.platform.version}</version>
122+
<type>pom</type>
123+
<scope>import</scope>
124+
</dependency>
125+
<dependency>
126+
<groupId>${quarkus.platform.group-id}</groupId>
127+
<artifactId>quarkus-langchain4j-bom</artifactId>
128+
<version>${quarkus.platform.version}</version>
129+
<type>pom</type>
130+
<scope>import</scope>
131+
</dependency>
132+
</dependencies>
133+
</dependencyManagement>
134+
<dependencies>
135+
<dependency>
136+
<groupId>io.quarkiverse.langchain4j</groupId>
137+
<artifactId>quarkus-langchain4j-openai</artifactId>
138+
</dependency>
139+
</dependencies>
140+
</profile>
99141
<profile>
100142
<id>native</id>
101143
<activation>

samples/tool-guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/EmailFormatValidator.java renamed to samples/guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/EmailFormatValidator.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,7 @@ public ToolInputGuardrailResult validate(ToolInputGuardrailRequest request) {
5656
return ToolInputGuardrailResult.success();
5757

5858
} catch (Exception e) {
59-
return ToolInputGuardrailResult.failure(
59+
return ToolInputGuardrailResult.fatal(
6060
"Failed to validate email format: " + e.getMessage(), e);
6161
}
6262
}

samples/tool-guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/EmailResource.java renamed to samples/guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/EmailResource.java

File renamed without changes.

samples/tool-guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/EmailService.java renamed to samples/guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/EmailService.java

File renamed without changes.

samples/tool-guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/EmailTools.java renamed to samples/guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/EmailTools.java

File renamed without changes.

samples/tool-guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/OutputSizeLimiter.java renamed to samples/guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/OutputSizeLimiter.java

File renamed without changes.

samples/tool-guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/RateLimitGuardrail.java renamed to samples/guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/RateLimitGuardrail.java

File renamed without changes.

samples/tool-guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/SensitiveDataFilter.java renamed to samples/guardrails/src/main/java/io/quarkiverse/langchain4j/sample/guardrails/SensitiveDataFilter.java

File renamed without changes.

0 commit comments

Comments
 (0)