Skip to content

Commit b0aa568

Browse files
aljesusgaljesusg
committed
Order tasks and README
Signed-off-by: Alberto Gutierrez <[email protected]>
1 parent 96c3575 commit b0aa568

File tree

132 files changed

+245
-4
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

132 files changed

+245
-4
lines changed

‎evals/claude-code/eval-inline.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ config:
1212
apiKeyKey: JUDGE_API_KEY
1313
modelNameKey: JUDGE_MODEL_NAME
1414
taskSets:
15-
- glob: ../tasks/*/*.yaml
15+
- glob: ../tasks/*/*/*.yaml
1616
assertions:
1717
toolsUsed:
1818
- server: kubernetes

‎evals/claude-code/eval.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ config:
1212
apiKeyKey: JUDGE_API_KEY
1313
modelNameKey: JUDGE_MODEL_NAME
1414
taskSets:
15-
- glob: ../tasks/*/*.yaml
15+
- glob: ../tasks/*/*/*.yaml
1616
assertions:
1717
toolsUsed:
1818
- server: kubernetes

‎evals/openai-agent/eval-inline.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ config:
1616
apiKeyKey: JUDGE_API_KEY
1717
modelNameKey: JUDGE_MODEL_NAME
1818
taskSets:
19-
- glob: ../tasks/*/*.yaml
19+
- glob: ../tasks/*/*/*.yaml
2020
assertions:
2121
toolsUsed:
2222
- server: kubernetes

‎evals/openai-agent/eval.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ config:
1212
apiKeyKey: JUDGE_API_KEY
1313
modelNameKey: JUDGE_MODEL_NAME
1414
taskSets:
15-
- glob: ../tasks/*/*.yaml
15+
- glob: ../tasks/*/*/*.yaml
1616
assertions:
1717
toolsUsed:
1818
- server: kubernetes

‎evals/tasks/README.md‎

Lines changed: 36 additions & 0 deletions

‎evals/tasks/kiali/Makefile‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
SHELL := /usr/bin/bash
2+
3+
.PHONY: update-tasks
4+
5+
update-tasks:
6+
@./scripts/update_tasks.sh

‎evals/tasks/kiali/README.md‎

Lines changed: 55 additions & 0 deletions

evals/tasks/kiali-istio-create/kiali-istio-create.yaml renamed to evals/tasks/kiali/istio-create/kiali-istio-create.yaml

File renamed without changes.

evals/tasks/kiali-istio-delete/kiali-istio-delete.yaml renamed to evals/tasks/kiali/istio-delete/kiali-istio-delete.yaml

File renamed without changes.

evals/tasks/kiali-istio-list/kiali-istio-list.yaml renamed to evals/tasks/kiali/istio-list/kiali-istio-list.yaml

File renamed without changes.

0 commit comments

Comments
 (0)