Skip to content

Commit d1a8b5d

Browse files
jordiclivejordicliveVictorSanh
authored
adding first WebNLG prompts. (#731)
* adding first WebNLG prompts. * Changed to choice and added ROUGE. Made names and distinctions clearer between prompts * Update promptsource/templates/enriched_web_nlg/en/templates.yaml Co-authored-by: jordiclive <[email protected]> Co-authored-by: Victor SANH <[email protected]>
1 parent eaac392 commit d1a8b5d

File tree

1 file changed

+60
-0
lines changed

1 file changed

+60
-0
lines changed
Lines changed: 60 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,60 @@
1+
dataset: enriched_web_nlg
2+
subset: en
3+
templates:
4+
3860d7fb-0b50-4275-a7ab-782ae86756e5: !Template
5+
answer_choices: null
6+
id: 3860d7fb-0b50-4275-a7ab-782ae86756e5
7+
jinja: 'Take the following triple set as part of a Data-to-Text task: {{modified_triple_sets.mtriple_set[0]
8+
| join(", ")}}. Make a lexicalization of the triple set into plain text. |||
9+
{{lex.text | choice}}'
10+
metadata: !TemplateMetadata
11+
choices_in_prompt: false
12+
metrics:
13+
- BLEU
14+
- ROUGE
15+
original_task: true
16+
name: Non-explicit Description
17+
reference: 'Triple set: lexicalization'
18+
5c203187-70e4-4913-86af-8b00b5ca9e16: !Template
19+
answer_choices: null
20+
id: 5c203187-70e4-4913-86af-8b00b5ca9e16
21+
jinja: 'Verbalize the following triples separated by a comma: {{modified_triple_sets.mtriple_set[0]
22+
| join(", ")}} ||| {{lex.text | choice}}'
23+
metadata: !TemplateMetadata
24+
choices_in_prompt: false
25+
metrics:
26+
- BLEU
27+
- ROUGE
28+
original_task: true
29+
name: Verbalize + Specify Commas
30+
reference: 'Instruction: verbalization'
31+
715a885b-1022-43b0-bcfe-20fa432314da: !Template
32+
answer_choices: null
33+
id: 715a885b-1022-43b0-bcfe-20fa432314da
34+
jinja: 'Take the following graph comprising triple sets, where each element of
35+
a triple is separated by "|" and each triple set by ",": {{modified_triple_sets.mtriple_set[0]
36+
| join(", ")}}. Make a verbalization of the triple set into plain text. |||
37+
{{lex.text | choice}}'
38+
metadata: !TemplateMetadata
39+
choices_in_prompt: false
40+
metrics:
41+
- BLEU
42+
- ROUGE
43+
original_task: true
44+
name: Explicit Graph Description
45+
reference: 'Explicit Graph Description: verbalization.'
46+
e80f68dd-ebd0-4cbc-960d-bb28aff2d2d4: !Template
47+
answer_choices: null
48+
id: e80f68dd-ebd0-4cbc-960d-bb28aff2d2d4
49+
jinja: 'Take the following Table to text task comprising semantic triples (RDF triples), where each element of
50+
a triple is separated by "|" and each triple set by ",": {{modified_triple_sets.mtriple_set[0]
51+
| join(", ")}}. Make a verbalization of the triple set into plain text, which fully and accurately describes the Table. |||
52+
{{lex.text | choice}}'
53+
metadata: !TemplateMetadata
54+
choices_in_prompt: false
55+
metrics:
56+
- BLEU
57+
- ROUGE
58+
original_task: true
59+
name: Explicit Table-to-Text Description
60+
reference: 'Explicit Table description: verbalization.'

0 commit comments

Comments
 (0)