Skip to content
Snippets Groups Projects
Commit b4cebef1 authored by lkim's avatar lkim
Browse files
parents 25f703a8 b1f110ee
No related branches found
No related tags found
No related merge requests found
......@@ -4,12 +4,12 @@
## Experiments on SummEval dataset
Full dataset used by G-Eval paper
Full dataset used by G-Eval paper
Sample dataset used for CoT analysis
### Meta Evaluate the G-Eval results
.\meta_eval_summeval.py changed for CoT analysis
.\meta_eval_summeval.py changed for CoT analysis
```python .\meta_eval_summeval.py --input_folder .\results\gemini --output_filename gemini_output.txt```
## Prompts and Evaluation Results
......@@ -17,5 +17,5 @@ Sample dataset used for CoT analysis
Prompts used to evaluate SummEval with GPT-4 & base and detailed prompts for CoT analysis are in prompts/summeval (by G-Eval paper)
Auto-CoT prompts are in prompts/cot_analysis
GPT-4 G-eval results on SummEval are in results (by G-Eval paper)
GPT-4 G-eval results on SummEval are in results (by G-Eval paper)
Other models results are in their respective folder
\ No newline at end of file
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment