48 lines
1.7 KiB
Markdown
48 lines
1.7 KiB
Markdown
# Models
|
|
|
|
## Results for Model paraphrase-multilingual-MiniLM-L12-v2 ##
|
|
|
|
(FOLYProp and FOLYFeet have been omitted from the dataset.)
|
|
|
|
| | n | pct |
|
|
|--------------------------------|------|--------|
|
|
| Total records in sample: | 2335 | |
|
|
| Top Result: | 415 | 17.77% |
|
|
| Top 5 Result: | 545 | 23.34% |
|
|
| Top 10 Result: | 419 | 17.94% |
|
|
| |
|
|
| UCS category count: | 752 | |
|
|
| Total categories in sample: | 238 | 31.65% |
|
|
| Most missed category (BLLTBy): | 140 | 6.00% |
|
|
|
|
|
|
## Results for Model paraphrase-multilingual-mpnet-base-v2 ##
|
|
|
|
(FOLYProp and FOLYFeet have been omitted from the dataset.)
|
|
|
|
| | n | pct |
|
|
|--------------------------------|------|--------|
|
|
| Total records in sample: | 2335 | |
|
|
| Top Result: | 469 | 20.09% |
|
|
| Top 5 Result: | 513 | 21.97% |
|
|
| Top 10 Result: | 506 | 21.67% |
|
|
| |
|
|
| UCS category count: | 752 | |
|
|
| Total categories in sample: | 238 | 31.65% |
|
|
| Most missed category (VEHCar): | 75 | 3.21% |
|
|
|
|
|
|
## Evaluating model paraphrase-multilingual-mpnet-base-v2...
|
|
|
|
(FOLYProp and FOLYFeet have been omitted from the dataset.)
|
|
|
|
| | n | pct |
|
|
|---------------------------------|------|--------|
|
|
| Total records in sample: | 5800 | |
|
|
| Top Result: | 681 | 11.74% |
|
|
| Top 5 Result: | 1025 | 17.67% |
|
|
| Top 10 Result: | 802 | 13.83% |
|
|
| |
|
|
| UCS category count: | 752 | |
|
|
| Total categories in sample: | 298 | 39.63% |
|
|
| Most missed category (MAGElem): | 481 | 8.29% | |