jamie/ucsinfer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Activity

Update MODELS.md

Browse Source 
Another run
This commit is contained in:
Jamie Hardt
2025-08-28 00:26:45 +00:00
parent 62654464f3
commit 4570ed632a
1 changed files with 16 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

16
MODELS.md
View File

@@ -30,3 +30,19 @@
| UCS category count: | 752 | | | UCS category count: | 752 | |
| Total categories in sample: | 238 | 31.65% | | Total categories in sample: | 238 | 31.65% |
| Most missed category (VEHCar): | 75 | 3.21% | | Most missed category (VEHCar): | 75 | 3.21% |
## Evaluating model paraphrase-multilingual-mpnet-base-v2...
(FOLYProp and FOLYFeet have been omitted from the dataset.)
| | n | pct |
|---------------------------------|------|--------|
| Total records in sample: | 5800 | |
| Top Result: | 681 | 11.74% |
| Top 5 Result: | 1025 | 17.67% |
| Top 10 Result: | 802 | 13.83% |
| |
| UCS category count: | 752 | |
| Total categories in sample: | 298 | 39.63% |
| Most missed category (MAGElem): | 481 | 8.29% |