The following table depicts the results for the concept-based retrieval task in alphabetical order. Runs were evaluated with the non-interpolated Average Precision, Precision@10, Precision@20, Prceision@100 and R-Precision in a topic-based evaluation using the trec_eval 8.1 software.
Detailed results for all topics and all runs can be found at the ftp.
Run< |
MAP |
P@10 |
P@20 |
P@100 |
R-Prec |
|
Manual |
Automated |
Textual |
Visual |
Mixed |
ISIS_1308685265788__runcbr-UvA-auto10.txt |
0.0181 |
0.0875 |
0.0688 |
0.0530 |
0.0448 |
|
| X |
|
X |
|
ISIS_1308685310238__runcbr-UvA-auto33.txt |
0.0366 |
0.1400 |
0.1350 |
0.1020 |
0.0790 |
|
|
X |
|
X |
|
ISIS_1308685350568__runcbr-UvA-auto100.txt |
0.0430 |
0.1675 |
0.1550 |
0.1270 |
0.0974 |
|
|
X |
|
X |
|
ISIS_1308685443537__runcbr-UvA-conceptmap.txt |
0.0534 |
0.1775 |
0.1938 |
0.1675 |
0.1159 |
|
X |
|
|
X |
|
ISIS_1308685497624__runcbr-UvA-multiconceptmul.txt |
0.0888 |
0.2600 |
0.2738 |
0.2213 |
0.1652 |
|
X |
|
|
X |
|
ISIS_1308685542216__runcbr-UvA-multiconceptsum.txt |
0.0803 |
0.2425 |
0.2600 |
0.2015 |
0.1500 |
|
X |
|
|
X |
|
ISIS_1308685631678__runcbr-UvA-enhanced.txt |
0.0867 |
0.2550 |
0.2725 |
0.2227 |
0.1597 |
|
X |
|
|
X |
|
ISIS_1308685680597__runcbr-UvA-enhancedplus100.txt |
0.0940 |
0.2950 |
0.2800 |
0.2335 |
0.1664 |
|
X |
|
|
X |
|
ISIS_1308685828076__runcbr-UvA-enhancedfast.txt |
0.0916 |
0.2700 |
0.2875 |
0.2277 |
0.1635 |
|
X |
|
|
X |
|
ISIS_1308685876873__runcbr-UvA-enhancedplus100fast.txt |
0.0997 |
0.3125 |
0.3050 |
0.2428 |
0.1712 |
|
X |
|
|
X |
|
MEIJI_1307986549452__meijiVn.txt |
0.0017 |
0.0150 |
0.0150 |
0.0197 |
0.0151 |
|
|
X |
|
X |
|
MEIJI_1308443537669__meijiTn.txt |
0.0213 |
0.0675 |
0.0862 |
0.0865 |
0.0648 |
|
|
X |
X |
|
|
MEIJI_1308443999150__meijiVr.txt |
0.0013 |
0.0125 |
0.0125 |
0.0185 |
0.0122 |
|
|
X |
|
X |
|
MEIJI_1308444441206__meijiTr.txt |
0.0227 |
0.0900 |
0.0962 |
0.0865 |
0.0628 |
|
|
X |
X |
|
|
MEIJI_1308444633885__meijiVCTn.txt |
0.0444 |
0.1625 |
0.1650 |
0.1465 |
0.1053 |
|
|
X |
|
|
X |
MEIJI_1308444822371__meijiVCTr.txt |
0.0333 |
0.1300 |
0.1200 |
0.1130 |
0.0824 |
|
|
X |
|
|
X |
MEIJI_1308495839773__meijiVTn.txt |
0.0408 |
0.1750 |
0.1513 |
0.1432 |
0.1053 |
|
|
X |
|
|
X |
MEIJI_1308495988189__meijiVTr.txt |
0.0325 |
0.1425 |
0.1250 |
0.1140 |
0.0867 |
|
|
X |
|
|
X |
MEIJI_1308496071960__meijiVTVn.txt |
0.0420 |
0.1725 |
0.1437 |
0.1417 |
0.1061 |
|
|
X |
|
|
X |
MEIJI_1308496150191__meijiVTVr.txt |
0.0327 |
0.1275 |
0.1138 |
0.1135 |
0.0847 |
|
|
X |
|
|
X |
MLKD_1307691968544__Sub1_Visual_1000.txt |
0.0361 |
0.1525 |
0.1375 |
0.1080 |
0.0883 |
|
X |
|
|
X |
|
MLKD_1307692048001__Sub2_Tags_QueryByExample_1000.txt |
0.0849 |
0.3000 |
0.2800 |
0.2188 |
0.1530 |
|
|
X |
X |
|
|
MLKD_1307692102536__Sub3_Tags_1000.txt |
0.1546 |
0.4100 |
0.3838 |
0.3102 |
0.2366 |
|
X |
|
X |
|
|
MLKD_1307692157334__Sub4_Multi1_1000.txt |
0.1640 |
0.3900 |
0.3700 |
0.3180 |
0.2467 |
|
X |
|
|
|
X |
MLKD_1307692201394__Sub5_Multi2_1000.txt |
0.1533 |
0.4175 |
0.3725 |
0.2980 |
0.2332 |
|
X |
|
|
|
X |
MLKD_1308226593230__Sub6_Visual_250.txt |
0.0295 |
0.1525 |
0.1375 |
0.1080 |
0.0863 |
|
X |
|
|
X |
|
MLKD_1308226793805__Sub7_Tags_QueryByExample_250.txt |
0.0708 |
0.3000 |
0.2800 |
0.2188 |
0.1486 |
|
|
X |
X |
|
|
MLKD_1308226864554__Sub8_Tags_250.txt |
0.1328 |
0.4100 |
0.3838 |
0.3102 |
0.2298 |
|
X |
|
X |
|
|
MLKD_1308226941036__Sub9_Multi1_250.txt |
0.1346 |
0.3900 |
0.3700 |
0.3180 |
0.2397 |
|
X |
|
|
|
X |
MLKD_1308227066531__Sub10_Multi2_250.txt |
0.1312 |
0.4175 |
0.3725 |
0.2980 |
0.2260 |
|
X |
|
|
|
X |
REGIMVID_1308548603241__REGIMVIDT1FRT.txt |
0.0042 |
0.0650 |
0.0550 |
0.0352 |
0.0200 |
|
|
X |
X |
|
|