A Comparative Study of Diversity Methods for Hybrid Text and Image Retrieval Approaches

AVEIR 2007-2009

About Diversity

This page gives you the DATA used in:

Sabrina Tollari, Philippe Mulhem, Marin Ferecatu, Hervé Glotin, Marcin Detyniecki, Patrick Gallinari, Hichem Sahbi, Zhong-Qiu Zhao,
"A Comparative Study of Diversity Methods for Hybrid Text and Image Retrieval Approaches",
Evaluating Systems for Multilingual and Multimodal Information Access, LNCS 5706/2009, pages 585-592, 9th Workshop of the Cross-Language Evaluation Forum, CLEF 2008: Aarhus, Denmark, Revised Selected Papers 2009
[DATA] [PDF] [DOI] [BIB]

Download

All files (50Mb)

Only the README.txt

Only the non-diversified runs

Only the diversified runs

Only the score files

Only the working notes

Working Notes

Sabrina Tollari, Marcin Detyniecki, Marin Ferecatu, Hervé Glotin, Philippe Mulhem, Massih-Reza Amini, Ali Fakeri-Tabrizi, Patrick Gallinari, Hichem Sahbi, Zhong-Qiu Zhao,
"Consortium AVEIR at ImageCLEFphoto 2008: on the fusion of runs",
Working Notes for the CLEF 2008 workshop, 2008
[PDF] [BIB]
Philippe Mulhem,
"LIG at ImageCLEFphoto 2008",
Working Notes for the CLEF 2008 workshop, 2008
[PDF] [BIB]
Sabrina Tollari, Marcin Detyniecki, Ali Fakeri-Tabrizi, Massih-Reza Amini, Patrick Gallinari,
"UPMC/LIP6 at ImageCLEFphoto 2008: on the exploitation of visual concepts (VCDT)",
Working Notes for the CLEF 2008 workshop, 2008
[PDF] [POSTER] [BIB]
Hervé Glotin, Zhong-Qiu Zhao,
"Affinity propagation promoting diversity in visuo-entropic and text features for Clef Photo retrieval 2008 campaign",
Working Notes for the CLEF 2008 workshop, 2008
[PDF] [BIB]
Marin Ferecatu, Hichem Sahbi,
"TELECOM ParisTech at ImageClefphoto 2008: Bi-Modal Text and Image Retrieval with Diversity Enhancement",
Working Notes for the CLEF 2008 workshop, 2008
[PDF] [BIB]

Resume

Name of the Non-Diversified Runs	P20	CR20	run	P20	CR20	run	P20	CR20	run	P20	CR20	run	P20	CR20	run	P20	CR20	run	P20	CR20	run	P20	CR20	run	P20	CR20	run
	NoDiv			ClustDMY			AffProp			DIVVISU			VisKmeans			DIVALEA			Kmeans			MAXMIN			QT
Automatic Text Only Runs
LIG-EN-EN-AUTO-TXT-NoDiv	0.203	0.276	R S	0.19	0.232	R S	0.203	0.279	R S	0.223	0.3	R S	0.208	0.286	R S	0.21	0.251	R S	0.19	0.343	R S	0.201	0.303	R S	0.212	0.305	R S
LIP6_r3tfidf_EN-EN-AUTO-TXT	0.25	0.3	R S	0.195	0.253	R S	0.25	0.306	R S	0.215	0.305	R S	0.232	0.306	R S	0.215	0.298	R S	0.226	0.352	R S	0.224	0.337	R S	0.249	0.328	R S
PTECH-EN-EN-AUTO-TXT-NoDiv	0.344	0.398	R S	0.199	0.331	R S	0.344	0.4	R S	0.3	0.393	R S	0.321	0.409	R S	0.304	0.359	R S	0.277	0.409	R S	0.28	0.419	R S	0.294	0.427	R S
Automatic Visual Only Runs
LIG-EN-EN-AUTO-IMG-NoDiv	0.18	0.252	R S	0.106	0.191	R S	0.18	0.245	R S	0.106	0.244	R S	0.127	0.244	R S	0.113	0.221	R S	0.122	0.255	R S	0.109	0.254	R S	0.122	0.262	R S
LSIS_EN-EN-AUTO-IMG	0.171	0.234	R S	0.109	0.183	R S	0.171	0.242	R S	0.106	0.234	R S	0.117	0.209	R S	0.124	0.185	R S	0.114	0.242	R S	0.118	0.221	R S	0.135	0.244	R S
PTECH-EN-EN-AUTO-IMG-NoDiv	0.245	0.3	R S	0.136	0.239	R S	0.245	0.289	R S	0.145	0.279	R S	0.178	0.288	R S	0.176	0.274	R S	0.16	0.309	R S	0.16	0.328	R S	0.178	0.326	R S
Automatic Text-Image Runs
AVEIR_EN-EN-AUTO-TXTIMG_MEAN	0.435	0.463	R S	0.263	0.363	R S	0.435	0.449	R S	0.369	0.469	R S	0.392	0.469	R S	0.347	0.44	R S	0.328	0.528	R S	0.365	0.523	R S	0.392	0.539	R S
AVEIR_EN-EN-AUTO-TXTIMG_MEAN1on4	0.21	0.321	R S	0.13	0.197	R S	0.21	0.297	R S	0.155	0.299	R S	0.18	0.315	R S	0.18	0.269	R S	0.16	0.318	R S	0.149	0.328	R S	0.156	0.315	R S
AVEIR_EN-EN-AUTO-TXTIMG_MEAN2on4	0.362	0.431	R S	0.227	0.319	R S	0.362	0.434	R S	0.309	0.449	R S	0.324	0.43	R S	0.315	0.437	R S	0.291	0.485	R S	0.308	0.494	R S	0.324	0.504	R S
AVEIR_EN-EN-AUTO-TXTIMG_MEAN3on4	0.412	0.443	R S	0.255	0.356	R S	0.412	0.419	R S	0.354	0.496	R S	0.38	0.465	R S	0.333	0.409	R S	0.339	0.529	R S	0.33	0.511	R S	0.351	0.504	R S
AVEIR_EN-EN-AUTO-TXTIMG_MIN	0.354	0.462	R S	0.231	0.318	R S	0.354	0.45	R S	0.309	0.439	R S	0.337	0.482	R S	0.28	0.419	R S	0.294	0.526	R S	0.277	0.509	R S	0.306	0.501	R S
LIG_histo_3_p_o_1v5_4_0_EN-EN-AUTO-TXTIMG	0.322	0.38	R S	0.217	0.309	R S	0.322	0.368	R S	0.278	0.393	R S	0.283	0.393	R S	0.268	0.339	R S	0.246	0.421	R S	0.246	0.403	R S	0.255	0.389	R S
LIP6_r3tfidf_VCDTWN_EN-EN-AUTO-TXTIMG	0.258	0.293	R S	0.181	0.229	R S	0.258	0.31	R S	0.218	0.299	R S	0.236	0.298	R S	0.221	0.278	R S	0.231	0.336	R S	0.214	0.314	R S	0.237	0.322	R S
LSIS_EN-EN-AUTO-TXTIMG	0.292	0.383	R S	0.173	0.256	R S	0.292	0.358	R S	0.221	0.371	R S	0.242	0.377	R S	0.227	0.312	R S	0.214	0.392	R S	0.21	0.389	R S	0.236	0.409	R S
PTECH-EN-EN-AUTO-TXTIMG-NoDiv	0.412	0.487	R S	0.242	0.368	R S	0.412	0.482	R S	0.34	0.437	R S	0.378	0.479	R S	0.323	0.394	R S	0.321	0.506	R S	0.339	0.498	R S	0.344	0.477	R S
Manual Text-Image Runs
PTECH-EN-EN-MAN-TXTIMG-NoDiv	0.699	0.552	R S	0.681	0.567	R S	0.699	0.516	R S	0.669	0.598	R S	0.681	0.603	R S	0.678	0.581	R S	0.683	0.635	R S	0.664	0.639	R S	0.662	0.637	R S
Ideal Runs
res_ideal_1	0.996	0.677	R S	0.994	0.708	R S	0.996	0.662	R S	0.996	0.755	R S	0.995	0.705	R S	0.992	0.736	R S	0.995	0.83	R S	0.994	0.822	R S	0.994	0.798	R S
res_ideal_2	0.991	0.735	R S	0.991	0.769	R S	0.991	0.7	R S	0.992	0.774	R S	0.991	0.763	R S	0.994	0.758	R S	0.992	0.86	R S	0.991	0.846	R S	0.992	0.831	R S
res_ideal_3	0.996	0.798	R S	0.995	0.795	R S	0.996	0.763	R S	0.995	0.827	R S	0.996	0.826	R S	0.992	0.798	R S	0.996	0.887	R S	0.996	0.882	R S	0.995	0.88	R S
res_ideal_4	0.994	0.721	R S	0.995	0.736	R S	0.994	0.699	R S	0.992	0.766	R S	0.992	0.749	R S	0.992	0.743	R S	0.994	0.854	R S	0.991	0.839	R S	0.994	0.832	R S
res_ideal_5	0.994	0.759	R S	0.995	0.751	R S	0.994	0.707	R S	0.995	0.788	R S	0.994	0.783	R S	0.997	0.775	R S	0.994	0.857	R S	0.994	0.866	R S	0.995	0.85	R S
res_ideal_6	0.995	0.718	R S	0.995	0.729	R S	0.994	0.717	R S	0.992	0.763	R S	0.995	0.732	R S	0.994	0.762	R S	0.995	0.851	R S	0.992	0.846	R S	0.992	0.817	R S
res_ideal_7	0.995	0.746	R S	0.994	0.759	R S	0.994	0.715	R S	0.992	0.81	R S	0.994	0.783	R S	0.991	0.765	R S	0.995	0.863	R S	0.991	0.872	R S	0.994	0.855	R S
res_ideal_8	0.994	0.759	R S	0.994	0.756	R S	0.992	0.696	R S	0.992	0.804	R S	0.992	0.784	R S	0.992	0.77	R S	0.992	0.879	R S	0.994	0.87	R S	0.992	0.868	R S
res_ideal_9	0.992	0.75	R S	0.991	0.756	R S	0.992	0.705	R S	0.992	0.816	R S	0.992	0.802	R S	0.991	0.798	R S	0.992	0.887	R S	0.994	0.878	R S	0.994	0.869	R S
res_ideal_10	0.994	0.718	R S	0.995	0.729	R S	0.994	0.679	R S	0.992	0.763	R S	0.994	0.745	R S	0.994	0.734	R S	0.994	0.862	R S	0.994	0.848	R S	0.994	0.819	R S
Mean and std
mean	0.58	0.514		0.518	0.469		0.58	0.496		0.548	0.533		0.56	0.528		0.548	0.504		0.544	0.585		0.543	0.578		0.553	0.573
std	0.349	0.196		0.397	0.238		0.349	0.182		0.374	0.219		0.365	0.211		0.373	0.224		0.377	0.241		0.377	0.242		0.369	0.234

Download

Working Notes

Resume

Related Links