Search results for "meta-evaluation"

Hits ?▲	Authors	Title	Venue	Year	Link	Author keywords
22	Hui Zhang 0010, Sharath R. Cholleti, Sally A. Goldman, Jason E. Fritts	Meta-Evaluation of Image Segmentation Using Machine Learning.	CVPR (1)	2006	DBLP DOI BibTeX RDF
21	Tobias Blanke, Mounia Lalmas	Theoretical benchmarks of XML retrieval.	SIGIR	2006	DBLP DOI BibTeX RDF	meta-evaluation, XML retrieval
19	Peter Spyns	Evaluating Automatically a Text Miner for Ontologies: A Catch-22 Situation?.	OTM Conferences (2)	2008	DBLP DOI BibTeX RDF
17	Andy Wai Kan Yeung, Natalie Sui Miu Wong, Hakwan C. Lau, Simon B. Eickhoff	Human brain responses to gustatory and food stimuli: A meta-evaluation of neuroimaging meta-analyses.	NeuroImage	2019	DBLP DOI BibTeX RDF
14	Ben Carterette	On rank correlation and the distance between rankings.	SIGIR	2009	DBLP DOI BibTeX RDF	information retrieval, evaluation, distance measures, rank correlation
13	Steffi Chern, Ethan Chern, Graham Neubig, Pengfei Liu 0003	Can Large Language Models be Trusted for Evaluation? Scalable Meta-Evaluation of LLMs as Evaluators via Agent Debate.	CoRR	2024	DBLP DOI BibTeX RDF
13	Zeyang Liu, Ke Zhou 0003, Max L. Wilson 0001	Meta-evaluation of Conversational Search Evaluation Metrics.	ACM Trans. Inf. Syst.	2021	DBLP DOI BibTeX RDF
13	Zeyang Liu, Ke Zhou 0003, Max L. Wilson 0001	Meta-evaluation of Conversational Search Evaluation Metrics.	CoRR	2021	DBLP BibTeX RDF
13	Jiqun Liu, Ran Yu 0001	State-Aware Meta-Evaluation of Evaluation Metrics in Interactive Information Retrieval.	CIKM	2021	DBLP DOI BibTeX RDF
13	Anya Belz, Simon Mille, David M. Howcroft	Disentangling the Properties of Human Evaluation Methods: A Classification System to Support Comparability, Meta-Evaluation and Reproducibility Testing.	INLG	2020	DBLP DOI BibTeX RDF
13	Junting Yu, Wuying Liu, Hongye He, Lin Wang	Automatic Meta-evaluation of Low-Resource Machine Translation Evaluation Metrics.	IALP	2019	DBLP DOI BibTeX RDF
13	Suneel Kumar Kingrani, Mark Levene, Dell Zhang	A Meta-Evaluation of Evaluation Methods for Diversified Search.	ECIR	2018	DBLP DOI BibTeX RDF
13	Ye Chen, Ke Zhou 0003, Yiqun Liu 0001, Min Zhang 0006, Shaoping Ma	Meta-evaluation of Online and Offline Web Search Evaluation Metrics.	SIGIR	2017	DBLP DOI BibTeX RDF
13	E. Praestgaard	Meta-evaluation: Evaluation of evaluations.	Scientometrics	1999	DBLP DOI BibTeX RDF
13	L. Georghiou	Meta-evaluation: Evaluation of evaluations.	Scientometrics	1999	DBLP DOI BibTeX RDF
13	M. Horvat	Meta-evaluation: Evaluation of evaluations some points for discussion.	Scientometrics	1999	DBLP DOI BibTeX RDF
11	David Nutter, Cornelia Boldyreff	WETICE 2004 ECE Workshop - Final Report.	WETICE	2004	DBLP DOI BibTeX RDF
10	Rishav Hada, Varun Gumma, Mohamed Ahmed, Kalika Bali, Sunayana Sitaram	METAL: Towards Multilingual Meta-Evaluation.	CoRR	2024	DBLP DOI BibTeX RDF
10	Masamune Kobayashi, Masato Mita, Mamoru Komachi	Revisiting Meta-evaluation for Grammatical Error Correction.	CoRR	2024	DBLP DOI BibTeX RDF
10	Nikita Moghe, Arnisa Fazla, Chantal Amrhein, Tom Kocmi, Mark Steedman, Alexandra Birch, Rico Sennrich, Liane Guillou	Machine Translation Meta Evaluation through Translation Accuracy Challenge Sets.	CoRR	2024	DBLP DOI BibTeX RDF
10	Teresa Gonçalves 0001, Rute Veladas, Hua Yang, Renata Vieira, Paulo Quaresma, Paulo Infante, Cátia Sousa Pinto, João Oliveira, Maria Cortes Ferreira, Jéssica Morais, Ana Raquel Pereira, Nuno Fernandes, Carolina Gonçalves	Clinical Screening Prediction in the Portuguese National Health Service: Data Analysis, Machine Learning Models, Explainability and Meta-Evaluation.	Future Internet	2023	DBLP DOI BibTeX RDF
10	Anna Hedström, Philine Bommer, Kristoffer K. Wickstrøm, Wojciech Samek, Sebastian Lapuschkin, Marina M.-C. Höhne	The Meta-Evaluation Problem in Explainable AI: Identifying Reliable Estimators with MetaQuantus.	CoRR	2023	DBLP DOI BibTeX RDF
10	Daniel Deutsch, George F. Foster, Markus Freitag	Ties Matter: Modifying Kendall's Tau for Modern Metric Meta-Evaluation.	CoRR	2023	DBLP DOI BibTeX RDF
10	Griffin Adams, Jason Zucker 0001, Noémie Elhadad	A Meta-Evaluation of Faithfulness Metrics for Long-Form Hospital-Course Summarization.	CoRR	2023	DBLP DOI BibTeX RDF
10	Yue Guo, Tal August, Gondy Leroy, Trevor Cohen, Lucy Lu Wang	APPLS: A Meta-evaluation Testbed for Plain Language Summarization.	CoRR	2023	DBLP DOI BibTeX RDF
10	Nuo Chen, Tetsuya Sakai	A Meta-Evaluation of C/W/L/A Metrics: System Ranking Similarity, System Ranking Consistency and Discriminative Power.	CoRR	2023	DBLP DOI BibTeX RDF
10	Evangelos Sariyanidi, Claudio Ferrari, Stefano Berretti, Robert T. Schultz, Birkan Tunç	Meta-evaluation for 3D Face Reconstruction Via Synthetic Data.	IJCB	2023	DBLP DOI BibTeX RDF
10	Griffin Adams, Jason Zuckerg, Noémie Elhadad	A Meta-Evaluation of Faithfulness Metrics for Long-Form Hospital-Course Summarization.	MLHC	2023	DBLP BibTeX RDF
10	Liang Ma, Shuyang Cao, Robert L. Logan IV, Di Lu, Shihao Ran, Ke Zhang, Joel R. Tetreault, Alejandro Jaimes	BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness Metrics.	ACL (1)	2023	DBLP DOI BibTeX RDF
10	Liang Ma, Shuyang Cao, Robert L. Logan IV, Di Lu, Shihao Ran, Ke Zhang, Joel R. Tetreault, Aoife Cahill, Alejandro Jaimes	BUMP: A Benchmark of Unfaithful Minimal Pairs for Meta-Evaluation of Faithfulness Metrics.	CoRR	2022	DBLP DOI BibTeX RDF
10	Jennifer Thoegersen, Pia Borlund	Researcher attitudes toward data sharing in public data repositories: a meta-evaluation of studies on researcher data sharing.	J. Documentation	2022	DBLP DOI BibTeX RDF
10	Alva Linhagen, Anton Björnqvist, Peter Berggren	A Meta-evaluation of Swedish Evaluations of COVID-19 Pandemic Management.	ISCRAM	2022	DBLP BibTeX RDF
10	Jian Wang, Qianqian Ma, Hu-Chen Liu	A meta-evaluation model on science and technology project review experts using IVIF-BWM and MULTIMOORA.	Expert Syst. Appl.	2021	DBLP DOI BibTeX RDF
10	Benjamin Marie, Atsushi Fujita, Raphael Rubino	Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers.	CoRR	2021	DBLP BibTeX RDF
10	Songhe Wang, Zheng Bao, Jingtong E	Armor: A Benchmark for Meta-evaluation of Artificial Music.	CoRR	2021	DBLP BibTeX RDF
10	Songhe Wang, Zheng Bao, Jingtong E	Armor: A Benchmark for Meta-evaluation of Artificial Music.	ACM Multimedia	2021	DBLP DOI BibTeX RDF
10	Yiran Chen 0013, Pengfei Liu 0003, Xipeng Qiu	Are Factuality Checkers Reliable? Adversarial Meta-evaluation of Factuality in Summarization.	EMNLP (Findings)	2021	DBLP DOI BibTeX RDF
10	Benjamin Marie, Atsushi Fujita, Raphael Rubino	Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Papers.	ACL/IJCNLP (1)	2021	DBLP DOI BibTeX RDF
10	Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi 0001, Jianfeng Gao 0001	GO FIGURE: A Meta Evaluation of Factuality in Summarization.	ACL/IJCNLP (Findings)	2021	DBLP DOI BibTeX RDF
10	Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi 0001, Jianfeng Gao 0001	Go Figure! A Meta Evaluation of Factuality in Summarization.	CoRR	2020	DBLP BibTeX RDF
10	Ameer Albahem, Damiano Spina, Falk Scholer, Lawrence Cavedon	Meta-evaluation of Dynamic Search: How Do Metrics Capture Topical Relevance, Diversity and User Effort?	ECIR (1)	2019	DBLP DOI BibTeX RDF
10	Pia Borlund	A study of the use of simulated work task situations in interactive information retrieval evaluations: A meta-evaluation.	J. Documentation	2016	DBLP DOI BibTeX RDF
10	Bogdan Babych, Anthony Hartley	Meta-evaluation of comparability metrics using parallel corpora.	CoRR	2014	DBLP BibTeX RDF
10	Anna Jordanous	Stepping Back to Progress Forwards: Setting Standards for Meta-Evaluation of Computational Creativity.	ICCC	2014	DBLP BibTeX RDF
10	Sudip Kumar Naskar, Antonio Toral, Federico Gaspari, Declan Groves	Meta-Evaluation of a Diagnostic Quality Metric for Machine Translation.	MTSummit	2013	DBLP BibTeX RDF
10	Bogdan Babych, Anthony Hartley	Meta-Evaluation of Comparability Metrics using Parallel Corpora.	Int. J. Comput. Linguistics Appl.	2011	DBLP BibTeX RDF
10	Julián Urbano	Information Retrieval Meta-Evaluation: Challenges and Opportunities in the Music Domain.	ISMIR	2011	DBLP BibTeX RDF
10	Jesús Giménez, Lluís Màrquez	Asiya: An Open Toolkit for Automatic Machine Translation (Meta-)Evaluation.	Prague Bull. Math. Linguistics	2010	DBLP BibTeX RDF
10	Lutz Bornmann, Loet Leydesdorff, Peter van den Besselaar	A meta-evaluation of scientific research proposals: Different ways of comparing rejected to awarded applications.	J. Informetrics	2010	DBLP DOI BibTeX RDF
10	Dominic Espinosa, Rajakrishnan Rajkumar, Michael White 0001, Shoshana Berleant	Further Meta-Evaluation of Broad-Coverage Surface Realization.	EMNLP	2010	DBLP BibTeX RDF
10	Lutz Bornmann, Loet Leydesdorff, Peter van den Besselaar	A Meta-evaluation of Scientific Research Proposals: Different Ways of Comparing Rejected to Awarded Applications	CoRR	2009	DBLP BibTeX RDF
10	Gregory A. Sanders, Sherri L. Condon	Probability of successful transfer of low-level concepts via machine translation: a meta-evaluation.	PerMIS	2009	DBLP DOI BibTeX RDF
10	Billy Tak-Ming Wong, Chunyu Kit	Meta-evaluation of Machine Translation Using Parallel Legal Texts.	ICCPOL	2009	DBLP DOI BibTeX RDF	Machine Translation Evaluation, Legal Text, BLIS, BLEU, ATEC
10	Chris Callison-Burch, Cameron S. Fordyce, Philipp Koehn, Christof Monz, Josh Schroeder	Further Meta-Evaluation of Machine Translation.	WMT@ACL	2008	DBLP BibTeX RDF
10	Ana Carolina Letichevsky, Marley M. B. R. Vellasco, Ricardo Tanscheit, Reinaldo C. Souza	A New Approach to Meta-Evaluation Using Fuzzy Logic.	Intelligent Educational Machines	2007	DBLP DOI BibTeX RDF
10	Chris Callison-Burch, Cameron S. Fordyce, Philipp Koehn, Christof Monz, Josh Schroeder	(Meta-) Evaluation of Machine Translation.	WMT@ACL	2007	DBLP BibTeX RDF
10	Ana Carolina Letichevsky, Marley Maria Bernardes Rebuzzi Vellasco, Ricardo Tanscheit	A Fuzzy Inference System for Meta-Evaluation.	ISDA	2007	DBLP DOI BibTeX RDF
10	Horacio Saggion, Dragomir R. Radev, Simone Teufel, Wai Lam	Meta-evaluation of Summaries in a Cross-lingual Environment using Content-based Metrics.	COLING	2002	DBLP BibTeX RDF
10	J. A. Long, J. A. Richards, C. E. Seko	The Canadian Institute for Health Information Data Quality Framework, Version 1: A Meta-Evaluation and Future Directions.	IQ	2001	DBLP BibTeX RDF
10	Robert Balzer, Neil M. Goldman, David S. Wile	Meta-Evaluation as a Tool for Program Understanding.	IJCAI	1977	DBLP BibTeX RDF
10	Carl Hewitt, Peter Boehler Bishop, Irene Greif, Brian Cantwell Smith, Todd Matson, Richard Steiger	Actor Induction and Meta-Evaluation.	POPL	1973	DBLP DOI BibTeX RDF
9	Eduard H. Hovy, Margaret King, Andrei Popescu-Belis	Principles of Context-Based Machine Translation Evaluation.	Mach. Transl.	2002	DBLP DOI BibTeX RDF	MT evaluation, context-based evaluation, quality models, evaluation metrics
6	Francis Jambon, Caroline Golanski, Pierre-Jacques Pommier	Évaluation des dispositifs mobiles: sur le terrain ou en laboratoire ?	IHM	2006	DBLP DOI BibTeX RDF	reality testing, mobility, remote usability testing, automated usability evaluation