Introduction

After the success of the first workshop of Evaluation methods of Knowledge Discovery in Data-EvalECD, in conjunction with the 9th EGC conference - we propose to organize the second edition of the EvalECD workshop, in conjunction with the 10th EGC conference, (26-29 January 2010).

The workshop aims at discussing the evaluation techniques that are used in different domains and showing the advantages and the drawbacks of these techniques. Such a workshop, open to different communities of EGC conference, allows enriching and/or generalizing works that are presented in more specific workshops (like, TIA'05 and COLING'08 on Automatic Language Processing). This workshop will offer the opportunity to propose first solutions for the problems caused by the variation of evaluation techniques of knowledge discovery and data integration.

Following this workshop, we plan to prepare a special issue of RNTI journal from a selection of good papers of the EvalECD workshop.

Topics

• Evaluation protocols (automatic, human, semi-auto, etc.)
• Evaluation measures (Accuracy, Recal, Precision, F-Measure, ROC Curves, etc.)
• Chalenge evaluations (TREC, DEFT, CLEF, DUC, INEX, Pascal, OAEI, etc.)
• Tuning : feature spécifications
• Builing of benchmarks
• Validation of Knowledge Discovery in Data Bases
• Human expertize in NLP and CI
• Evaluation in Data Integration and Data Reconciliation
• HMI model evaluations (ergonomic, visualisation)