In this paper we present work in progress towards implementing a benchmark called BEFRIEND (BEnchmark For Reverse engInEering tools workiNg on source coDe), with which the outputs of reverse engineering tools can be evaluated and compared easily and efficiently. Such tools are e.g. design pattern miners, duplicated code detectors and coding rule violation checkers. BEFRIEND supports different kinds of tool families, programming languages and software systems, and it enables the users to define their own evaluation criteria.
BibTeX:
@InProceedings{FFG08,
author = {F{\"u}l{\"o}p, Lajos Jen\H{o} and Ferenc, Rudolf and Gyim{\'o}thy, Tibor},
title = {Towards a Benchmark for Evaluating Design Pattern Miner Tools},
booktitle = {Proceedings of the 12th European Conference on Software Maintenance and Reengineering (CSMR 2008)},
year = {2008},
pages = {143--152},
address = {Antwerp, Belgium},
month = apr,
publisher = {IEEE Computer Society},
doi = {10.1109/WCRE.2008.18},
keywords = {tool evaluation, Benchmark, reverse engineering tools},
url = {http://ieeexplore.ieee.org/document/4656431/},
}