Definition from Usability First
“A study designed to make a comparison of 2 or more designs and that compares them by having one set of users try one design and another set of users try another design, measuring their performance for each design.”
Going further
I've curated 400+ definitions just like this one in a tiny dictionary. In this glossary you can easily access, search and understand 400+ terms that service designers and other innovators use.