Are there any objective methods of assessment or standardized tests available to measure the effectiveness of a software that does pattern recognition?
Yes, there are many methods. You would need to specify which model you're using, because it can vary.
- I recommend reading Pattern Recognition and Machine Learning by Christopher Bishop.
- This is also discussed in Chapter 5 on Credibility, and particularly section 5.5 "Comparing data mining methods" of Data Mining: Practical Machine Learning Tools and Techniques by Witten and Frank (which discusses Weka in detail).
- Lastly, you should also have a look at The Elements of Statistical Learning by Hastie, Tibshirani and Friedman which is available for free online.