Trade-offs between formative and summative evaluation - Revision history

Usabart at 02:50, 1 March 2011

2011-03-01T02:50:05Z

Alan at 21:14, 21 February 2011

2011-02-21T21:14:27Z

Usabart: Created page with "Formative evaluation is quicker and cheaper to conduct than summative evaluation, and the results are more straightforward. However, the method is less suitable for adaptive syst..."

2011-02-21T19:09:59Z

Created page with "Formative evaluation is quicker and cheaper to conduct than summative evaluation, and the results are more straightforward. However, the method is less suitable for adaptive syst..."

New page

Formative evaluation is quicker and cheaper to conduct than summative evaluation, and the results are more straightforward. However, the method is less suitable for adaptive systems (including recommender systems), because it is hard to find out what exactly causes (problems with) the usability or user experience. In [[summative evaluation]] you need to define hypotheses beforehand, you can only focus on a few aspects at a time, and the analysis is more complex. You also need more test users to ascertain adequate statistical power. On the other hand, it is easier to test adaptive systems because you can single out the effect of specific features. Moreover, the results of summative evaluation are more generalizable and can be statistically validated.

← Older revision		Revision as of 02:50, 1 March 2011
Line 1:		Line 1:
−	~~'''~~Formative evaluation~~'''~~ is quicker and cheaper to conduct than summative evaluation, and the results are more straightforward. However, the method is less suitable for adaptive systems (including recommender systems), because it is hard to find out what exactly causes (problems with) the usability or user experience. In [[summative evaluation]] you need to define hypotheses beforehand, you can only focus on a few aspects at a time, and the analysis is more complex. You also need more test users to ascertain adequate statistical power. On the other hand, it is easier to test adaptive systems because you can single out the effect of specific features. Moreover, the results of summative evaluation are more generalizable and can be statistically validated.	+	[[Formative evaluation]] is quicker and cheaper to conduct than summative evaluation, and the results are more straightforward. However, the method is less suitable for adaptive systems (including recommender systems), because it is hard to find out what exactly causes (problems with) the usability or user experience. In [[summative evaluation]] you need to define hypotheses beforehand, you can only focus on a few aspects at a time, and the analysis is more complex. You also need more test users to ascertain adequate statistical power. On the other hand, it is easier to test adaptive systems because you can single out the effect of specific features. Moreover, the results of summative evaluation are more generalizable and can be statistically validated.
	[[Category:Evaluation]]		[[Category:Evaluation]]
		+	[[Category:User-centric evaluation]]

← Older revision		Revision as of 21:14, 21 February 2011
Line 1:		Line 1:
−	Formative evaluation is quicker and cheaper to conduct than summative evaluation, and the results are more straightforward. However, the method is less suitable for adaptive systems (including recommender systems), because it is hard to find out what exactly causes (problems with) the usability or user experience. In [[summative evaluation]] you need to define hypotheses beforehand, you can only focus on a few aspects at a time, and the analysis is more complex. You also need more test users to ascertain adequate statistical power. On the other hand, it is easier to test adaptive systems because you can single out the effect of specific features. Moreover, the results of summative evaluation are more generalizable and can be statistically validated.	+	'''Formative evaluation''' is quicker and cheaper to conduct than summative evaluation, and the results are more straightforward. However, the method is less suitable for adaptive systems (including recommender systems), because it is hard to find out what exactly causes (problems with) the usability or user experience. In [[summative evaluation]] you need to define hypotheses beforehand, you can only focus on a few aspects at a time, and the analysis is more complex. You also need more test users to ascertain adequate statistical power. On the other hand, it is easier to test adaptive systems because you can single out the effect of specific features. Moreover, the results of summative evaluation are more generalizable and can be statistically validated.
		+	[[Category:Evaluation]]