Checklist Prior to Fielding

Top  Previous  Next

1.  Is this an appropriate study for ACBC?  Appropriate studies typically involve about five or more attributes.  Studies with very few attributes (such as Brand-Package-Price studies) are often more appropriately studied using standard CBC.

 

2.  Have you used the Test Design capability on the Design tab to have the software generate dummy (robotic) respondents that answer randomly?  Have you examined the attribute level frequency report for these dummy test records?  Does each non-BYO level occur at a minimum of 2 times (3 times, preferably)?

 

3.  Does each respondent evaluate no more than about 7 levels per attribute?  If more than about 7 levels per attribute are being studied, then a constructed list should be used and respondents should evaluate the most preferred/relevant levels.

 

4.  If you are studying a large number of attributes or levels per attribute (such that using constructed lists to discard levels and attributes from consideration within the ACBC survey is necessary), is your sample size sufficient to stabilize the parameters across the full list of attributes and levels?  Are you willing to assume that discarded attributes are entirely unimportant to the respondent?

 

5.  When you take the questionnaire, do the Unacceptables and Must-Have questions properly identify (using correct "at least" or "at most" phrasing) the levels you have consistently selected or rejected?   (This confirms you set the correct worst to best or best to worst attribute direction).

 

6.  Take a practice questionnaires yourself, making sure that the computed part-worths reflect the preferences you expressed in the questionnaire.

 

7.  Have you asked colleagues or a small convenience sample of target respondents to take the survey?  Have you debriefed them regarding their experiences and analyzed their data?  Were any sections/instructions confusing?  Do the computed part-worth utilities reasonably reflect their individual preferences?

 

8.  Have you fielded the study (a "soft launch") among a few target respondents, examining the same issues as directly above?

 

Page link: http://www.sawtoothsoftware.com/help/lighthouse-studio/manual/index.html?checklistpriortofielding.html