Have an idea?

Visit Sawtooth Software Feedback to share your ideas on how we can improve our products.

Relative D-efficiency and preference model in ACBC

Is it possible to include relative d-efficiency in ACBC design as suggested by Kuhfeld et al. (1994)? I'm wondering because a comparison of more than one design does not seem possible due to the adaptive design algorithm of ACBC? The "D-Effiency" Tab does only show absolute D-Efficiency which Kuhfeld et al. do not recommend to use.

Also, I'm confused about the preference model ACBC uses. Is it additive only or does it somehow include deterministic and stochastic elements?

Thanks for your help!
asked Mar 22, 2018 by Tim Geyer (270 points)

1 Answer

0 votes
Best answer
ACBC's designer has a specific way of selecting the composition of product concepts, described in good detail in the manual.  Although we use d-efficiency to help guide the designer, d-efficiency is just one of the multiple goals that are traded off.  One of the overriding goals for the designer is to over-sample the levels picked in the BYO section of the survey; which obviously is at odds with traditional d-efficiency metrics.

Regarding the modeling of the data, we use MNL with its additive compensatory assumption & RUT (random utility theory).  However, the way that we augment the data matrix when respondents state that a levels are unacceptable tends to push those unacceptable parameters a bit lower in utility than a standard CBC (without the data augmentation) would do.

As an example, if in the middle of the survey a respondent states that the color "red" is unacceptable (and we only allow the respondent to do so after we observe a pattern of that respondent consistently rejecting any product concept containing the red level), then we look forward to the concepts not yet evaluated by the respondent (but that are planned to be asked) and automatically reject any concepts containing the color red.  We replace the rejected concepts with new concepts that don't include red.
answered Mar 22, 2018 by Bryan Orme Platinum Sawtooth Software, Inc. (177,015 points)
edited Mar 22, 2018 by Bryan Orme