Have an idea?

Visit Sawtooth Software Feedback to share your ideas on how we can improve our products.

ACBC Simulation results have changed

Hi all,

I am a bit worried. I ran a whole lot of simulations a few weeks back, and reported on them. I was asked to run a few more, and tried to replicate my old simulations to ensure I was setting everything up the same way, and I CANNOT replicate my old results.

The utilities and importances are all correct, but when I run the simulations I get different results from what I got before - some only minor differences, others fairly major. I saved my output from the earlier simulations and have checked against them - everything is identical except the results. Same weights, same sample, same segments, but different results.  The results are (mostly) the same for my price sensitivity analysis (only 0.1 out in some cases), but are out quite a bit for ALL of my competitive sets.

It is an ACBC with an alternative-specific design, and I am using randomized first choice, with several continuous price variables. Why have my results changed? We'll be handing over the simulator soon and they are not going to be able to match what I have reported.
asked Jun 11, 2021 by Sharon Morris (385 points)
edited Jun 11, 2021 by Sharon Morris
Can you elaborate on what software you're using and whether you've done any software updates since your previous simulations?
I am using the Lighthouse Simulator. I don't THINK I have done an update since the previous simulations, but it is possible (I definitely updated when the WTP calculator was released, but whether that was before or after I did my simulations I'm not sure). Would this change the results?
I would suggest sending your files to support so that we can look closer at the project and see what may be responsible for the changes.

Your solution to the original question

Please only use this to answer the original question. Otherwise please use comments.
Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
Anti-spam verification:

To avoid this verification in future, please log in or register.