How Obama Raised $60 Million by Running a Simple Experiment – The Optimizely Blog

Lessons Learned

  1. Every visitor to your website is an opportunity. Take advantage of that opportunity through website optimization and A/B testing.
  2. Question assumptions. Everyone on the campaign loved the videos. All the videos ended up doing worse than all the images. We would have never known had we not questioned our assumptions.
  3. Experiment early and often. We ran this experiment in December of 2007 and reaped the benefits for the rest of the campaign. Because this first experiment proved to be so effective we continued to run dozens of experiments across the entire website throughout the campaign. 

 

Lots of great lessons in this post on how the Obama campaign used multivariate testing to optimize. I’ve learned in my own testing that you can spend all the time in the world trying to get inside the mind of your users, and doing what you think makes sense only to find the exact opposite is what ultimately works.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: