https://gds.blog.gov.uk/2014/03/18/organ-donor-register/

One link on GOV.UK – 350,000 more organ donors

Last autumn we shared early results of testing various versions of the GOV.UK ‘Thank You’ page. First introduced a year ago, people see this page once they’ve bought their tax disc via GOV.UK. People are generally more open to trying out new stuff after completing a successful transaction, so we’ve been using this page to encourage as many  as possible to join the NHS organ donation register.

 Over 350,000 people have now registered for organ donation via this one link on GOV.UK [since Jan 2013]

Via a comment on that earlier blog post, Claire reminded me recently that we’d not shared the final results of the experiment, notably which type of message was most effective at persuading people to register.

What we tested

Working with the Cabinet Office Behavioural Insights team, DVLA and NHS Organ Register team, we tested eight different calls to action with a total of over 1,000,000 visitors to the tax disc ‘Thank You’ page.

The eight variants below appeared at random, and we worked closely with the NHS Organ Donation team to see which one generated the most completed registrations. This is known as A/B testing.

Variants of Done page for organ donation 1 to 4Variants of Done page for organ donation 5 to 8

What we found

Here are the results, showing which variant was most effective at getting people to actually register for organ donation. The percentages are not just for click-throughs; they’re actual organ donor registrations.

Bar chart showing which variant was most effective at driving organ donation registrations

The most successful variant introduced concepts of reciprocity and fairness by asking people: “If you needed an organ transplant, would you have one? If so please help others.

I don’t feel qualified to speculate as to the reasons why this particular message performs best – data trumps intuition. But, feel free to add your thoughts via the comments below.

We ended the experiment in the autumn, and have left this “reciprocity”  message in place. Meanwhile, the new digital team at DVLA has got on with updating the tax disc service.

Since the DVLA tax disc online service is used by around 2m people every month, the impact of such optimisation is significant.

Extrapolated over 12 months, some 96,000 more people will register compared with the original call to action. (“Please join the NHS Organ Donor Register“). In December the former Cabinet Office Behavioural Insights team published a paper with more statistical detail on the experiment.

In total over 350,000 people have registered for organ donation via this one link on GOV.UK since we added the original call to action just over a year ago.

Stuff worth doing.

Follow Tom on Twitter, join the wider conversation with @GDSTeam and don’t forget to sign up for email alerts.


16 comments

  1. john

    Great initiative, but I'm confused by youer explanation.

    Option 7 was most successful because it achieved a sign-up rate of just over 3%. 3% of what? 3% of people who clicked through on that option or 3% of all click throughs?

    Isn't the most successful variant, simply the one that yields the most sign-ups rather than a percentage?

    Link to this comment Reply
  2. john

    Also, I notice that variant three with the logo performed well, but you didn't test it with alternative wordings. Given it's such an important cause, might it be worth adding the logo to the successful wording variant and see if you get better results?

    Link to this comment Reply
  3. Christopher Fahey

    Great test. That said, my intuition said that 5 and 7 would have been the best, so for me at least data didn't actually trump intuition. :-)

    Link to this comment Reply
  4. Christopher Fahey

    John: 3% of people who *saw this screen* went on to actually finish signing up for organ donation. It doesn't matter what path they took to get there. So to answer your second question, the variant with the most sign-ups *is* the one with the highest percentage of people who signed up.

    Link to this comment Reply
    • john

      Thanks for the clariifcation. But that suggests that six of the variants had very similar success, I wonder if that means there's a limit to the conversion rate or if that there may be room for tweaking the design to get an even higher response.

      Link to this comment Reply
  5. Phil

    Wow, so you got a conversion rate of 22% of all viewers of the thank you screen. That's pretty good!

    Link to this comment Reply
  6. Keith C

    You might get wear out idc so can be useful to rotate. This, from 1983, is pretty useful guide to copy-testing
    http://www.amazon.co.uk/Ogilvy-Advertising-David/dp/1853756156 (er – other retailers are available)
    Keith

    Link to this comment Reply
  7. Dev

    It is good to know that AB testing is doing something great especially when it comes to humanitarian ground

    Link to this comment Reply
  8. Sara

    It is good to see that online marketing is doing some thing positive and contributing to the society. Good effort.

    Link to this comment Reply
  9. Michael

    Very interesting article and what a great result.

    I am sure the author and others know that the importance of reciprocity as a stimulus to action was identified and popularised by Prof Robert Cialdini (RSA has great audio of his lecture.)

    Cialidin also highlights the importance of "social proof" : we are likely to do the same things that other people do, when we identify them as being similar to us in some relevant respect.
    So on his basis it would be interesting to see if you got an increase in conversions by saying at bottom of current page, something like

    Since March 2013 over 350,000 people who came here to buy a tax disc have registed as organ doners.

    Link to this comment Reply
  10. David

    Over 350,000, this is awesome! Great test and a great contribution to the society.

    Link to this comment Reply
  11. abpmr

    Over 350,000, this is awesome! Great test and a great contribution to the society.

    Link to this comment Reply
  12. claire toplis

    wow over 350,000 what a great job , here is to many mores

    Link to this comment Reply
  13. o-boulo.com

    Any initiative to increase organ donation should be praised. Well done!

    Link to this comment Reply

Leave a comment