https://gds.blog.gov.uk/2016/08/09/designing-the-scottish-governments-service-standard-assessments/

Designing the Scottish government’s service standard assessments

I’m Katy. I’m currently working in the Digital Public Services and Business Transformation Division as part of the Scottish government’s Graduate Development Programme.

Over the past 4 months, I’ve been developing the service assessment process for the Scottish government’s service standard, Digital First.

The standard applies to all online services on our mygov.scot platform and has been around for a while. Over the last few months however, myself and my colleagues in the transformation team have been working out how we should assess new services against the Digital First standard.

To help us do this, we visited our English counterparts at the Government Digital Service (GDS) to see what we could learn from them.

Team exercise at Government Digital Service

Learning by example

At GDS, the Standards Assurance team is responsible for running the service assessments. We went to watch one, which turned out to be a good example of how a service team should present their service to the assessors. I’ve themed the main things we learnt below.

Spotting bad things earlier

We’re in the lucky position where we can implement measures early on to try and avoid some of the issues GDS has faced. For example, we now understand long assessments can be challenging for service teams, as assessors sometimes don’t get a full picture of a service. To try and avoid this, we’re thinking about encouraging assessors to attend team show and tells in the lead up to a service assessment so they have more background information.

Asking the right questions

We heard the kinds of questions GDS assessors ask and what kind of issues they’re interested in. They place lots of importance on having a process where service teams learn from users and use this to iterate and improve their product. This will be helpful when we run our first training session for our assessors, with GDS, as our assessors will get to hear first-hand the experiences of some GDS assessors.

Assessments can be time-consuming

We wanted to know where GDS gets its assessors from and how much of their time assessments take. We were also interested in how GDS ensures consistency across its assessments. At GDS, service assessors take time out of their regular work to help with assessments, which can be pretty time-consuming. To try and avoid too much disruption to everyday work, we’ll try to make sure assessors aren’t called on too often. We also think it’d be beneficial to have assessors from other departments and public bodies, so there is a wider understanding of what Digital First means across the public sector.  

Examples from far and wide

But we’re not just learning from GDS. It’s been interesting to watch the Australian Digital Transformation Office’s approach to service assessments, which focuses more on regular ‘check-ins’ than traditional assessments. The check-ins encourage collaboration between teams and assessors, working together to create a better service, which, after all, is what assessments are all about.

Process mapping using sticky notes

Using what we’ve learnt to design Scottish service assessments

We’re still developing a model that will work best for our public services. However, we already know that:

  • the Digital First assessment process shouldn’t be a burden for organisations
  • there’s a need for us to help service teams access advice, help and resources early on before they even begin a discovery, so they can check they’re on track to meet the Digital First service standard
  • our service teams need clarity over whether they’re meeting Digital First, and access to resources when they’re not

Next steps for Digital First’s service assessments

We recently hosted a workshop with some users from the types of organisations that will be using our assessment service to ask them how they think the process should work. We’ll be talking more about the outcomes from the day, and how we think the whole process will work, over on our Digital Blog soon. We’ve also recruited our first group of assessors and, with help from GDS, we’ll be training them this week.

Over the next few months we’ll continue to design and test our process to ensure it’s as effective and as helpful as it can be. The process we design will reflect the things we’ve learnt from the service assessments elsewhere while acknowledging the unique nature of digital in Scotland.

If you have any questions or comments, please email our team. You can also follow our progress via our own Digital blog.

3 comments

  1. Comment by Harmick posted on

    This is great to see, but I can't help but feel like it's all a little bit "doing it for the sake of it" when we know that GDS has already had great success. Why does Scotland have to build something totally separate, when Wales is covered here? Why waste time and resources in "workshopping" for the sake of it

    All seems a little bit indulgent to be completely honest.

  2. Comment by Hitesh Patel posted on

    Keep up the good work Katy!

  3. Comment by Craig Cockburn posted on

    Hi Katy and thanks for doing the great work although I am a little surprised at work being done for mygov.scot appearing on the GDS blog and not the mygov.scot blog. Hopefully it will appear there soon.

    Scotland needs its own site because user needs come first. When you are looking for content users want content which is relevant and useful and gov.uk does a great job for non devolved matters. However the extent of Scottish devolution and the increasing areas devolved to Scotland means that anything which is accurate for Scottish citizens and businesses is increasingly difficult to find and a bit like the arguments for the Scottish six, why should people in Scotland have to wade through content that isn't relevant? That certainly isn't an optimal user journey and as well as the devolved areas of responsibility there is also the obligation on the Scottish Government to have a Gaelic plan and I'm looking forward to Gaelic content on mygove.scot a bit sooner than on gov.uk which I assume is outwith the scope of the Gaelic Language (Scotland) Act 2005 10(2). There is also the ease of scalability in Scotland and joining up central and local government with only 32 local authorities.

    I would like to see some joined up thinking from GDS so that with the differing levels of devolution across the UK, people should be able to type in their postcode and get content relevant for them. Tell us where you are was very prominent in the old alphagov site, perhaps it is time to revive it?

    My concern of the Scottish approach and also GDS is too much on localised optimisation and not enough big picture. If you meet the standard then you go live, rather than being clear about the strategy about what service does it make sense to put live next from the citizen's perspective. Certainly judging by the GDS performance dashboard there has been a fair bit of money burned on services hardly anyone uses. Hopefully Scotland will take a more strategic view.

    Keep up the great work, but please be open about your failures - fail fast is an integral part of agile and if we don't understand where the failures have occurred then we are at risk of repeating them unecessarily.

    Craig