Assistive technology: Where are we going?
The lives of blind people have been changed by new technology. Peter White and Lucy Edwards head to a Microsoft research centre to talk about new developments and the future.
Pictured: Peter white with Hector Minto, Senior Technology Evangelist at Microsoft, and journalist and YouTuber Lucy Edwards.
The lives of blind and visually-impaired people are being transformed by technology. But where are the changes heading?
Peter White is joined by YouTuber Lucy Edwards as they head to a Microsoft research centre, to get her take on life as a digital native. As a blind person, what does she want from the technology that's around the corner?
Microsoft's "Senior Technology Evangelist" Hector Minto explains his job title - and takes Peter and Lucy through some of the tools of their "Seeing AI" app. He addresses their questions about the current state of technology which is for, and increasingly designed by, the blind and visually impaired.
We also hear from Saqib Shaikh, who was a driving force behind Microsoft's approach to technology for the blind and VI and from Dave Williams, who trains people to use assistive technology.
Presenter Peter White.
Producer Kevin Core.
Last on
More episodes
In Touch Transcript: 03-07-2018
THE ATTACHED TRANSCRIPT WAS TYPED FROM A RECORDING AND NOT COPIED FROM AN ORIGINAL SCRIPT.听 BECAUSE OF THE RISK OF MISHEARING AND THE DIFFICULTY IN SOME CASES OF IDENTIFYING INDIVIDUAL SPEAKERS, THE 麻豆社 CANNOT VOUCH FOR ITS COMPLETE ACCURACY.
听
IN TOUCH 鈥� Assistive technology:听 Where are we going?听
TX:听 03.07.2018听 2040-2100
PRESENTER:听 听听听听听听听 PETER WHITE
PRODUCER:听 听听听听听听听听听 KEVIN CORE
听White
Anyone who listens regularly to this programme will know that digital technology is having a vast impact on many blind and partially sighted people鈥檚 lives.听 It鈥檚 helping us to read, to get around, to identify objects 鈥� doing the job of sight in other words.听 We frequently feature individual developments but today is more about direction of travel.听 Where are we going with this and what impact is it going to have on the lives of all of us in the future?
听
So, we鈥檙e heading to the headquarters of one of the biggest, although by no means the only, players in this field.听 Microsoft is an international name and amongst their research and development a good deal of effort is going into working up kit aimed at us.听 And we鈥檙e going to a research centre in Reading.
听
Well I鈥檓 taking with me Lucy Edwards because Lucy is a representative of the generation who鈥檚 going to be using this stuff for the next 60 or 70 years.
听
Hi, Lucy.
听
Edwards
Hi, Peter, lovely to see you again.
听
White
Good to see you too.听 So, have you got some鈥�
听
So, Lucy, first of all, how much do you use this kind of technology and what do you use it for?
听
Edwards
Well Pete, I鈥檓 a freelance journalist and I鈥檓 primarily on You Tube quite a lot, I鈥檓 a creator on there, so I use the technology an awful lot for my work.
听
White
And you were particularly famous for your make-up tutorials weren鈥檛 you because they went viral.
听
Edwards
Yes, Blind girl does her own make-up, was really popular because I don鈥檛 think people expected a blind girl to be on a video platform applying her make-up because it鈥檚 such a sighted thing to do I think.听 So, smashing stereotypes there.
听
White
And in the longer term what do you want to get from this trip?
听
Edwards
I think the future of technology ahead of me, as a blind user, is very daunting and I think because I have to use this technology for the rest of my life what does it hold, where am I going to be with it in the next 10, 15 years.
听
Actuality 鈥� Introductions
听
White
Well we鈥檙e in the office of Hector Minto, who rejoices in the title of Senior Technology Evangelist for Microsoft.听 What does it mean?
听
Minto
One of the things about accessibility and assistive technology is people don鈥檛 know they care about it until they know about it but when they know about it they really care about it.听 You do need to break the door down a bit to get people to care about accessibility and so it needs somebody who can really go out and evangelise about it.
听
White
Where does developing this kind of equipment sit in your portfolio 鈥� if I can put it more crudely 鈥� what sort of proportion of your budget does it take up?
听
Minto
The easy way to describe this is that the design around disability in general at Microsoft is a core value in all of the design teams.听 And that鈥檚 not always been the case.听 We have gone through a long history with accessibility and with technology in general, where the accessibility for people with disabilities has been an obligation put on companies to make products accessible.听 We鈥檙e now at the stage, with Microsoft, where we see it as an opportunity.听 An opportunity to design in at the start.听 So, it doesn鈥檛 have a set budget as such, it鈥檚 just more of a kind of core cultural value.
听
White
But you say that you are now taking it seriously but this hadn鈥檛 always been the case, are you, to some extent, in fact, playing catch up with the companies who took it seriously from the start?
听
Minto
I think what we recognise is a burgeoning third party assistive technology world grew up around the technology work and Microsoft allowed that to happen.听 What we can definitely say has happened in the last couple of years is a reinvestment from Microsoft and the understanding that as technology becomes more global, as the cost that people are willing to pay for specialist solutions around the world, as that whole relationship changes there鈥檚 become a requirement on us to invest again on making the core built in solutions even better.听 I would 鈥� I think it鈥檚 fair to say that we allowed other people to take the lead on this in the past.听 We now want to lead the market on assistive technology and actually encourage more people to create even more amazing tools.
听
Edwards
So, updates scare me, as a visually impaired user of technology, even as a 22-year-old they scare me, I鈥檓 on Jaws 16, you鈥檙e quite vocal about working with Freedom Scientific and developing Microsoft Edge with that but why do Freedom Scientific have to script for Edge, why can鈥檛 it be integral to Jaws?
听
White
And this is 鈥� just to make it clear 鈥� this is just a way of accessing the internet, browsing?
听
Edwards
Yeah.
听
Minto
One of the challenges for, let鈥檚 say Jaws, for VFO and for all assistive technology manufacturers now is that the world has become cloud based, you know, the rate of change of technology is increasing.听 So, as we do that we need to support the third party AT world to keep up.听 The voice of the consumer or the voice of the user is through our disability answer desk.听 When people report in through our disability answer desk we have a much earlier warning system for problems that are appearing and we now have great relationships with global partners on assistive technology to help them iron out the issues that are arising.听 And what we need to do is just make sure that the compatibility moving forward is increasingly better.
听
White
Seeing AI 鈥� AI 鈥� artificial intelligence 鈥� this is almost a catch all system, is that basically the idea?听 I think it鈥檚 been described to me as the kind of Swiss army knife of accessibility.
听
Minto
I think that鈥檚 a great description.听 It is a set of channels, a set of tools that can be used to narrate the world around you.听 So, for example, on the table here I have two cans 鈥� how does somebody who鈥檚 blind know where the barcode is an object to identify it?听 Well that鈥檚 difficult right?听 So鈥�
听
White
Yes you had to read it, you have to know where it is.
听
Minto
You have to know where it is.听 So, what actually happens, if we can just listen to this as I go round, I鈥檒l stop talking but as I twist the can in front of the camera I hear some beeps鈥�
听
Voice
Diet coke can 330 millilitres.
听
Minto
And I鈥檒l do it on the second can but I鈥檒l avoid the barcode at first.
听
Voice
Processing.听 Pepsi diet.
听
Minto
So, the beeps are about helping you locate it.
听
Edwards
Yes, so I鈥檓 a vegan and I鈥檓 also blind, so it鈥檚 kind of hard for me to read labels and maybe trust people to read the label out properly to me, maybe if it hasn鈥檛 got milk in or they haven鈥檛 noticed, so I think it鈥檚 really beneficial.听 I was jumping up and down last night doing it.
听
Minto
And when you read the barcode there is a more information button which will give you more information.听 Now what we want to do in the longer term is obviously work with the food manufacturers, work with maybe the local shops, the local businesses to put their barcode libraries up into the directory, so you can get even more information than is currently available.
听
White
One of the things we haven鈥檛 talked about yet is the whole business of blind people navigating, getting the information they need to get around.听 There have been various attempts to do this over the years, a lot of people have tried things out but actually in the real world most people are still getting around with either a guide dog or a white cane.听 Hector, Soundscape is Microsoft鈥檚 attempt to do this, so what鈥檚 different about it?
听
Minto
So, this is using 3D audio and cloud sourced maps and beacons in your community to give you extra information in 3D audio through a headset.听 Now it comes from your phone, so you connect to your telephone.
听
White
And Lucy, you鈥檝e been quite impressed.
听
Edwards
I really have, I think it鈥檚 the first app that I feel safe to use.听 Because of the 3D audio I鈥檓 hearing the beacon location on my right-hand side and that鈥檚 indicating that I鈥檓 hearing that a building is to the right of me and it鈥檚 really intuitive.
听
White
And again, you would hear something behind you, you鈥檇 hear the description of something behind you if that鈥檚 where it was because of the 3D?
听
Edwards
Yes, I would and so crossings, it tells me I鈥檓 coming up to them and so it鈥檚 really useful when navigating with a guide dog.
听
White
I mean one of the things that blind people, me included, often say about all this stuff you put in your ear is it鈥檚 all very well giving you this 鈥� all this information but you鈥檙e actually taking information away as well, the information that we get from our ears.听 That鈥檚 going to need quite some change of attitude isn鈥檛 it really, I mean you鈥檙e going to have learn how to do that.
听
Edwards
It鈥檚 really scary for me as a blind user to put headphones in when it鈥檚 my only mode and needing my extra sense that I need out there in the wide world and it is a bit scary but I think I鈥檓 going to have to get used to it.
听
White
So, let鈥檚 give it a go, let鈥檚 see you in action Lucy, you鈥檙e going to actually try this out for us.
听
Edwards
Yeah, okay.
听
Minto
So, using the voiceover on your phone you should be able to find the set a beacon button.
听
Edwards
Okay.
听
Voice
Starbucks 85 metres.
听
Minto
Okay and now you need to orient yourself, move yourself around, until you hear the ping.
听
Edwards
There.
听
Voice
Frankie and Benny鈥檚 360 metres鈥�
听
Edwards
Oh my gosh this is so weird.
听
Voice
Microsoft building鈥�
听
Edwards
Let鈥檚 go.听 Yeah, it鈥檚 over there, it鈥檚 telling me now that I鈥檓 approaching an intersection.听 The tapping is actually slightly distracting 鈥� I鈥檓 like ooh where am I.听 Oh my god I need to get used to this.听 Microsoft Building 3 is behind me?听 Yeah, I could definitely get used to it, I think it鈥檚 really overwhelming to start off with because you鈥檙e trying to navigate your dog and yourself and then sort of hear where all the buildings are in your head, you very much feel at one with the app.
听
Minto
Yeah, and when you press that and select that it will give you the objects that are in front of you鈥�
听
Edwards
Starbucks 85 metres鈥�
听
Minto
That鈥檚 correct.
听
Edwards
Microsoft building 鈥� I鈥檓 pointing guys to all the buildings around me.听 Oh my gosh this is so cool.
听
White
But it鈥檚 probably a little bit like getting your sight back, isn鈥檛 it鈥�
听
Edwards
It is a bit.
听
White
鈥ou鈥檙e suddenly being overwhelmed with information.
听
Edwards
With all this information, yeah, yeah definitely and sometimes I鈥檓 like ooh do I want that all at once, I don鈥檛 know, I鈥檓 going to have to get used to it.
听
White
Well one of the things that we鈥檝e touched on is quite often the major breakthroughs in this area have been by visually impaired people because we know the kinds of problems we鈥檙e trying to solve.听 Saqib Shaikh is a senior software engineer with Microsoft and he鈥檚 joining me on a line from outside of the office.
听
Saqib, one of the things that people often say is something they couldn鈥檛 do is what inspired them to try to change things, I wonder what are the things that maybe that you couldn鈥檛 do, the frustrations that you found perhaps early on?
听
Shaikh
I know my own problems better than anyone whether that is those inaccessible websites we all encounter, being able to read things out in the world or those social situations, like weddings, when you鈥檙e standing in a corner trying to mingle.听 And I could go on.听 There are so many of these little challenges.听 And over time I realised that technology has the power to change people鈥檚 lives.听 As I see the new generation of technology, like AI, I think how can we apply some of that to try and somehow smooth out some of the rough edges of life.听 Like somebody using the handwriting recognition to read a letter that was sent to her when she still was able to see.
听
White
How did the project start, how did you get the thing going?
听
Shaikh
So, I鈥檝e been at Microsoft a number of years working on various mainstream projects but then we had this hackathon, which is a whole week where we were allowed to work on anything that interested you.听 I took one of my side projects at the time to look at how AI can be used to help a blind person and that鈥檚 how Seeing AI came about.听 The next year at the hackathon I found some colleagues in Silicon Valley who were able to pitch in and make it even, even better and it took off from there until it is the product that it is today.
听
White
So, with Seeing AI as a specific example, what do you see as the potential?
听
Shaikh
When I look to the future I鈥檇 love to imagine a world where even if I鈥檓 alone I have the same information as when I鈥檓 with a friend acting as a sighted guide, telling me all the things that are around me and knowing what things are of interest to me.听 And of course, we鈥檒l still want to be with our friends and family but sometimes you want that even when you鈥檙e alone.
听
White
Hector Minto, can I just ask you another question which actually comes from a listener, from a guy called Dave Williams?听 Narrate is great but, he says, it鈥檚 not compatible with many of the games and apps in the Microsoft store.听 So, he sits down to play a game with his nine-year-old and there鈥檚 a cliff edge where his fun stops and Arlo, his son, his fun goes on.
听
Minto
We are trying to standardise the design principle so that everything that people design and put on the store, the millions of software authors worldwide, start designing around principles that make things accessible.听 So, the tools that we have for designing software, that鈥檚 available via the store, should more and more design in great accessibility.听 So, we鈥檙e hoping that that starts to happen.听 We have exactly the same problem with websites, of course, right?听 The law and the regulations came in that said websites had to be accessible and yet we sit here today 20 years after the regulations came in with only 3% of the websites.听 The minute other people are allowed to author then clearly we run across problems with design principles and accessibility.听 So, we鈥檙e trying to coach that and actually design it in so that they cannot design stuff that it鈥檚 inaccessible, is the strategy.听 But it鈥檚 extremely difficult to achieve that.听 On our own apps鈥�
听
White
When can Dave play games with his nine-year-old?
听
Minto
When the voice of people with disabilities is so loud that they cannot 鈥� or the law, or the regulations demand that it cannot be launched as inaccessible.
听
Edwards
Are you not, as Microsoft, the main voice for us as a disabled community?
听
Minto
Yeah, well we want to increasingly be but Microsoft鈥檚 mission, core mission, is to empower other people to design great solutions.听 Interestingly, as people go to the cloud, as people start to deliver their software via the cloud and via a set list of tools from all of the suppliers, what will happen is we can hopefully start to design in accessibility at the outset.听 We want to get to that world with software where it鈥檚 almost difficult not to create accessible materials.
听
White
Hector Minto, Microsoft鈥檚 Senior Technology Evangelist.
听
So, back in the studio, what does all that tell us about where we are and where we鈥檙e going with assistive technology?听 Well we decided to ask Dave 鈥� remember him?听 He鈥檚 the blind dad who was stuck at the starting gate while his nine-year-old son is racing ahead with computer games.听 But Dave Williams is also someone who鈥檚 worked for assistive technology companies, he trains people to use it and he鈥檚 an early adopter of new kit himself.听 So, Dave Williams, I think Lucy will have struck a chord with people when she talked about sudden changes in equipment and upgrades which can make stuff that we鈥檝e come to depend on unusable.听 Is that something we just have to live with or should more be done to help?
听
Williams
I think more can be done.听 My concern is that if we rely exclusively on the accessibility that is built into mainstream technology we risk going into work or going into school tomorrow, switching it on and maybe it doesn鈥檛 work.听 And then there鈥檚 also the question of what role does accessibility play in the testing process.听 Smartphone manufacturers have pushed out updates and suddenly blind people find they can鈥檛 answer a call.听 And you wouldn鈥檛 accept that if you were sighted, would you?
听
White
We heard about various bits of equipment there and of course lots of other companies are making things, there are loads of apps, it鈥檚 sometimes said the developers pursue areas that interest them rather than the ones that blind consumers need solving.听 Are we getting actually what we need?
听
Williams
In some cases, yes, in some cases, no.听 So, the idea that you鈥檝e got this out of the box accessibility, we definitely do need that.听 Something like Soundscape, as we heard, there鈥檚 a lot of information going on there and some people will find that really overwhelming and that鈥檚 going to take some time to adjust and there will be some people who just won鈥檛 use it because it鈥檚 too much.听 I mean just listening to it it鈥檚 quite stressful isn鈥檛 it sometimes when you鈥檙e bombarded with lots of streams of information, particularly when you鈥檙e trying to navigate with your cane and your dog.
听
White
Dave, of course, you raised the issue of computer games specifically and the problems you had in keeping up with your nine-year-old son, what did you think of Hector鈥檚 response?
听
Williams
I don鈥檛 think it鈥檚 a fair comparison to say well there are inaccessible webpages out there, well of course there are inaccessible webpages out there but Microsoft don鈥檛 run the web but they do run their own app store, so they get to choose what goes into store and which apps are featured.听 And there is a certification process that software developers have to go through if they want to be listed in Microsoft store, Apple store or Google store, come to that, your app has to be age rated to ensure the content is suitable for a certain age group, it also has to be secure 鈥� they can鈥檛 steal your information 鈥� and stuff like that.听 And I would like to see accessibility as part of that vetting process.
听
White
Dave Williams, thanks very much indeed.
听
What do you think?听 Are you getting your money鈥檚 worth?听 Will this help all visually impaired people or just those with fairly high skills or perhaps people in work who can get funding?听 You can call our Actionline on 0800 044 044 for 24 hours after the programme.听 You can email intouch@bbc.co.uk or you can click on contact us, if you do have these skills, on our website to get more information and download tonight鈥檚 and other editions of the programme.
听
That鈥檚 it from me, Peter White, producer Kevin Core and the team, goodbye.
Broadcast
- Tue 3 Jul 2018 20:40麻豆社 Radio 4
Download this programme
Listen anytime or anywhere. Subscribe to this programme or download individual episodes.
Podcast
-
In Touch
News, views and information for people who are blind or partially sighted