Main content

Hallucinations, AI Apps

Judith Potts, founder of a support group for Charles Bonnet Syndrome, talks about the condition. Plus Jackie Brown, BCAB Chair, explains a range of AI apps and their significance.

When they lose their sight, many people start to suffer from visual hallucinations. These can be very distressing and many people suffer in silence as they fear it is the onset of mental illness. Doctors are often unaware that hallucinations are common in sight loss and the experience is called Charles Bonnet Syndrome - named after the Swiss naturalist who first described the condition in 1760. Judith Potts has founded of a new support group for Charles Bonnet Syndrome sufferers. Esme's Umbrella is named after Judith's mother and was suffered from CBS. Esme's Umbrella offers help and support for sufferers and their families. Judith has successfully lobbied the Royal College of Ophthalmologists who have agreed to agree to inform their patients about the condition.
Jackie Brown is the new chair of British Computer Association of the Blind, she talks to Peter White about a range of free Artificial Intelligence (AI) apps and their significance for blind people.
麻豆社 Washington Correspondent Gary O'Donoghue has been using the new Seeing AI app and is enthusiastic about its potential for VI people..
Richard Pryor is a retired social worker who fears that VI people, like him, who are not smart phone users risk being left behind as yjr technology develops.

Presenter: Peter White
Producer: Cheryl Gabriel.

Available now

20 minutes

Last on

Tue 28 Nov 2017 20:40

Transcript

THIS TRANSCRIPT WAS TYPED FROM A RECORDING AND NOT COPIED FROM AN ORIGINAL SCRIPT.听 BECAUSE OF THE RISK OF MISHEARING AND THE DIFFICULTY IN SOME CASES OF IDENTIFYING INDIVIDUAL SPEAKERS, THE 麻豆社 CANNOT VOUCH FOR ITS COMPLETE ACCURACY.听

听

IN TOUCH 鈥� Hallucinations, AI Apps

听

TX:听 28.11.2017听 2040-2100

听

PRESENTER:听 听听听听听听听 PETER WHITE

听

PRODUCER:听 听听听听听听听听听 CHERYL GABRIEL

听

听

White

Good evening. 听Tonight, the hallucinations which can blight the lives of many visually-impaired people. 听But why do they go undiagnosed and unexplained? 听And the latest smartphone app called Seeing AI, which is exciting some and alarming and puzzling others.

听

Clip

I really don鈥檛 know what an app is and AI for me, growing up in the country, is artificial insemination for dairy herds.听 So that鈥檚 where I start from.

听

White

Well we鈥檒l be finding out more about what it really does later in the programme.

听

But first, it鈥檚 reasonable to think that the main problem for people losing their sight is what they can鈥檛 see. 听But for a surprising number it can be more a question of what they do see, but which isn鈥檛 really there at all. 听Many report seeing frightening images which turn out to be hallucinations. 听The problem is they often go unexplained, either because doctors don鈥檛 know about them either, or because patients are too scared to mention them. 听And yet this phenomenon has been known about since the 18th Century. 听It鈥檚 got a name 鈥� Charles Bonnet Syndrome 鈥� after the Frenchman who first identified it. 听We鈥檝e often mentioned it here on In Touch. 听This is what Ruth, and first Margaret, described to us on a previous programme.

听

Margaret

I started to see these hallucinations but I didn鈥檛 want to tell anybody about them because they were rather scary and I thought people will think that there鈥檚 something wrong with my mind because nobody sees things like that.

听

White

And what were they?

听

Margaret

The first thing I actually experienced was blackberries in all the bushes, everywhere I went there was blackberries on the bushes as I looked.听 The other thing that does puzzle me a lot 鈥� my partner, if I鈥檓 looking across the room, his head goes down on his lap.

听

Ruth

We鈥檙e very lucky at the Isle of Wight Society for the Blind we had a talk recently from one of the island鈥檚 optometrists and he mentioned Charles Bonnet Syndrome to people.听 And out of the 20 in the room every single one had had some experience of it.

听

White

Really?

Ruth

And I think four or five of them had not mentioned to anybody before.听 So it鈥檚 incredibly common.听 I run the Macular Support Group on the Isle of Wight and I mean I always mention it to new members.听 Without fail they鈥檝e all had some experience of seeing something that isn鈥檛 there and nine times out of 10 they haven鈥檛 said anything.听 It鈥檚 often age related eye conditions so I think they often think there鈥檚 maybe something else going on in the background, so therefore they don鈥檛 speak out.听 And worry themselves unnecessarily a lot of the time.

听

White

And indeed as Margaret made clear, the key difference for her came when she knew what she was actually dealing with. 听And that鈥檚 what bothers journalist Judith Potts. 听Judith came in to the studio to tell me about her late mother, Esme鈥檚, experience.

听

Potts

Well mum, Esme, was in her early 90s, she was incredibly independent, lived on her own, despite her failing eyesight she completed the Telegraph cryptic crossword every day, which is more than I can do, and enjoyed all her friends.听 That is until one day when I was leaving her flat and she suddenly said 鈥� I do wish these people would get off my sofa, they go if I tap them on the shoulders.听 Well I didn鈥檛 know what to say.听 I said that there鈥檚 nobody on your sofa.听 And she said 鈥� well it鈥檚 not just that, they haven鈥檛 got any faces so that鈥檚 rather horrible and there鈥檚 this other creature.听 And she described like a gargoyle creature.

听

White

Because you mentioned and in a way quite matter of factly but I get guess 鈥� I mean how was she actually feeling about it?

听

Potts

Well I think this had been going on, I suspect, for some months鈥�

听

White

And she hadn鈥檛 told you.

听

Potts

鈥he hadn鈥檛 told me and I think she suddenly could bear it no longer.听 So she was getting very upset.听 And I thought well this must be some form of mental illness, possibly dementia with her age, but she didn鈥檛 seem to have any problems with her mind, just that she was seeing these things.听 She said 鈥� I鈥檓 pretty sure they鈥檙e not really there but I just wish they would go away because they are interrupting my life.

听

White

Having talked to her about it did you try to get her treatment?

听

Potts

I did, I rang her ophthalmologist who infuriatingly refused to discuss it with me.听 So I went to the GP, she鈥檇 never heard of it.听 And then I went to the optician who鈥檇 also never heard of it.听 So then, of course, I did what we鈥檙e always told not to do 鈥� I went on to the internet and found Dr Dominic Ffytche who is at King鈥檚 London and he is still the only globally acknowledged expert in Charles Bonnet Syndrome.听

听

White

And he has indeed been on this programme.听 But this is the mysterious thing about this, Judith, which I don鈥檛 quite understand, which is 鈥� I mean we鈥檝e talked about it, clearly the Macular Society is trying to draw attention to it, you鈥檙e trying to draw attention to it 鈥� why don鈥檛 people know, particularly why don鈥檛 ophthalmologists know?

听

Potts

I think it鈥檚 because there is nothing that can be done, so there is no doctor to whom they can refer and also it doesn鈥檛 fall into a particular medical category.听 So even if there was someone they don鈥檛 know who to refer.

听

White

But of course there is something that can be done because people can be told what it is and your mum could have been told鈥�

听

Potts

She could.

听

White

鈥� straightaway.

听

Potts

Absolutely and forewarned is forearmed.听 And now the Royal College is going to 鈥� possibly insist is too strong a word but they are certainly going to ensure that most of their members will warn their patients.听 I think also some of the doctors say to me 鈥� well I don鈥檛 want to tell them because if it doesn鈥檛 happen they鈥檒l be worrying about it.听 But I said I think it鈥檚 just better if the warning is there, if it doesn鈥檛 happen that鈥檚 absolutely marvellous and of course it doesn鈥檛 to everybody.

听

White

But you鈥檙e trying to do more about it aren鈥檛 you because you鈥檝e started Esme鈥檚 Umbrella鈥�

听

Potts

I have.

听

White

鈥amed after your mother, what鈥檚 it for and what鈥檚 that going to do?

听

Potts

Well after she died I thought I really have to do something about this, she had struggled with this condition, we didn鈥檛 know what to do.听 So I launched an awareness campaign and over the last two years I have been everywhere really to speak to all sorts of different members of the medical profession鈥�

听

White

But in the meantime clearly what鈥檚 really needed is some help for people when they need it because you said to me, I think, at one point this ruined the end of your mother鈥檚 life.

听

Potts

Yes it did, it did, the last few years of her life she was simply tormented by the hallucinations and I think they were getting worse.听 It was just all too much for her.听 And people with severe Charles Bonnet Syndrome, who call my helpline or who email me or members of their family who do on their behalf, they say I cannot go on, this is like living in hell.听 And the description of the hallucinations that some people have to live with are totally horrific 鈥� fire, rushing water, the whole room sometimes changes.听 One lady told me she woke up and she thought her bed was on fire.听 And because the hallucinations come directly from the brain they are sharp and clear, as opposed to the person鈥檚 normal sight.

听

White

Judith Potts. 听And I hope hearing about those experiences may have reassured people going through this that there is a rational explanation for it and there are things that can be done.听 There are more details about Charles Bonnet Syndrome and Esme鈥檚 Umbrella on our website.

听

There鈥檚 also some more potential good news for visually-impaired people frustrated by that perennial problem of identifying things that really are there.听 What鈥檚 on the table in front of me? 听What鈥檚 in the bland tin on my kitchen shelves? 听Or when I鈥檓 trying to identify items out shopping. 听But there鈥檚 a new app 鈥� isn鈥檛 there always 鈥� it鈥檚 called Seeing AI and although there are a lot of these popping up on smartphones, this one really is causing quite a stir.听 One of those people who鈥檚 using it and who has greeted it with enthusiasm is our 麻豆社 Washington correspondent Gary 翱鈥橠辞苍辞驳丑耻别.

听

翱鈥橠辞苍辞驳丑耻别

I鈥檝e been using the Seeing AI app for a few months now and I find it incredibly useful.听 It kind of draws together a whole bunch of functions that other apps do and does some more as well.听 So, for example, the product category where it tries to read barcodes, I use it a lot obviously for reading tins and packets out of the kitchen cupboards and the great thing about it that it doesn鈥檛 just tell you what they are, it often tells you instructions 鈥� so cooking instructions or serving instructions.听 And obviously that depends on the database of barcodes but here in the US it does work really well.听 And it鈥檚 very rare that I pick a product up from the cupboard and it can鈥檛 read it.听 It also has an audio guide, which tells you whether you鈥檙e pointing it properly at the barcode itself, it鈥檚 really very good.听

听

I also use the short text setting and the thing I really like about this is that you don鈥檛 have to take a picture, you don鈥檛 have to press a button to take a picture and then get the app to interpret the text, which you have to do with some other apps.听 You simply point it at the thing you鈥檙e trying to read.听 And I鈥檝e used this countless times, particularly in hotel rooms when you鈥檙e trying to work out which side of that card is 鈥� please clean my room 鈥� and which side is 鈥� please do not disturb.听 And that works really well, that鈥檚 a sort of 鈥� a use case that I鈥檝e used dozens and dozens of times.听 And then of course with Christmas coming up there鈥檚 a really fun part to this app which is the person setting.听 So you can point it at a person, it tries to describe them to you.听 And the really cool thing is that it tries to guess their age at times as well, which can be a double edged sword.听

听

All in all I think it鈥檚 a really worthwhile thing to get and to try, it鈥檚 free, there鈥檚 no downside in that sense and I鈥檝e used it a great deal over the last few months.

听

White

So Gary 翱鈥橠辞苍辞驳丑耻别 obviously a bit of a fan.听 But even if you鈥檙e confident with the technology, as Gary clearly is, where does this fit in with the other equipment that鈥檚 around doing similar kinds of things?听 Well who better to ask than Jackie Brown, who鈥檚 been, this weekend, at a get together of the British Computer Association of the Blind, indeed as from yesterday she鈥檚 its new Chair, so congratulations for that Jackie.听

听

Brown

Thank you.

听

White

Now how significant is this latest app do you think?

听

Brown

It seems to be very popular Peter among lots of techie users who would already be using smartphones anyway.听 It鈥檚 only available in the app store on IOS, at the moment, it鈥檚 not available for android users.听 But those who are using it are really enjoying it.听 I like the OCR part of it鈥�

听

White

That鈥檚 the optical character recognition yeah?

听

Brown

That鈥檚 right.听 My husband and I both receive talking books from RNIB and if you want to identify whose book belongs to who it鈥檚 really good at just pointing that app at the CD.听 I鈥檝e had more success really quickly on the trot with that than I have using a KNFB reader, which I鈥檝e also got on my phone.听 So that鈥檚 interesting.

听

White

How does it compare with some of the others, I mean things that we鈥檝e featured on the programme before which are ways of identifying objects, for example, or the colours of things 鈥� Tap Tap See, Be My Eyes 鈥� how does it compare with them?

Brown

People seem to be really liking it, they think it鈥檚 good value to have all those things in one app.听 Then there are others who say that they just can鈥檛 get aspects of it working.听 So it is very subjective in the sense that there are lots of other apps out there that maybe do a good or better job.听 So it really depends on what you want from an app and what you want it to do.听 But there are also people out there who can鈥檛 use smartphones, don鈥檛 want to use them, just find touch screens really difficult and feel that they鈥檙e very, very tied to their phone if they鈥檙e going to go down that road.听

听

White

What does this mean in financial terms because as I understand it Seeing AI is free, at the moment anyway, it鈥檚 a free app and so are some of the others.听 Does that mean that this is the end of people spending hundreds or in some cases even thousands on free standing readers and that kind of thing?

听

Brown

In a way it is going to make the job of selling those kind of devices with four figures more difficult.听 But the other side of the coin is that people who need physical buttons, who prefer standalone equipment 鈥� they鈥檙e the ones that are going to be left behind if this kind of material isn鈥檛 produced in solid form, if you like, if it鈥檚 just going to all be confined to apps then they鈥檙e the people that are going to be left behind and that is the concern.听 But I think the days of spending thousands of pounds, if you like, on dedicated barcode scanners and reading machines, I think that we are working towards much more cheap apps and stuff like that.

听

White

Jackie Brown, thank you very much indeed.

听

Well listening to that from our 麻豆社 Cornwall studio in Truro was retired social worker, Richard Pryor. 听We鈥檝e asked Richard to listen to this because he鈥檇 already got in touch with us with some concerns about the gap that he felt was widening between people who were sailing ahead with this kind of technology and those who he thought were being left behind and not offered the support they might need to take advantage of it.听 Richard, just explain your concerns.

听

Pryor

I totally agree with what Jackie was saying later on in the interview because that鈥檚 the first person I鈥檝e actually heard acknowledge that there are an awful lot of us, I don鈥檛 know percentage, but an awful lot of us who actually don鈥檛 know the first thing about technology.听 And, for example, I really don鈥檛 know what an app is AI for me, growing up in the country, is artificial insemination for dairy herds!听 So that鈥檚 where I start from and it is quite frightening.听 When I was working the most important bits of equipment for blind people who were more interested in anything were the talking books, the wireless for the blind and talking watches.

听

White

But of course Richard because time 鈥� time moves on, there鈥檚 progress, things happen and because somebody can鈥檛 use a piece of equipment that鈥檚 no reason to stop those who are benefitting from it and who are good at it.

听

Pryor

No that鈥檚 right.听 My concern is that we鈥檙e going backwards.听 I worked for 30 odd years and I received fabulous support, I had a wonderful career, I thoroughly enjoyed every minute of it and I鈥檓 still very happy about the way things are going.听 But when you look back at the support that young people have got nowadays and the support that I had, there鈥檚 absolutely no comparison.

听

White

Now you鈥檙e not talking about technology there, you鈥檝e widened it out, so what kind of areas of support did you get that you think that people aren鈥檛 getting now?

听

Pryor

Okay, I lost my sight over about three days, went completely, now the first person I had was a technical officer for the blind, she came in.听 Then I had a blind person鈥檚 resettlement officer, specialist officer from the Job Centre.听 Then I was sent off to Manor House Torquay for 12 weeks, where I had six lessons a week in mobility, apart from anything else.听 They suggested a job for me that I would never have thought of in a million years.听 Came away from there, trained up with a guide dog, the Guide Dogs were great in those days, they had their own centres until they decided to close them down, which is the biggest mistake they鈥檝e ever made.

听

White

Well in a few weeks鈥� time we鈥檒l have Guide Dogs on, they can talk about some of those things.听

听

Pryor

But going for employment, the first just I applied for, which was back in the 鈥�70s, they wrote back and said I鈥檓 sorry you can鈥檛 drive.听 So I wrote back and said I can drive, I just can鈥檛 steer.听 At which point I got an interview.听 But the second job I went for, which was down here in Cornwall, which was 鈥�83.听 Before I actually came for interview the RNIB advisor had been here, the blind person鈥檚 resettlement officer had been to talk to my employers and by the time I came for interview they weren鈥檛 interested in how I would record things, how I鈥檇 get around or anything because they鈥檇 got all that explained to them and all I had to do was explain what I was doing in terms of social work.

听

White

And you鈥檙e saying that wouldn鈥檛 happen now?

听

Pryor

No doesn鈥檛 happen now.听 I鈥檝e watched several young people tried to get employment and it鈥檚 appalling.听 A lot of the software companies use these days are not accessible, using specialist software, I mean I used Dolphin which is great but you know a lot 鈥� you can鈥檛 get at it, you can鈥檛 get a lot of these software programs鈥�

听

White

But is that because the support isn鈥檛 there or is it because of the nature of the employment market now?

听

Pryor

No, I think the support not鈥檚 there.听 We鈥檝e got 鈥� I mean you鈥檝e heard Jackie talking about all these fancy gadgets and things like that, I mean they sound really great, I鈥檇 like some of those but I do need somebody to show me how to use them.

听

White

Richard Pryor.

听

So is there a widening information gap amongst blind and partially sighted people and if there is how should we be tackling it?

听

You can call our action line on 0800 044044 for 24 hours after tonight鈥檚 programme, you can email us at in touch at bbc.co.uk or click on contact us on our website, where you can find out more information about Seeing AI and Charles Bonnet Syndrome.听 And you can also download our programme from there.

听

Next week we鈥檒l be Christmas shopping on air, so do let us have your suggestions, we want to know examples of the best and the worst presents you鈥檝e ever received. 听From me, Peter White, producer Cheryl Gabriel and the team, goodbye.

Broadcast

  • Tue 28 Nov 2017 20:40

Download this programme

Listen anytime or anywhere. Subscribe to this programme or download individual episodes.

Podcast