Shop OBEX P1 Docs P2 Docs Learn Events
Human echolocation — Parallax Forums

Human echolocation

Dr_AculaDr_Acula Posts: 5,484
edited 2013-07-29 18:09 in Propeller 1
Could the propeller help blind people to see?

An interesting article on human echolocation here http://www.southampton.ac.uk/engineering/news/2013/05/20_echolocation.page and another one here http://www.bbc.co.uk/news/magazine-19524962

Ride a bike or play basketball just with clicks. But clicking, hand claps and foot stomps have problems – as described in that second article by a blind person -
"I believe it's discouraged because it's seen as a 'blindism' - if you're clicking then you're drawing undue or negative attention to yourself."

So – how about clicks that are ultrasonic and downconvert the echoes?

Here is a whole thesis on the topic http://libdspace.uwaterloo.ca/bitstream/10012/3878/1/TCDavies%20final%20thesis%20August22.pdf and here is another shorter article http://redwood.berkeley.edu/w/images/f/f7/SohlDickstein_et_al_echolocation_for_the_blind_icme_preprint.pdf

In that second article, the hardware is described as a windows computer with a soundcard and a wheelchair battery, and there is a photo on page 5 of the whole setup in a backpack.

Ah, the inner propellerhead says...

Of course there are smaller versions. You can buy a portable bat detector on ebay for $100. But that is just for hearing bats, not for echolocation.

The simplest downconvert is a heterodyne, or for something a bit more complex, a superhet. Some other techniques here http://en.wikipedia.org/wiki/Bat_detector and the problem with the simpler analog methods is you lose amplitude information.

The long theses referenced above used some more complex DSP techniques to do doppler shifting with some promising results. Time stretching may also be useful. One of the articles about bats talks about how some bats can close off their ears when they chirp, so they don't go deaf with the loud noise and can hear the echoes better. That can all be done digitally.

To take the technique used by the Berkeley team, produce a chirp sweeping from 25khz to 50khz modelled on a bat chirp, store the echo, then play it back 25x slower. That ought to be possible with a propeller. And with different software, you could quickly switch to doppler mode if you wanted.

Thoughts would be most appreciated!

Comments

  • Cluso99Cluso99 Posts: 18,069
    edited 2013-07-21 22:19
    I hope Phil will chime in here. He has done some great signal analysis with the prop and the Q demodulator. Superhet is no longer in fashion because direct conversion using maths is not only simpler (from a hardware point of view), but in fact can be much quieter (less noisy).

    I remember when we used to ski regularly, one of the instructors used to take a blind boy (teenager IIRC) skiing. He used to clap and speak so that the boy could follow. I was amazed at his skill and his ability. I just used to think how amazing it was that the boy could follow the sounds and never thought about the actual noise bringing attention to the fact.

    I would think you will have to have a number of directional antennas so that the relative direction of the echoes can be located. I wonder if a tiny microphone and speaker fitted to an earplug (one for each ear) would work with the electronics being located in a belt/pocket, much like an iPod.
  • John BoardJohn Board Posts: 371
    edited 2013-07-22 02:45
    Heh, I remember back in my Lego Mindstorms days (not that long ago mind you...) I made a "blind-person-helper" program, that works fairly similarly. It was just me having fun playing around with LM when I didn't really know what I was doing. But what it'd do is the "blind person" (me with my eyes closed), would angle an ultrasonic at wherever I wanted to see at, and the "Lego Brick" (CPU) would make beeping noises. The closer the beeping noises were together, the closer you were to an object.

    I think the idea is a fairly decent one to be honest. Who knows... We have EEG (mind reading), one day we might have "mind writing", we can mount a 3D scanner on someone's head, and dump the information straight into their brain :P
  • TorTor Posts: 2,010
    edited 2013-07-22 04:53
    Some years ago I watched a TV program about a blind teenager who had developed amazing echolocation skills. He was able to notice parked cars with ease, for example, and he could play basketball. That last part created another problem though, because (as the TV documentary showed clearly) if he walked through the park and someone played basketball he couldn't help stopping and joining in. After the game he was always completely lost.. because he couldn't remember his original direction anymore and the echolocation was only good for detecting nearby obstacles and items.
    Watching that, I imagined that a great combination for a blind person would be echolocation combined with a haptic belt which can give you an additional directional sense - it tells you where north is, at all times. Some guy made his own version of the belt described in the article, using an Arduino.. say no more! :)

    -Tor
  • prof_brainoprof_braino Posts: 4,313
    edited 2013-07-22 06:36
    Tor wrote: »
    Some years ago I watched a TV program about a blind teenager who had developed amazing echolocation skills.

    I saw that same show. I still have a pile of piezo tweeters from radio shack and lm386 op amps for this project. One of the many goal projects that are waiting for my foundation projects to be completed. Good to remember this.
  • Tim-MTim-M Posts: 522
    edited 2013-07-22 06:47
    The boy's name was Ben Underwood and his story is remarkable. He has since passed away, but had developed amazing skills which were tested in some detail. The program is about 45 minutes long and worth every bit of it.

    http://www.youtube.com/watch?v=en2r4LeGkqA
  • Beau SchwabeBeau Schwabe Posts: 6,566
    edited 2013-07-22 12:06
    About 17 years ago we applied for a research grant for development of sonar equipped glasses that could be worn as an aid to assist the blind. The grant was denied, but we continued with our proof of concept. Unfortunately for whatever reason that project was shelved even though with our own pilot study the proof of concept worked. Back then we would formulate a proof of concept before we ever thought of applying for a grant which menat prior to a grant submission we had something tangible to back our claims.

    Grant Study
    http://forums.parallax.com/showthread.php/145462-How-to-digitally-record-a-10ms-pulse-then-stretch-it-out-into-audio-in-real-time?p=1158493&viewfull=1#post1158493


    Another project, relatively recently (2010), that I was involved in helping one of the youth at the church, was a science fair project proving the speed of sound. A unique thing that I wanted to point out is that we were NOT using any ultrasonics to perform the test, but simply an 8 Ohm speaker and an electret microphone. This is significant, because of the misconception that you must use ultrasonics (specifically 40kHz) to measure distance by echo location, which is not true. Audible ranges are perfectly acceptable.

    Proving the Speed of Sound
    http://forums.parallax.com/showthread.php/122467-Proving-the-Speed-of-Sound-5th-grade-science-fair-project
  • HumanoidoHumanoido Posts: 5,770
    edited 2013-07-22 12:10
    Dr_Acula wrote: »
    Could the propeller help blind people to see?

    Yes. Check the Penguin Superhero article in Robot magazine and the downloads. It has a PING sensor that can see in complete darkness out to about 9-feet. I've had good results with some PING sensors out to around 12-feet. The program converts the distance into a scaling sound in real time. It also works for normal eyesight, walking in total darkness, with the display of graphics representing distance. With a little practice, it's possible to determine the location of nearby objects in a rudimentary fashion. The code uses the BS2px. When using the Propeller, it could speak and return the actual distance in feet and inches.
  • lardomlardom Posts: 1,659
    edited 2013-07-23 08:20
    Great thread. Combining echolocation with Phil Pilgrim's "Goertzel Algorithm" object means it's possible to say "Come here Mr. Robot."
  • Tim JohnsonTim Johnson Posts: 2
    edited 2013-07-24 07:17
    That 45 minute program on Ben Underwood is a great program and it's what inspired me to learn echolocation myself. It's actually not as hard as you might think :)

    Daniel Kish has since taken on a role of teaching blind people all over the world how to use conscious echolocation to see all sorts of different objects and obstacles and even go "sight-seeing". He's a very smart guy and has done a few TED Talks: http://www.youtube.com/watch?v=ob-P2a6Mrjs

    A
    nd yes, blind people have a stigma against "using" echolocation by emitting clicks and refer to it as a "blindism" or something that provokes unwanted attention. If more sighted people were exposed to what echolocation is, however, more blind people might be tempted to want to learn.
  • Tim JohnsonTim Johnson Posts: 2
    edited 2013-07-24 07:22
    By the way, this is awesome:
    lardom wrote: »
    If the grass is greener on the other side...it's time to water your lawn.
  • lardomlardom Posts: 1,659
    edited 2013-07-26 20:54
    Tim Johnson, Thanks. Welcome to the forum.
  • jtilghmanjtilghman Posts: 67
    edited 2013-07-29 18:09
    Here is a project you might want to look into: http://www.instructables.com/id/VIA-Visual-Impairment-Aid-Haptic-Sound-Feedbac/

    Its not using a prop, but it might be helpful.

    jt
Sign In or Register to comment.