Shop OBEX P1 Docs P2 Docs Learn Events
CMUcam4 sneak preview - Ken and Kwabena — Parallax Forums

CMUcam4 sneak preview - Ken and Kwabena

BumpBump Posts: 592
edited 2012-03-17 10:36 in General Discussion
Ken ambushes Kwabena in this short film featuring the CMUcam4, with the Propeller Microcontroller on the board.

I think Kwabena tells Ken not to post it on the web at the end of the video...
«1

Comments

  • MicrocontrolledMicrocontrolled Posts: 2,461
    edited 2011-07-26 14:48
    NICE!!! I'd love a little vision processing prop board for my Stingray. I hope this goes into production soon!
  • WhitWhit Posts: 4,191
    edited 2011-07-26 14:50
    Looks cool!

    Kwabena is Kye right? Interning for the summer - I assume?
  • Roy ElthamRoy Eltham Posts: 3,000
    edited 2011-07-26 15:50
    I am really looking forward to this one! My bot's need a good vision system!
  • Oldbitcollector (Jeff)Oldbitcollector (Jeff) Posts: 8,091
    edited 2011-07-26 19:21
    Were the last few words "Hey, Don't post that on the..... " :)

    Looks great! This is a FANTASTIC way to introduce Ardunio users to the power of the Propeller. Awesome!

    Any chance of a Gadget Gangster Propeller Platform version of this camera?

    OBC
  • ElectricAyeElectricAye Posts: 4,561
    edited 2011-07-26 21:15
    Kwabena comes up with this awesome technology and all he gets is a Kit-Kat bar?
  • Ken GraceyKen Gracey Posts: 7,401
    edited 2011-07-26 21:25
    Kwabena comes up with this awesome technology and all he gets is a Kit-Kat bar?

    Ah, man, wouldn't it be great if that's all it took!

    In addition to his salary, we feed this guy like crazy: Thai, Chinese, pasta, salads and cake. Kwabena has been living in the CMU campus housing on their mega-starch diet for several years. Apparently they know how to make 20 different meals from the same three ingredients. Guess you could say he's been happy in California for the food alone.

    We'll miss Kwabena when he returns back to CMU in four weeks. Wouldn't mind talking him out of the last year of his university but we'll be ready to roll when he graduates. He's truly been a fantastic member of our crew.

    Ken Gracey
  • TubularTubular Posts: 4,712
    edited 2011-07-26 23:02
    Awesome. That's a really neat little product right there. Thanks for sharing.

    So are kit kats the secret to motivating engineers? You know they released a 'chunky 3' version here that should work three times as well.
  • GordonMcCombGordonMcComb Posts: 3,366
    edited 2011-07-26 23:39
    At UPEW Kwabena mentioned a target price for the CMUcam4. Frankly, I have my doubts, but I said if he could pull it off I'd buy him dinner. Looks like I'm going to lose that bet, and now you tell me he eats like a college student. I better start saving now!

    -- Gordon
  • schillschill Posts: 741
    edited 2011-07-27 05:20
    Looking forward to this. I've got a place all ready for it on my Stingray - I'll just remove the camera that's there now and bolt on this one. :)
  • Ken GraceyKen Gracey Posts: 7,401
    edited 2011-07-27 07:53
    At UPEW Kwabena mentioned a target price for the CMUcam4. Frankly, I have my doubts, but I said if he could pull it off I'd buy him dinner. Looks like I'm going to lose that bet, and now you tell me he eats like a college student. I better start saving now!-- Gordon

    Early price discussions probably didn't take into account that a product must have some kind of return on investment. If manufacturing costs are going to be tightly controlled there's a possibility it would be $99.99, but I think $129.99 is more of a reality.

    The version he designed is for the Arduino, so we'll share it with suppliers who work more in that space. Anybody is welcome to make a version more suitable for any 3.3/5V microcontroller and eliminate the shield format. We don't have plans to manufacture it right now (in this case we'd rather be the Propeller supplier) but we'll see how it works out. I'd rather put it into a dual-row SIP arrangement so it can stand upright, or be mounted in that way (like our XBee Educational Adapter).

    Ken Gracey
  • GordonMcCombGordonMcComb Posts: 3,366
    edited 2011-07-27 11:19
    Ken Gracey wrote: »
    there's a possibility it would be $99.99, but I think $129.99 is more of a reality.

    Even at $130 that's almost half the cost of the CMUcam3.

    Sparkfun could well fly with this on the Arduino front. It's a nice way to sell Propellers, so it's win-win. I have a feeling Nathan and crew will jump at this one.

    I like the dual-SIP arrangement which saves space on a robot. Too many boards are horizontal and take up valuable real estate. It's not always practical to stack things up with shields (for one thing, shields are seldom cooperative in which pins they occupy). If you do go ahead with your own processor-independent version, I'd like to see one with dual Tx/Rx, and that accepts inverted or non-inverted serial. The products that use just a single serial line for Rx and Tx are harder to interface to Arduinos and AVRs.

    -- Gordon
  • Phil Pilgrim (PhiPi)Phil Pilgrim (PhiPi) Posts: 23,514
    edited 2011-07-27 11:41
    The products that use just a single serial line for Rx and Tx are harder to interface to Arduinos and AVRs.
    To interface such a device (e.g. ColorPAL) to a micro with dedicated RxD and TxD pins, a single diode on TxD is all you need to make the connection:

    attachment.php?attachmentid=83463&d=1311791637

    Micros without dedicated serial peripherals, such as some PICs and AVRs, can be bit-banged half-duplex fashion to accommodate bidirectional comms on a single pin.

    The advantage of multiplexed Tx/Rx devices, of course, is the wide availability of servo headers on various controller boards (e.g. BOE) and the ease of obtaining interconnecting cables.

    -Phil
    460 x 206 - 2K
  • Phil Pilgrim (PhiPi)Phil Pilgrim (PhiPi) Posts: 23,514
    edited 2011-07-27 11:44
    Kwabena,

    That camera really looks cool! It's great to see the CMUCam family furthered by using the Propeller chip. Not only do you get great performance, but the Propeller finds a home in a very visible product -- a big win for everyone!

    -Phil
  • schillschill Posts: 741
    edited 2011-07-27 12:43
    I'm not too concerned about an Arduino compatible form factor except for the fact that I'd like something as small as possible. And mounting holes - everything beyond 1 inch square or so (arbitrary size) needs mounting holes.
  • GordonMcCombGordonMcComb Posts: 3,366
    edited 2011-07-27 14:11
    See, Phil, I knew I'd get you to come out of your shack to respond!

    Will the same connection work for an Arduino via its dedicated UART and Prop Backback?

    Understand about the cabling and headers, though these days more and more peripherals are going I2C and you've got four there, so it's hard to escape. I'm seeing a lot of these support both serial and I2C, which I find handy. If I'm already using one I2C device, I've made the bus and now I can just hang off additional devices.

    -- Gordon
  • Phil Pilgrim (PhiPi)Phil Pilgrim (PhiPi) Posts: 23,514
    edited 2011-07-27 15:08
    See, Phil, I knew I'd get you to come out of your shack to respond!

    attachment.php?attachmentid=83466&d=1311804344
    Will the same connection work for an Arduino via its dedicated UART and Prop Backback?
    Yes. Like the ColorPAL, the Backpack includes the pull-up resistor, so all that needs to be added to the Arduous Weenie is a diode.

    BTW, multiple ColorPALs can be networked, simply by connecting them in parallel, once their addresses have been programmed into their on-chip EEPROM. The same applies to the Backpack, but it's up to the programmer to provide the address decoding and comms protocol. There's a limit though, which occurs when too many paralleled pull-ups become too stiff to be pulled down by the host.

    -Phil
    317 x 240 - 26K
  • KyeKye Posts: 2,200
    edited 2011-07-27 19:00
    The camera might need to go into full duplex modes at times... (It might be sending you stuff and you want it to stop). So... I don't know about a 3 pin header. Whatever the case the Arduino Shield version will come out first and that will have a dedicated RX and TX pin.
  • AJMAJM Posts: 171
    edited 2011-07-28 05:50
    Also looking forward to this. What a sweet new product.
  • BeanBean Posts: 8,129
    edited 2011-07-28 07:07
    Wow, first the WiFi and now this...I can't wait for either to be available.

    Bean
  • Martin_HMartin_H Posts: 4,051
    edited 2011-07-30 16:49
    Kwabena, that is great! Now I am not so bummed out that I missed out on the CMUcam that Parallax auctioned off a few weeks back.
  • RL600RL600 Posts: 40
    edited 2012-02-05 05:37
    It's a really coooool product. When he came out I will to buy one.
    I have only 1 question. What are the dimensions? because I want to involve the cmucam4 in another project.

    RL600
  • LeonLeon Posts: 7,620
    edited 2012-02-05 06:28
    I was curious about the sensor that it uses. Checking the video clip I heard Omnivision and 9965 mentioned, so it must be the OV9665:

    http://www.ovt.com/products/sensor.php?id=5

    http://www.ovt.com/uploads/parts/OV9665_PB%20%281.0%29web.pdf

    This camera uses the OV9665 with an ADI Blackfin ($195):

    http://www.surveyor.com/blackfin/index.html

    The stereo version is nice.

    The OV9665 is used in several webcams. Getting one of those might be a good way to get hold of one, they are probably only available to OEMs from Omnivision.
  • KyeKye Posts: 2,200
    edited 2012-02-05 08:28
    It will be on sale before the summer.

    Its the exact size of an Ardunio Pro.

    Thanks,
  • nooiahnooiah Posts: 1
    edited 2012-03-15 08:00
    I'm Bruno Rabelo in the name of NorSul Engenharia, an interprise of engineering, in Brazil.
    We're developing a project that uses the CMUCAM 3.
    Now we need more unities of this device or CMUCAM 4, but all the suppliers listed on your web site don't have this device anymore.
    We would like to know if there is the possibility of produce the CMUCAM 3 or CMUCAM 4 here in Brazil. If yes, we would like know how we can produce this device.
    We'are thinking if you could send us the hardware project and so we would be able to produce the integrated circuit board.

    Regards,
  • KyeKye Posts: 2,200
    edited 2012-03-15 08:02
    http://www.lextronic.fr/P1890-module-de-reconnaissance-video-cmucam4.html

    It goes on sale this weekend. The CMUcam4 will appear on the CMUcam website this weekend.

    ---

    You can't the CMUcam3 anymore because the camera module is EOL.
  • PublisonPublison Posts: 12,366
    edited 2012-03-15 13:58
    Kye wrote: »
    http://www.lextronic.fr/P1890-module-de-reconnaissance-video-cmucam4.html

    It goes on sale this weekend. The CMUcam4 will appear on the CMUcam website this weekend.

    ---

    You can't the CMUcam3 anymore because the camera module is EOL.

    Great news Kye!

    I'm sure Parallax might pick this up, also.

    Hope the final manual will not be in French. :)

    Jim
  • Beau SchwabeBeau Schwabe Posts: 6,568
    edited 2012-03-15 14:33
    Kye,

    I have a question regarding the image filtering.

    Can you compare differentially from frame to frame or a specific time/frame interval?

    Most of the filtering that comes close to this function uses pixel shifting of the same image and that's not quite what I am looking for.
    ... By taking the differential from frame to frame, everything that is common mode drops out. Anything that passes through means that it is in motion.
    This has many security applications, and autonomous robot applications as well, not to mention others.
  • KyeKye Posts: 2,200
    edited 2012-03-15 14:45
    @Publison - I'll post a blog post about this all on Saturday. The manual is in very readable English.

    @Beau - So the CMUcam4 firmware does not support image differencing directly. But, if you hack the firmware you can make it happen. We left out the pixel differencing feature because it uses up to much memory.

    The CMUcam4 can stream 80x60 binary images to the host microcontroller at 10 FPS. The host can then store one image as a baseline image and xor it with all new images coming in. This would allow you to detect motion. The host could also store a mask image to logically AND with the xor'ed image to kill certain areas of the image.

    Unfortunately, this technique only works for a particular color. So, you would have to choose a range of colors that you wish to examine first before doing this. You could put the CMUcam4 into black and white mode to make the range smaller.

    There's 70+ commands in the CMUcam4 toolbox. It can do a lot of stuff if you put your mind to it.
  • Invent-O-DocInvent-O-Doc Posts: 768
    edited 2012-03-15 15:52
    I like how the video ends "hey, don't post this on the web"

    Nice project
  • TubularTubular Posts: 4,712
    edited 2012-03-15 18:44
    Kye

    Look forward to more detail.

    That board looks really compact. What offset between the centreline of the two lenses would you get if you place two side by side (for stereoscopic vision) ?
Sign In or Register to comment.