Shop OBEX P1 Docs P2 Docs Learn Events
Dr. Jim videos - a conversation about machine intelligence — Parallax Forums

Dr. Jim videos - a conversation about machine intelligence

mallredmallred Posts: 122
edited 2009-08-05 23:48 in Propeller 1
Dr. Jim discusses machine intelligence in a series of 3 videos on the Machine Intelligence Technologies blog.· More in-depth than in the past.

http://machineinteltech.com/blog/blog1.php
«1345

Comments

  • hover1hover1 Posts: 1,929
    edited 2009-07-31 00:08
    Mark,

    Interesting video. Thanks for posting it.

    Hope your wife is doing better.

    Jim
    mallred said...
    Dr. Jim discusses machine intelligence in a series of 3 videos on the Machine Intelligence Technologies blog.· More in-depth than in the past.

    http://machineinteltech.com/blog/blog1.php
  • mallredmallred Posts: 122
    edited 2009-07-31 00:54
    Thank you, Jim, she is much better.· We just don't know what caused her pain.· She was in the fetal position at one point.· And then it went away.·

    Glad you liked the videos.

    Mark
  • Bill HenningBill Henning Posts: 6,445
    edited 2009-07-31 00:58
    I am glad to hear she is better... I will check out the video later.

    Kidney stone can cause pain like that.
    mallred said...
    Thank you, Jim, she is much better. We just don't know what caused her pain. She was in the fetal position at one point. And then it went away.


    Glad you liked the videos.



    Mark
    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    www.mikronauts.com - my site 6.250MHz custom Crystals for running Propellers at 100MHz
    Las - Large model assembler for the Propeller Largos - a feature full nano operating system for the Propeller
    Morpheus & Mem+ Advanced dual Propeller SBC with XMM and 256 Color VGA
    Please use mikronauts _at_ gmail _dot_ com to contact me off-forum, my PM is almost totally full
  • hover1hover1 Posts: 1,929
    edited 2009-07-31 01:06

    Kidney stone can cause pain like that.

    Bill, Good call. I now recall a few·friends going through that.
    Jim
  • Phil Pilgrim (PhiPi)Phil Pilgrim (PhiPi) Posts: 23,514
    edited 2009-07-31 01:41
    Mark,

    I'm glad to hear your wife is doing better! If it was, indeed, a kidney stone, I can empathize fully. But, no matter what the cause, it's good to hear she's attained relief. Fortunately, our capacity to remember pain is very limited; else, I suspect, every child would be an only child! smile.gif

    Take care,
    -Phil
  • mallredmallred Posts: 122
    edited 2009-07-31 02:59
    They did a CT scan and found no kidney stones and no gall stones. It really is a mystery. They said it my be small cysts on the ovaries that are too small to pick up on the CT, anything less than plum-sized would not pick up. So if she has grape-sized cysts, for example, that would not show up. That was the only explanation they offered as a possibility, except for gas. They said she could flare up again at any time without notice. At least she is ok for now.

    Thank you all for your concern.

    Mark
  • Nick MuellerNick Mueller Posts: 815
    edited 2009-07-31 08:01
    Sorry, double posted

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    Never use force, just go for a bigger hammer!

    The DIY Digital-Readout for mills, lathes etc.:
    YADRO
  • Nick MuellerNick Mueller Posts: 815
    edited 2009-07-31 08:01
    17 minutes 42 seconds.
    And I understood, that the Propeller doesn't have enough RAM, so it needs a memory-extension. And a permanent storage to keep that information after power down.

    What a waste of time!


    Nick

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    Never use force, just go for a bigger hammer!

    The DIY Digital-Readout for mills, lathes etc.:
    YADRO
  • BradCBradC Posts: 2,601
    edited 2009-07-31 09:20
    Nick Mueller said...
    17 minutes 42 seconds.
    And I understood, that the Propeller doesn't have enough RAM, so it needs a memory-extension. And a permanent storage to keep that information after power down.

    That is about what I thought when I watched it also.. bear with me here..

    I'm primarily a technical guy. I believe I have a pretty good understanding of the basics, through to about the 10,000 ft view. I've been lucky enough to work with (and learn from) some exceptionally clever people. People who give a presentation that drones on and on about trying to explain the basics (badly), yet glosses over the super interesting stuff sitting about 20,000 ft up because to them, the stuff we find interesting is their bread and butter.

    It used to irritate me when I sat through these presentations as I felt they were trying to teach me how to suck eggs (badly). Eventually it twigged that in most cases the people presenting were coming from a viewpoint so far removed from mine, that their grasp of the bits they were describing was extremely elementary, sometimes misguided and sometimes just plain wrong. But these people did not have to understand this stuff any more than was required to achieve the basic functionality (if at all, some have others just do it for them) they needed to do some really, really interesting things. These are the people who conceptualise the stuff we'll be using in 20 years.

    You can't be good at everything, and knowing what you don't know is the most valuable thing you can learn. The stuff Dr Jim is talking about right now seems pretty basic when you look at the technology (because it is). We know there is nothing new in the base platform he is presenting, but I suspect his head is so far up in the clouds he only needs to make it do what he needs it to do to achieve a set of specific end goals.

    I'm hanging on for the end game. The things he's hinted at during some of the video blogs have been so completely out there that I can't get past my 10,000 ft view to truly understand where he's coming from. I'm hoping to learn something along the way, but I'm hanging out to see what he's really going to show us.

    I hope that post did not come across as arrogant.. It was intended as the opposite.. Django Reinhardt said you only stop learning when you are 6 ft under. I'm hanging on as I reckon I might learn something new, and new is good [noparse]:)[/noparse] (Shiny is better!)

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    <This space for rent>
  • Mike HuseltonMike Huselton Posts: 746
    edited 2009-07-31 10:10
    Ouch!

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    JMH
  • RossHRossH Posts: 5,512
    edited 2009-07-31 11:37
    All,

    Having just sat through these vidoes - twice - I feel I have to publicly agree with Nick. To NOT say something about this type of nonense would be doing a disservice to the rest of the Propeller community. I sat through these videos intending to take a few notes so that I could bring up some points to promote further discussion. This is a subject I know a little bit about (as well as simply being interested in) having done an honours thesis on neural networking. I sat through all the videos twice because I figured I MUST have missed (or perhaps misunderstood) something the first time round. Now I'm just sorry I wasted so much time.

    Over 17 minutes watching a static Propeller screen (on which nothing actually happens) while listening to a voiceover by Dr Jim describing some very simplistic (and sometimes just plain wrong) notions of how the brain works - and how a machine following a program can never be intelligent (Dr Jim has clearly never heard either of chaos theory or emergent behaviour). Just why Dr Jim believes programming a Propeller is going to achieve machine intelligence when he's just finished defining machine intelligence as something that can't be achieved this way is completely inexplicable.

    I also find Dr Jim's repeated insinuations (he does it again in these videos) that there is no support software, standalone debuggers or other helpful tools suitable for developing software for the Propeller annoying - but also a little sad. Even if it were true when he started out (frankly, I doubt it was the case even then) he now has access to a wealth of tools far more sophisticated than those he himself appears to be either using, selling or developing.

    Ross.

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    Catalina - a FREE C compiler for the Propeller - see Catalina
  • localrogerlocalroger Posts: 3,452
    edited 2009-07-31 12:30
    I can't watch the vids at work but judging from the level of sophistication in the text "ethics" post beneath the vids, Dr. Jim has also never heard of the Singularity or any of the couple of dozen people who have been publicly flogging the idea, including a very vigorous debate about the ethics of AI, for the last decade.
  • Cluso99Cluso99 Posts: 18,069
    edited 2009-07-31 12:44
    Glad I didn't waste my time watching the video.

    See these old threads

    Dr. Jim in Sept/Oct issue of ROBOT Magazine http://forums.parallax.com/showthread.php?p=825564

    KISS OS - A new operating system for the Parallax Propeller· http://forums.parallax.com/showthread.php?p=822915

    Dr. Jim in Robot Magazine··http://forums.parallax.com/showthread.php?p=809911

    I note none contain any answers or information of substance, with the exception of KISS OS which states
    mallred said...
    The KISS OS is finally ready. Dr. Gouge wants to run through it one last time to check for optimization and to see if he can free up any more memory for a cushion.

    He will be running virtual memory, just like on the PC.

    MRAM is the onboard Propeller RAM, the fastest running at up to about 10 MB block transfers. ERAM is our Expanded RAM from 2MB to 16MB capacity per Proto board using daisy-chained daughter boards, running at up to 3 MB in block transfer mode, and then VRAM, one or more thumb drives used as permanent memory, all running very slow, in a serial fashion, and speed dependent upon the thumb drive manufacturer, but the slowest of the three types of memory.

    Our OS supports 32-bit virtual addressing in MRAM, ERAM, and VRAM.

    The OS supports abstract addressing, a proprietary set of functions for synaptic storage and retrieval, i.e. for learning and for accessing previously learned and stored synaptic information which equates to previously stored intelligence.

    The OS supports file manipulation. Users may also write their own functions. We have a large number of utility routines, including many of the debug functions.

    There really is no common ground for comparison between the KISS OS and other CPM-like OSes. The KISS OS is unique among operating systems and cannot truly be compared against any micro controller or microprocessor based OS that we are aware of. Instead, it is more like a mainframe architecture, and should be thought of in those terms, a virtual memory machine.

    It will be available for purchase soon, through a download from our website. The pricing will be $49.95 for a lifetime subscription initially.

    Stay tuned. Machine intelligence software to follow...


    Mark Allred
    Dr. Jim


    to which I replied
    Cluso99 said...
    Interesting specs...
    MRAM (hub ram) 32KB - 10MB (presume 10MB/s) block transfers.... A number of us have been doing 20MB/s for ages (standard 80MHz prop)
    ERAM (external sram) 2MB to 16MB - up to 3 MB (presume 3MB/s) block transfers... Depends on what you are saying here. I can get 6.7MB/s in byte transfers using unravelled code, 5MB/s in looped code. But if we want 32bit (long) fetches using byte-wide reads that is about 1MB/s. BTW, that only places it in the cog, not the hub.
    That was on 22 July. No reply and no more posts to that thread.... and a new thread starts

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    Links to other interesting threads:

    · Home of the MultiBladeProps: TriBladeProp, RamBlade, TwinBlade,·SixBlade, website
    · Single Board Computer:·3 Propeller ICs·and a·TriBladeProp board (ZiCog Z80 Emulator)
    · Prop Tools under Development or Completed (Index)
    · Emulators: Micros eg Altair, and Terminals eg VT100 (Index) ZiCog (Z80), MoCog (6809)
    · Search the Propeller forums (via Google)
    My cruising website is: ·www.bluemagic.biz·· MultiBladeProp is: www.bluemagic.biz/cluso.htm
  • BradCBradC Posts: 2,601
    edited 2009-07-31 12:53
    Guys, guys, guys.. my mother told me if you don''t have anything nice to say...

    I was trying to explain that perhaps Dr Jim was flying a lot higher than perhaps we were looking at and maybe we should wait patiently and simply see what transpires.. let's stop the mud please..

    Never know.. might learn something.
    I'll stop now, honest.

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    <This space for rent>
  • RsadeikaRsadeika Posts: 3,837
    edited 2009-07-31 13:05
    @RossH
    "Over 17 minutes watching a static Propeller screen (on which nothing actually happens) while listening to a voiceover by Dr Jim describing some very simplistic (and sometimes just plain wrong) notions of how the brain works ..." I am interested in the "... (and sometimes just plain wrong) ..." statement. Would you be a little more specific, and identify the "... plain wrong stuff ..." And while you are at it, maybe you should describe your theory of brain functionality.

    Ray
  • TrapperBobTrapperBob Posts: 142
    edited 2009-07-31 13:49
    All,

    If Dr. Jim is all talk and no substance he will disappear in the wind as his words will fall on deaf ears deafened by the white noise! However if there is real substance to come let us wait and listen carefully so as to be able to hear it over our own voices!

    TrapperBob
  • mallredmallred Posts: 122
    edited 2009-07-31 14:24
    I know many of you will think this is an unsubstantiated claim, but there is no way for me to prove it because it uses part of the machine intelligence software to work, but if you follow Dr. Jim's design, you will be speaking to your propeller by December 2009 at the latest. It will start slow, because you have to teach it English (or French, or Spanish, or Mandarin, etc.) but you will be able to see that it works by that timeframe.

    Mark
  • MicrocontrolledMicrocontrolled Posts: 2,461
    edited 2009-07-31 14:40
    What is the problem here?!?

    Why EVERY TIME Dr. Jim posts does everybody go against him?!?

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    Toys are microcontroled.
    Robots are microcontroled.
    I am microcontroled.



    If it's not Parallax then don't even bother. :-)
    ·

    Mini-Din/PS2 connectors are for sale! 5 for $1! PM me if you wish to make an order.
    Cheap·shipping unless specified!··········150 left!!··


  • mallredmallred Posts: 122
    edited 2009-07-31 15:12
    I know you are a very fact-oriented, logical bunch. Hey, nothing wrong with that.

    So, you probably are wondering, "Mark, how the heck do you know that this even works if you have not seen it yourself?"

    Ok, fair question. In an effort of full disclosure, I have seen Dr. Jim's imaging software, which also uses his machine intelligence algorithms, learn to read on a PC. I have seen it take a dark image of the ocean and identify underwater structures because of the wave patterns passing over it. I have seen many of his patents and have seen emails from the military in contact with him.

    I'm not trying to prove anything here, just trying to give a little more substantiation to my claims, that's all.

    In the end, I hope you join us. When this thing busts loose, we are going to need intelligent people to help with the research. I hope you will be there with us.

    Thanks,

    Mark
  • MicrocontrolledMicrocontrolled Posts: 2,461
    edited 2009-07-31 15:21
    Will you be at the Expo to give a presintation?

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    Toys are microcontroled.
    Robots are microcontroled.
    I am microcontroled.



    If it's not Parallax then don't even bother. :-)
    ·

    Mini-Din/PS2 connectors are for sale! 5 for $1! PM me if you wish to make an order.
    Cheap·shipping unless specified!··········150 left!!··


  • mallredmallred Posts: 122
    edited 2009-07-31 15:25
    We may make it next time to the Expo, but we are unable to do so at this time. We would rather show a finished product.
  • MicrocontrolledMicrocontrolled Posts: 2,461
    edited 2009-07-31 15:33
    I just got done watching your video on the KISS debugger. Nice Job! It's handy to have an on-the-go debugger. I should try to build something like that as a challenge. The only thing that makes ViewPort prime is it's OpenCV application.

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    Toys are microcontroled.
    Robots are microcontroled.
    I am microcontroled.



    If it's not Parallax then don't even bother. :-)
    ·

    Mini-Din/PS2 connectors are for sale! 5 for $1! PM me if you wish to make an order.
    Cheap·shipping unless specified!··········150 left!!··


  • RossHRossH Posts: 5,512
    edited 2009-07-31 15:35
    @Ray,

    Ok, as BradC says - I'll try to be open minded about Dr Jim. He may indeed be a genius for all I know. But to answer your specific question, I'll have to point out where I think Dr Jim is wrong (and I invite Dr Jim to respond if he feels I am misrepresenting his views).

    To start with, it's a fundamental misunderstanding of neurons to think that they are like digital switches and only have two states - to quote Dr Jim (from memory here) - "neurons either fire or don't fire - one or zero". This is simply not how neurons propagate information - it's the rate at which the neuron fires which does that - for example, in the visual cortex a bright light hitting the retina results in a higher rate of firing of the neurons in the visual cortex than a dim light. It's not a simple binary thing - neurons are in many ways more like analog circuits than digital ones.

    Also, neurons are not passive participants in brain functioning as Dr Jim states - i.e. they are not mere "signalling stations" (I can't recall the exact the term he uses) - neurons have a complex internal "state", based on both immediate past inputs (which briefly change the ability of the neuron to "fire" - in either an "excitory" or an "inhibitory" manner) and long term past inputs (which is reflected in the strength of the synaptic connections between the neurons). The behaviour of neurons is very complex - and this complexity is essential to cognitive functioning - in fact it IS the congitive functioning. Yes, synapses are important, and the strength of the synaptic connections are probably the seat of long-term memory. But this has been known for decades - It is not (as Dr Jim implies) some new idea that people are only now starting to consider. Also, there are now known to be several other memory mechanisms at work in the brain, and at least one of these is probably based in the neurons, not in the synapes - because the synapses are known to change far too slowly to explain even short-term memory, let alone be any use for any cognitive processing which has to occur in real-time.

    Of course, it is unlikely that Dr Jim is actually simulating neurons - while it's hard to tell exactly what it is he is doing, it only requires simple arithemetic to see that he cannot be doing that. Not only is the 32kb of the Prop not enough memory to perform any significant cognitive processing (Dr Jim is right about that) - neither is 16Mb. 16Mb might be enough to simulate (at a coarse level) a couple of thousand neurons - because even just a thousand neurons means upwards of a MILLION synaptic connections between them. All the synaptic connections have to be represented somehow - and this takes of the order of a megabyte no matter how cleverly you try and represent it or encode it (basic information theory says this, not me) - don't forget that each of these connections is not a simple digital value (requiring only a bit or two) - they are more like analog values (requiring potentially many bits each to represent with sufficient accuracy). But even if you can do all this properly, a couple of thousand neurons gets you about the cognitive processing power of a housefly - and how many houseflies do you know that can carry on an intelligent conversation?

    So all we can really tell from the vidoes is that if neural modelling is what Dr Jim is proposing then simple information theory says he doesn't have enough memory. If he's not proposing that but instead has some other idea in mind, then he hasn't explained what it might be - or why the Propeller is a particularly good platform on which to do it.

    As for my theory of brain functionality (and remember, I'm not the one who claims to have one!) - I'll happily explain mine once Dr Jim explains his. His videos certainly don't appear to explain anything.

    Perhaps BradC is right and Dr Jim is soaring at 20,000 ft while the rest of us are dirtbound. I'd be willing to concede this - once Dr Jim provides some evidence.

    Ross.

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    Catalina - a FREE C compiler for the Propeller - see Catalina
  • Nick MuellerNick Mueller Posts: 815
    edited 2009-07-31 15:39
    > I'm not trying to prove anything here, just trying to give a little more substantiation to my claims, that's all.

    That's OK.
    But what you are doing is present a still picture into a tool-box and someone talking in the background about a break-through in engine-design that makes more than 100 mpg and in which way to turn a screw. "And you only have to buy my set of screw-drivers to share this break-trough at the end of the year".

    Sorry, it's *you* presenting these videos that make them look like a scam.

    You have already learned that here's a rats nest of critical observers. And they want answers and explanations about principles that are new to them. Don't explain them in a 16 minutes video which way to grab a soldering iron. wink.gif


    Nick

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    Never use force, just go for a bigger hammer!

    The DIY Digital-Readout for mills, lathes etc.:
    YADRO
  • MicrocontrolledMicrocontrolled Posts: 2,461
    edited 2009-07-31 15:47
    I saw that video - The thing is that no one knows exactly HOW the brain works but for decades people have been trying to come up with an explination for it. Odds are he is wrong, for even the smartest of us have a far chance at imitating the most complicated organ in the whole body, but there is always a 1 in 1,000,000,000,000,000,000,000 chance that he is right. Dr. Jim might be right or wrong, but if he is right, it will be the biggest scientific breaktrough in history!

    Good Luck, Dr. Jim.

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    Toys are microcontroled.
    Robots are microcontroled.
    I am microcontroled.



    If it's not Parallax then don't even bother. :-)
    ·

    Mini-Din/PS2 connectors are for sale! 5 for $1! PM me if you wish to make an order.
    Cheap·shipping unless specified!··········150 left!!··


  • mallredmallred Posts: 122
    edited 2009-07-31 15:57
    @Ross,

    Great! You are thinking about it. I see the gears turning.

    @Nick, are you sure you watched the right set of videos?

    Mark
  • mallredmallred Posts: 122
    edited 2009-07-31 16:00
    @microcontrolled,

    Dr. Jim admits that his is not the only solution, but it is a start. He may not have all of it right, but that's ok. This is a good first start. I have seen things that he can do that I have not seen anyone else be able to do. So, a perfect replica of the brain is not the goal here, but trying our best to approximate our understanding of it, rather, is what we are trying to do. It can always be improved upon. Of that I am certain.

    Mark
  • LeonLeon Posts: 7,620
    edited 2009-07-31 16:01
    I didn't hear anything particularly relevant to machine intelligence in those very boring clips. Dr Jim could have imparted the same amount of information in a couple of written paragraphs.

    Leon

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    Amateur radio callsign: G1HSM
    Suzuki SV1000S motorcycle
  • John AbshierJohn Abshier Posts: 1,116
    edited 2009-07-31 16:53
    I've watched the videos and read the first article in Robot magazine. I've use the Propeller in the last 4 robots that I have built and love it. But I have a question that won't go away. Why is Dr. Jim using a Propeller? I think the final design requires 3 or 4 Propellers. If you need lots of memory and an OS why not use a PC? If you give me a system with AI, vision, speech recoginition, speech output, I will build a robot that can carry a laptop.

    John Abshier
  • Nick MuellerNick Mueller Posts: 815
    edited 2009-07-31 16:54
    > @Nick, are you sure you watched the right set of videos?

    Good question!
    I looked at the three videos in your link. But I found no discussion about "machine intelligence". But at least the title said so.

    If your question was targeted to my saying "screwdriver" and "engine": Just shift a problem or description to a different domain but keep the meaning of the words. This is a trick to sometimes understand things easier. So "screwdriver" translates to "debugger" and "zero & one" to "wich way round to turn a screw" etc.


    Nick

    ▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔▔
    Never use force, just go for a bigger hammer!

    The DIY Digital-Readout for mills, lathes etc.:
    YADRO
Sign In or Register to comment.