Notices
Results 1 to 7 of 7

Thread: Why does Hebbian learning work?

  1. #1 Why does Hebbian learning work? 
    HTM fan
    Join Date
    Dec 2012
    Location
    U.S.
    Posts
    227
    Hebbian learning is where each neuron (which represents an aspect such as "shoe" or "blue" or "top left of visual field") connects to other neurons which generally fire at the same time. So if you generally saw a nose on a face, the nose neuron would connect to the face neuron.
    I've heard a lot of ideas about why this works. A lot of them are useful, and can create abilites such as prediction. However, all (2) of the ideas I've heard of/figured out require some kind of structure to work. Some parts of the brain have no structure. Neurons can connect to any other neuron in the nuclei (a cluster of neurons), in any direction. How is this useful?

    Hebbian theory - Wikipedia, the free encyclopedia (note that weights are fake, according to Jeff Hawkins. A connection ahs a weight of 1, and a neuron's threshold can vary.) http://en.wikipedia.org/wiki/Nucleus_(neuroanatomy) https://www.youtube.com/user/numenta...ow=grid&view=0

    You don't have to pay attention to all the technicalities and links to be able to contribute something applicable to everything else.


    "It is the ability to make predictions about the future that is the crux of intelligence."
    -Jeff Hawkins.
    For example, you can predict that 3+5=8. You can predict what sequence of muscle commands you should generate during a conversation, or whether an object is a desk or a chair. The brain is very complicated, but that is essentially how intelligence works. Instinct, emotions, and behavior are somewhat seperate.
    Reply With Quote  
     

  2.  
     

  3. #2  
    SHF
    SHF is offline
    Forum Sophomore
    Join Date
    Sep 2012
    Location
    London
    Posts
    107
    I'm not sure what your question is, can your rephrase it?

    also, what do you mean when you say 'some parts of the brain have no structure'?


    Reply With Quote  
     

  4. #3  
    HTM fan
    Join Date
    Dec 2012
    Location
    U.S.
    Posts
    227
    When 2 neurons generally fire at the same time, one will cause the other to activate if it is active.
    Some parts of the brain have neurons with connections to any other neuron in that part. Why are those 2 things combined useful?
    "It is the ability to make predictions about the future that is the crux of intelligence."
    -Jeff Hawkins.
    For example, you can predict that 3+5=8. You can predict what sequence of muscle commands you should generate during a conversation, or whether an object is a desk or a chair. The brain is very complicated, but that is essentially how intelligence works. Instinct, emotions, and behavior are somewhat seperate.
    Reply With Quote  
     

  5. #4  
    SHF
    SHF is offline
    Forum Sophomore
    Join Date
    Sep 2012
    Location
    London
    Posts
    107
    perhaps I'm missing your point, but wouldn't it be rather useful in an area where all the neurons are connected to be able to have a mechanism whereby the synaptic strengths can be altered?
    Reply With Quote  
     

  6. #5  
    HTM fan
    Join Date
    Dec 2012
    Location
    U.S.
    Posts
    227
    Yes, but why in that way?
    "It is the ability to make predictions about the future that is the crux of intelligence."
    -Jeff Hawkins.
    For example, you can predict that 3+5=8. You can predict what sequence of muscle commands you should generate during a conversation, or whether an object is a desk or a chair. The brain is very complicated, but that is essentially how intelligence works. Instinct, emotions, and behavior are somewhat seperate.
    Reply With Quote  
     

  7. #6  
    SHF
    SHF is offline
    Forum Sophomore
    Join Date
    Sep 2012
    Location
    London
    Posts
    107
    it's a coincidence detector. what other way would you like it to work?
    Reply With Quote  
     

  8. #7  
    HTM fan
    Join Date
    Dec 2012
    Location
    U.S.
    Posts
    227
    Quote Originally Posted by SHF View Post
    it's a coincidence detector. what other way would you like it to work?
    I know, but how is that useful? There are other ways Hebbian learning can be used, such as predicting what will occur next or controlling the connections from an intelligent part to an output, if the output also has hard-wired inputs.
    I guess to know how that is useful requires knowing about all the connections of the part I'm talking about to other parts.
    Kind of a pointless thread.
    "It is the ability to make predictions about the future that is the crux of intelligence."
    -Jeff Hawkins.
    For example, you can predict that 3+5=8. You can predict what sequence of muscle commands you should generate during a conversation, or whether an object is a desk or a chair. The brain is very complicated, but that is essentially how intelligence works. Instinct, emotions, and behavior are somewhat seperate.
    Reply With Quote  
     

Similar Threads

  1. Learning How
    By IOPTFEAR in forum Electrical and Electronics
    Replies: 3
    Last Post: February 17th, 2010, 11:24 PM
  2. Self learning
    By Aether in forum Mathematics
    Replies: 11
    Last Post: February 13th, 2010, 11:25 PM
  3. What Are you Learning
    By in forum Mathematics
    Replies: 46
    Last Post: November 4th, 2009, 03:54 PM
  4. Asking isn't learning
    By marcusclayman in forum Behavior and Psychology
    Replies: 0
    Last Post: October 20th, 2009, 08:00 AM
  5. e-learning
    By biotoy in forum General Discussion
    Replies: 2
    Last Post: April 25th, 2008, 12:59 PM
Bookmarks
Bookmarks
Posting Permissions
  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •