Learning of Highest Order Q) Why Algorithmic leaps can be better than Hardware leaps? Hardware constraints create bottlenecks that are hard to tackle as uncertainty of physics at small scale (nano-meters and less) come into play ( ). Ans) electrons start jumping around At this point, ideas (algorithms) can be used to unleash full potential of the feasible hardware. Q) Why these improvements are so beneficial for Machine Learning? Machine (ML) programs can easily involve: Ans) Learning Billions of computations with Similar equations hundreds to millions degree of exponents Most of each other (can be parallelised or distributed) computations are independent Hence even a small optimisation can have very visible effects, saving you from a few hours to months! Q) Why refer to the brain for optimisations? Short answer, without the below mentioned evolution in human brain, we might have looked like: Ans) The Memory-Prediction Framework Q) What is Neocortex? which is the outer layer of the . Ans) Neocortex is the largest part of the cerebral cortex cerebrum Q) Why is neocortex important? , also called the , is the part of the mammalian brain involved in such as , , , and ( ). Ans) Neocortex isocortex higher-order brain functions sensory perception cognition generation of motor commands spatial reasoning language partially Extra : The neocortex is further subdivided into the and the . More about working of Neocortex can be found , and ( ). true isocortex proisocortex here here here curiosity might just make you open the links Q) How is neocortex relevant to machine learning? ( ) is based on of the human brain. Ans) Hierarchical temporal memory HTM interaction of pyramidal neurons in the neocortex At the core of HTM: Learning algorithms that can store, learn, infer and recall high-order sequences Learn time-based patterns in unlabeled data on a continuous basis . Robust to noise and high capacity, meaning that it can learn multiple patterns simultaneously When applied to computers, HTM is well suited for prediction, anomaly detection, classification and ultimately sensorimotor applications. The on account of hierarchies observed in some naturally occurring neural , such as those observed in the brain. HTM has a hierarchical topology networks Human Memory hierarchy can be really really complex! Example: Or in Simplified form: As one moves up the hierarchy, representations have increased: Extent: for example, larger areas of the visual field, or more extensive tactile regions. Temporal stability: lower-level entities change quickly, whereas, higher-level percepts (mental-concepts) tend to be more stable. Abstraction: through the process of successive extraction of invariant features, increasingly abstract entities are recognised. Less resource intensive: require much less resources especially memory. Human brain’s algorithmic efficiency is almost petrifyingly high! Philosphy’s Treasure, The Introspection Q) What is Introspection? or , is self-awareness about one’s thinking or ‘ability to think about the thinking’. A high-level mental process (very high). Asn) Introspection metacognition Accurate introspection ables discrimination between correct decisions and incorrect ones. Basically, a learner developing a conscious. Being self-able to reject or encourage patterns during training. Hence a self-optimising learner, the very necessity of General Learning. Example: (two pictures in binocular vision, one from each eye) are one of the most popular approaches to studying the neural mechanism of conscious visual perception. Bistable Stimuli Such stimuli contain conflicting information, which the visual system cannot integrate into a unified percept. This causes the perceptual (ability to interpret) state of the observer to change every few seconds trying to figure out correct interpretation. All this while the physical stimulus remains the same. In this case the frontal lobe of cerebrum makes a self aware (introspective) decision to reject either information or modify each information to eliminate conflict. Details of this can be found in this by Natalia Zaretskaya and Marine Narinyan paper Q) What is gray matter? The interior of the is organised into . Ans) central nervous system gray and white matter consists of nerve cells embedded in ; it has a gray color. Gray matter neuroglia (nervous tissue made up of large number of nerve cells) Q) Why is gray matter important? In humans the gray-matter volume might help clarify the extent to which a person’s confidence about his introspective abilities is supported. Also how accurate his introspective abilities are. Ans) More gray matter usually signifies more intelligence. As Einstein once said “Gray Matter bitches!” ….. no, he actually didn’t. Q) Then why don’t we directly implement the working of gray matter? Simply because the working of gray matter is very very complex. We do not know the exact correlation between ‘ ’ and ‘ ’ one’s introspective abilities. Ans) confidence in accuracy of Q) So what do we know? Introspection is still (after millions years of evolution) a rare abilities even for complex organisms with most organisms lacking this ability completely. This has been one of the most recent development in evolution. Ans) Q) Which part of the brain is responsible for introspection? in cerebrum. Ans) Prefrontal cortex ( ) is the cerebral cortex which covers the front part of the frontal lobe. Prefrontal cortex PFC Two parts of this area are of great interest: Anterior prefrontal cortex Medial prefrontal cortex Q) What’s special about Anterior prefrontal cortex? has been associated with top-level processing abilities that are thought to set humans apart from other animals. Ans) Anterior prefrontal cortex (right anterior prefrontal cortex, to be precise). The structure of neighbouring white matter plays some (unclear) role in introspective capabilities too. Most of the gray-matter which plays the role in introspection exists in this region This brain region has been implicated in planning , , , and . The basic activity of this brain region is considered to be . complex cognitive behaviour personality expression decision making moderating social behaviour orchestration of thoughts and actions in accordance with internal goals Q) What does that mean in terms of machine learning? I’ll answer this in short point Ans) Learner that is aware of it’s decision Leaner that adapts to it’s environment Learner that can set it’s goals on the go Learner that can Generalise massive information in just a few patterns Q) And what’s special about Medial prefrontal cortex? is considered to be a part of the . Ans) Medial prefrontal cortex (mPFC) brain’s reward system The mPFC is part of the system ( ). mesocorticolimbic dopaminergic basically it generates dopamine, the ‘happy enzyme’ Evidence for the involvement of the mPFC in reward-related mechanisms comes mainly from three types of studies: : measure the motivational effects of objects or experiences Conditioned Place Preference (CPP) : what conditions trigger brain reward system Intracranial Self-Stimulation (ICSS) : which external drug (like insulin for diabetes) the brain wants Self-Administration What’s interesting about this reward system is: . This indicates existence of . Different subareas of the mPFC appear to be differently involved in the ‘rewarding actions’ of different drugs multiple reward systems Which can be represented as . Some drugs can produce reward directly within the mPFC, and that some drugs, even though not having direct rewarding effects within the mPFC, depend on the function of the mPFC for the mediation of their rewarding effects. multi-tier reward process Q) What does that mean in terms of machine learning? Even shorter answer: Ans) WHOLE OF REINFORCEMENT LEARNING Q) What’s reinforcement learning? A type of machine learning that involves: Ans) (trial and error on bases of rewards) No Supervision Good or Bad is decided a few steps later, not instantaneously Dynamic system so time really matters, sequence of steps really matters Agent gets to take action and alter/influence it’s environment For and it’s every action the Agent gets a reward job is to maximise it It works something like this: Q) Confused? _‘_Reward’ is what enables to prioritise one decision over other. Ans) It is a scalar feedback, quantifying how well agent is adapting/interacting with environment. Like you give treat to your dog if he sits first else no treat (why u no gud boi?!). The reinforcement learner simply follows the steps which maximise the cumulative reward. essentially mean that brain has inbuilt reinforcement learning mechanism. Multiple reward systems multi actor-critic In simple words, actor-critic learning involves an and . actor who takes an action critic finds pros and cons (criticises) in that action Q) Role of reward system sounds very similar to introspection?? Well that’s because reward system does play a major part in one’s introspective abilities. This relation, though, is REALLY COMPLEX. Ans) “Reinforcemennt learning is simply Science of Decision Making. That’s what makes it so General.” — David Silver So Prefrontal Lobe is frontier in field of General Intelligence!
![What Are Convolution Neural Networks? [ELI5]](https://hackernoon.imgix.net/images/69s32rn.jpg?auto=format&fit=max&w=3840)
