Beginner's Guide to NuPIC

•Download as PPTX, PDF•

3 likes•5,412 views

Numenta

Software Technology Education

Beginner’s Guide to Developing
with NuPIC
Scott Purdy
May 3, 2014

Levels of Abstraction
• Algorithms
– Encoders
– Spatial Pooler
– Sequence Memory (Temporal Pooler)
– CLA Classifier (not covered)
• Networks and Regions – supports topology
• Online Prediction Framework (OPF)
– CLAModel (network and algorithm wrapper)
– OpfRunExperiment.py
– run_swarm.py
– experiment.json (not covered)

Interactive work with ipython notebook:
http://nbviewer.ipython.org/url/fer.io/~scott/nu
pic_overview.ipynb

Network and Regions API
• Supports arbitrary topology
• Formalizes serialization (but delegates
implementation to each region)
• Handles data flow through network

Network and Regions API
Classifier
L2 Temporal Pooler
L2 Spatial Pooler
L1 Temporal Pooler
L1 Spatial Pooler
Audio
L1 Temporal Pooler
L1 Spatial Pooler
Image

Viewers also liked

Jeff Hawkins discussed recent advances in cortical theory made by Numenta during the HTM Meetup on 11/03/2017. These discoveries are described in the recently published peer-reviewed paper, “A Theory of How Columns in the Neocortex Enable Learning the Structure of the World.” Jeff walked through the text and figures in the paper, as well as discussed the significance of these advances and the importance they play in AI and cortical theory. The recording of the HTM Meetup is available at https://www.youtube.com/watch?v=c6U4yBfELpU&t=

Numenta Brain Theory Discoveries of 2016/2017 by Jeff Hawkins

Numenta

Predictive Analytics with Numenta Machine Intelligence

Numenta

What the Brain says about Machine Intelligence

Numenta

Copy and paste this URL to your browser to watch the live presentation: https://www.youtube.com/watch?v=-h-cz7yY-G8 Abstract: Today’s wave of AI technology is still being driven by the ANN neuron pioneered decades ago. Hierarchical Temporal Memory (HTM) is a realistic biologically-constrained model of the pyramidal neuron reflecting today’s most recent neocortical research. This talk will describe and visualize core HTM concepts like sparse distributed representations, spatial pooling and temporal memory. Strong AI is a common goal of many computer scientists. So far, machine learning techniques have created amazing results in narrow fields, but haven’t produced something we could all call “intelligent”. Given recent advances in neuroscience research, we know a lot more about how neurons work together now than we did when ANNs were created. We believe systems with a more realistic neuronal model will be more likely to produce Strong AI. Hierarchical Temporal Memory is a theory of intelligence based upon neuroscience research. The neocortex is the seat of intelligence in the brain, and it is structurally homogeneous throughout. This means a common algorithm is processing all your sensory input, no matter which sense. We believe we have discovered some of the foundational algorithms of the neocortex, and we’ve implemented them in software. I’ll show you how they work with detailed dynamic visualizations of Sparse Distributed Representations, Spatial Pooling, and Temporal Memory.

The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Numenta

Marcus gave a talk called "Recognizing Locations on Objects" during the HTM Meetup on 11/03/2017. The brain learns and recognizes objects with independent moving sensors. It’s not obvious how a network of neurons would do this. Numenta has suggested that the brain solves this by computing each sensor’s location relative to the object, and learning the object as a set of features-at-locations. Marcus showed how the brain might determine this “location relative to the object.” He extended the model from Numenta’s recent paper, "A Theory of How Columns in the Neocortex Enable Learning the Structure of the World," so that it computes this location. This extended model takes two inputs: each sensor’s input, and each sensor’s “location relative to the body.” The model connects the columns in such a way that a column can compute its “location relative to the object” from another column’s “location relative to object.” When a column senses a feature, it recalls a union of all locations where it has sensed this feature, then the columns work together to narrow their unions. This extended model essentially takes its sensory input and asks, “Do I know any objects that contain this spatial arrangement of features?”

Recognizing Locations on Objects by Marcus Lewis

Numenta

a tour of several popular tensorflow models

jtoy

Sparse Distributed Representations: Our Brain's Data Structure

Numenta

HTM Spatial Pooler

Numenta

ICMNS Presentation: Presence of high order cell assemblies in mouse visual co...

Numenta

Applications of Hierarchical Temporal Memory (HTM)

Numenta

Getting Started with Numenta Technology

Numenta

TouchNet preview at Numenta

jtoy

Viewers also liked (12)

Numenta Brain Theory Discoveries of 2016/2017 by Jeff Hawkins

Predictive Analytics with Numenta Machine Intelligence

What the Brain says about Machine Intelligence

The Biological Path Towards Strong AI Strange Loop 2017, St. Louis

Recognizing Locations on Objects by Marcus Lewis

a tour of several popular tensorflow models

Sparse Distributed Representations: Our Brain's Data Structure

HTM Spatial Pooler

ICMNS Presentation: Presence of high order cell assemblies in mouse visual co...

Applications of Hierarchical Temporal Memory (HTM)

Getting Started with Numenta Technology

TouchNet preview at Numenta

Similar to Beginner's Guide to NuPIC

OpenStack has been a part of OPNFV from the start and the OpenStack and OPNFV communities have strong areas of overlap. We will explain OPNFV from an Openstack and practical perspective, providing a specific example (SFC scenario) of how we are daily testing different components of OpenStack and other communities (ODL, OVS, etc). We’ll also talk about how OPNFV is useful to OpenStack because (hint: telco requirements & testing) and briefly describe several OPNFV projects which have contributed to OpenStack: NetReady, Multisite, Doctor, Cross CI, Copper, etc.

How OPNFV Uses OpenStack & How It's Useful

OPNFV

The Joy of SciPy

kammeyer

Simulating the behavior of satellite Internet links to small islands

APNIC

Review of micro Orm in c#

Kanstantsin Harbachou

LCA14: LCA14-209: ODP Project Update

Linaro

Routing is the process of selecting paths in a network Routing protocols are key elements of modern communication networks Interior Gateway Protocols (IGP): within an Autonomous System (AS) RIP, EIGRP, and OSPF Exterior Gateway Protocol (EGP): between ASs Border Gateway Protocol (BGP) Metrics: cost, bandwidth, maximum transmission unit (MTU), packet delay, and hop count OPNET Modeler was used to compare performance of RIP, EIGRP, and OSPF

Performance Analysis of Dynamic Routing Protocols using OPNET

Muzahidul Islam

In this video from the 2015 Stanford HPC Conference, Pavel Shamis from ORNL presents: Preparing OpenSHMEM for Exascale. "OpenSHMEM is a partitioned global address space (PGAS) one-sided communications library that enables remote memory access (RMA) across processing elements (PEs). Its API allows data to be transferred from one PE memory space to another PE’s symmetric memory space; decoupling the data transfers from synchronizations. OpenSHMEM is useful for applications that are latency driven or that have irregular communication patterns, because its one-sided API can be mapped very efficiently to hardware (e.g. RDMA interconnects, etc), and its one-sided programming model helps the overlapping of communication with computation. Summit is Oak Ridge National Laboratory’s next high performance supercomputer system that will be based on a many core/GPU hybrid architecture. In order to prepare OpenSHMEM for future systems, it is important to enhance its programming model to enable efficient utilization of the new hardware capabilities (e.g. massive multithreaded systems, accesses different type memories, next generation of interconnects, etc). This session will present recent advances in the area of OpenSHMEM extensions, implementations, and tools.” Watch the video: http://insidehpc.com/2015/02/video-preparing-openshmem-for-exascale/ See more talks in the Stanford HPC Conference Video Gallery: http://wp.me/P3RLHQ-dOO

Preparing OpenSHMEM for Exascale

inside-BigData.com

Ryu sdn framework

Isaku Yamahata

BKK16-106 ODP Project Update

Linaro

Introduction to Storm

Chandler Huang

Cumulus networks - Overcoming traditional network limitations with open source

Nat Morris

Data science online camp using the flipn stack for edge ai (flink, nifi, pu...

Timothy Spann

Opentracing jaeger

Oracle Korea

Distributed Tracing with Jaeger

Inho Kang

The landscape of security threats an enterprise faces is vast. It is imperative for an organization to know when one of the machines within the network has been compromised. One layer of detection can take advantage of the DNS requests made by machines within the network. A request to a Command & Control (CNC) domain can act as an indication of compromise. It is thus advisable to find these domains before they come into play. The team at Akamai aims to do just that. In this session, Aminov will share Akamai’s experience in porting their PoC detection algorithms, written in Python, to a reliable production-level implementation using Scala and Apache Spark. He will specifically cover their experience regarding an algorithm they developed to detect botnet domains based on passive DNS data. The session will also include some useful insights Akamai has learned while handing out solutions from research to development, including the transition from small-scale to large-scale data consumption, model export/import using PMML and sampling techniques. This information is valuable for researchers and developers alike.

From Python Scikit-learn to Scala Apache Spark—The Road to Uncovering Botnets...

Databricks

Jaeger and OpenTracing Cloud Native Computing (CNCF) meetup Zurich

⛑ Pavol Loffay

MPLS Deployment Chapter 1 - Basic

Ericsson

Functional approach to packet processing

Nicola Bonelli

NS3 Overview

Rahul Hada

CentOS NFV SIG Introduction and Update

Tom Herbert

Similar to Beginner's Guide to NuPIC (20)

How OPNFV Uses OpenStack & How It's Useful

The Joy of SciPy

Simulating the behavior of satellite Internet links to small islands

Review of micro Orm in c#

LCA14: LCA14-209: ODP Project Update

Performance Analysis of Dynamic Routing Protocols using OPNET

Preparing OpenSHMEM for Exascale

Ryu sdn framework

BKK16-106 ODP Project Update

Introduction to Storm

Cumulus networks - Overcoming traditional network limitations with open source

Data science online camp using the flipn stack for edge ai (flink, nifi, pu...

Opentracing jaeger

Distributed Tracing with Jaeger

From Python Scikit-learn to Scala Apache Spark—The Road to Uncovering Botnets...

Jaeger and OpenTracing Cloud Native Computing (CNCF) meetup Zurich

MPLS Deployment Chapter 1 - Basic

Functional approach to packet processing

NS3 Overview

CentOS NFV SIG Introduction and Update

More from Numenta

Deep learning at the edge: 100x Inference improvement on edge devices

Numenta

Meetup page: https://www.meetup.com/Brains-Bay/events/284481247/ Neuromodulators are signalling chemicals in the brain, which control the emergence of adaptive learning and behaviour. Neuromodulators including dopamine, acetylcholine, serotonin and noradrenaline operate on a spectrum of spatio-temporal scales in tandem and opposition to reconfigure functions of biological neural networks and to regulate global cognition and state transition. Although neuromodulators are important in shaping cognition, their phenomenology is yet to be fully realized in deep neural networks (DNNs). In this talk, we will give an overview of the biological organizing principles of neuromodulators in adaptive cognition and highlight the competition and cooperation across neuromodulators.

Brains@Bay Meetup: A Primer on Neuromodulatory Systems - Srikanth Ramaswamy

Numenta

Meetup page: https://www.meetup.com/Brains-Bay/events/284481247/ A hallmark of intelligence is the ability to learn new flexible, cognitive behaviors - that is, behaviors that require discovering, storing and exploiting novel information for each new instance of the task. In meta-learning, agents are trained with external algorithms to learn one specific cognitive task. However, animals are able to pick up such cognitive tasks automatically, as a result of their evolved neural architecture and synaptic plasticity mechanisms, including neuromodulation. Here we evolve neural networks, endowed with plastic connections and reward-based neuromodulation, over a sizable set of simple meta-learning tasks based on a framework from computational neuroscience. The resulting evolved networks can automatically acquire a novel simple cognitive task, never seen during evolution, through the spontaneous operation of their evolved neural organization and plasticity system. We suggest that attending to the multiplicity of loops involved in natural learning may provide useful insight into the emergence of intelligent behavior.

Brains@Bay Meetup: How to Evolve Your Own Lab Rat - Thomas Miconi

Numenta

We receive information about the world through our sensors and influence the world through our effectors. Such low-level data has gradually come to play a greater role in AI during its 70-year history. I see this as occurring in four steps, two of which are mostly past and two of which are in progress or yet to come. The first step was to view AI as the design of agents which interact with the world and thereby have sensorimotor experience; this viewpoint became prominent in the 1980s and 1990s. The second step was to view the goal of intelligence in terms of experience, as in the reward signal of optimal control and reinforcement learning. The reward formulation of goals is now widely used but rarely loved. Many would prefer to express goals in non-experiential terms, such as reaching a destination or benefiting humanity, but settle for reward because, as an experiential signal, reward is directly available to the agent without human assistance or interpretation. This is the pattern that we see in all four steps. Initially a non-experiential approach seems more intuitive, is preferred and tried, but ultimately proves a limitation on scaling; the experiential approach is more suited to learning and scaling with computational resources. The third step in the increasing role of experience in AI concerns the agent’s representation of the world’s state. Classically, the state of the world is represented in objective terms external to the agent, such as “the grass is wet” and “the car is ten meters in front of me”, or with probability distributions over world states such as in POMDPs and other Bayesian approaches. Alternatively, the state of the world can be represented experientially in terms of summaries of past experience (e.g., the last four Atari video frames input to DQN) or predictions of future experience (e.g., successor representations). The fourth step is potentially the biggest: world knowledge. Classically, world knowledge has always been expressed in terms far from experience, and this has limited its ability to be learned and maintained. Today we are seeing more calls for knowledge to be predictive and grounded in experience. After reviewing the history and prospects of the four steps, I propose a minimal architecture for an intelligent agent that is entirely grounded in experience.

Brains@Bay Meetup: The Increasing Role of Sensorimotor Experience in Artifici...

Numenta

In this talk, I will propose a conceptual framework sketching a path toward open-ended skill acquisition through the coupling of environmental, morphological, sensorimotor, cognitive, developmental, social, cultural and evolutionary mechanisms. I will illustrate parts of this framework through computational experiments highlighting the key role of intrinsically motivated exploration in the generation of behavioral regularity and diversity. Firstly, I will show how some forms of language can self-organize out of generic exploration mechanisms without any functional pressure to communicate. Secondly, we will see how language — once invented — can be recruited as a cognitive tool that enables compositional imagination and bootstraps open-ended cultural innovation. For more:

Brains@Bay Meetup: Open-ended Skill Acquisition in Humans and Machines: An Ev...

Numenta

Most current deep neural networks learn from a static data set without active interaction with the world. We take a look at how learning through a closed loop between action and perception affects the representations learned in a DNN. We demonstrate how these representations are significantly different from DNNs that learn supervised or unsupervised from a static dataset without interaction. These representations are much sparser and encode meaningful content in an efficient way. Even an agent who learned without any external supervision, purely through curious interaction with the world, acquires encodings of the high dimensional visual input that enable the agent to recognize objects using only a handful of labeled examples. Our results highlight the capabilities that emerge from letting DNNs learn more similar to biological brains, though sensorimotor interaction with the world. For more:

Brains@Bay Meetup: The Effect of Sensorimotor Learning on the Learned Represe...

Numenta

SBMT 2021: Can Neuroscience Insights Transform AI? - Lawrence Spracklen

Numenta

Nick Ni (Xilinx) and Lawrence Spracklen (Numenta) presented a talk at the FGPA Conference Europe on July 8th, 2021. In this talk, they presented a neuroscience approach to optimize state-of-the-art deep learning networks into sparse topology and how it can unlock significant performance gains on FPGAs without major loss of accuracy. They then walked through the FPGA implementation where they exploited the advantage of sparse networks with a unique Domain Specific Architecture (DSA).

FPGA Conference 2021: Breaking the TOPS ceiling with sparse neural networks -...

Numenta

BAAI Conference 2021: The Thousand Brains Theory - A Roadmap for Creating Mac...

Numenta

Jeff Hawkins presents a talk on "How the Brain Uses Reference Frames to Model the World, Why AI Needs to do the Same." In this talk, he gives an overview of The Thousand Brains Theory and discusses how machine intelligence can benefit from working on the same principles as the neocortex. This talk was first presented at the NAISys conference on November 10, 2020. You can find a re-recording of the talk here: https://youtu.be/mGSG7I9VKDU

Jeff Hawkins NAISys 2020: How the Brain Uses Reference Frames, Why AI Needs t...

Numenta

In this research meeting, guest Stephen Omohundro gave a fascinating talk on GPT-3, the new massive OpenAI Natural Language Processing model. He reviewed the network architecture, training process, and results in the context of past work. There was extensive discussion on the implications for NLP and for Machine Intelligence / AGI. Link to GPT-3 paper: https://arxiv.org/abs/2005.14165 Link to YouTube recording of Steve's talk: https://youtu.be/0ZVOmBp29E0

OpenAI’s GPT 3 Language Model - guest Steve Omohundro

Numenta

CVPR 2020 Workshop: Sparsity in the neocortex, and its implications for conti...

Numenta

Sparsity In The Neocortex, And Its Implications For Machine Learning

Numenta

Recent advances in reverse engineering the neocortex reveal that it is a highly-distributed sensory-motor modeling system. Each cortical column learns complete models of observed objects through movement and sensation. The columns use long-range connections to vote on what objects are currently being observed. In this talk, we introduce the key elements of this theory and describe how these elements can be introduced into current machine learning techniques to improve their capabilities, robustness, and power requirements.

The Thousand Brains Theory: A Framework for Understanding the Neocortex and B...

Numenta

Jeff Hawkins Human Brain Project Summit Keynote: "Location, Location, Locatio...

Numenta

Location, Location, Location - A Framework for Intelligence and Cortical Comp...

Numenta

Have We Missed Half of What the Neocortex Does? A New Predictive Framework ...

Numenta

Locations in the Neocortex: A Theory of Sensorimotor Prediction Using Cortica...

Numenta

The Predictive Neuron: How Active Dendrites Enable Spatiotemporal Computation...

Numenta

These are Matt Taylor's slides from the AI Singapore Meetup on May 17, 2018. Abstract: Today’s wave of AI technology is still being driven by the ANN neuron pioneered decades ago. Hierarchical Temporal Memory (HTM) is a realistic biologically-constrained model of the pyramidal neuron reflecting today’s most recent neocortical research. This talk will describe and visualize core HTM concepts like sparse distributed representations, spatial pooling and temporal memory. Strong AI is a common goal of many computer scientists. So far, machine learning techniques have created amazing results in narrow fields, but haven’t produced something we could all call “intelligent”. Given recent advances in neuroscience research, we know a lot more about how neurons work together now than we did when ANNs were created. We believe systems with a more realistic neuronal model will be more likely to produce Strong AI. Hierarchical Temporal Memory is a theory of intelligence based upon neuroscience research. The neocortex is the seat of intelligence in the brain, and it is structurally homogeneous throughout. This means a common algorithm is processing all your sensory input, no matter which sense. We believe we have discovered some of the foundational algorithms of the neocortex, and we’ve implemented them in software. I’ll show you how they work with detailed dynamic visualizations of Sparse Distributed Representations, Spatial Pooling, and Temporal Memory.

The Biological Path Toward Strong AI by Matt Taylor (05/17/18)

Numenta

More from Numenta (20)