ESCP Europe Torino Campus Wikistage
•
1 like•697 views
This document discusses the rise of artificial intelligence and machine learning. It notes that IBM invested over $1 billion to establish a new business unit for Watson. It also mentions Google's acquisitions of robotics and AI companies, showing their focus on data acquisition. The document argues that AI requires ubiquitous data collection and exponentially growing computing power to continue advancing. It recognizes that while the path of intelligent machines' evolution is unclear, it will likely progress faster than expected due to exponential growth.
Recommended
More Related Content
What's hot
What's hot (20)
Similar to ESCP Europe Torino Campus Wikistage
Similar to ESCP Europe Torino Campus Wikistage (20)
More from Enrico Busto
More from Enrico Busto (18)
Recently uploaded
Recently uploaded (17)
ESCP Europe Torino Campus Wikistage
- 1. Wikistage - ESCP Europe Torino Campus Educatorio della Provvidenza, Torino, Italia
- 3. WE ARE AT THE END OF THE BEGINNING John Kelly SVP - Director of IBM Research
- 6. iCub.org an open source cognitive humanoid robotic platform
- 7. There is a Global Effort to develop COGNITIVE COMPUTING IBM (IBM.N) said it will invest more than $1 billion to establish a new business unit for Watson Reuters - Thu Jan 9, 2014 2:50am EST "The biggest thing will be Artificial Intelligence," Schmidt (Google CEO) said at Oasis Bloomberg - Mar 6, 2014 10:07 PM GMT+0100 China's top search engine Baidu Inc. has hired Google Inc's former Artificial Intelligence (AI) chief Andrew Ng Reuters - Fri May 16, 2014 4:58pm EDT
- 10. Yann LECUN Industry kept-up faster than Academia Opportunities are closing rapidly Opportunities are in Vertical Applications bit.ly/Lecun-FB2014 bit.ly/AI-McKinsey
- 12. MACHINE LEARNING AS A SERVICE (MLaaS)
- 14. tensorflow.org
- 15. Numenta has developed a cohesive theory, core software technology, and numerous applications all based on principles of the neocortex. This technology lays the groundwork for the new era of machine intelligence. numenta.com
- 16. Computer Science Data Science (MACHINE LEARNING) Domain Knowledge (Engineering) Embedded Software Electronics add-for.com
- 18. Target Detected Class: Missile Launcher Type: MAZ-543 Uragan IMAGING - AEROSPACE & DEFENCE add-for.com
- 19. PTC Performance Traction Control Maximum Traction + Sideslip Angle Control Integration of ATC and SSE: Supports the driver in driving sport mode leaving more control and enjoyment while keeping safety Can be set to two targets: + PERFORMANCE : Maximum Cornering Speed and Acceleration on Corner Exit add-for.com
- 22. myjibo.com
- 25. EARLY SIGNS OF THE INCOMING REVOLUTION
- 26. UBIQUITOUS DATA COLLECTION Artificial Intelligence is DATA HUNGRY
- 27. Partial List of mergers and acquisitions by Google 2013 03 12 - DNNresearch Inc. (Deep NN) 2013 12 02 - SCHAFT Inc. (Robotics) 2013 12 03 - Industrial Perception (Robotics) 2013 12 04 - Redwood Robotics (Robotics) 2013 12 05 - Meka Robotics (Robotics) 2013 12 06 - Bot & Dolly (Robotics) 2013 12 10 - Boston Dynamics (Robotics) 2014 01 26 - Deepmind Technologies (AI) 2014 04 14 - Titan Aerospace (High Altitude UAVs) 2014 06 10 - Skybox Imaging (Real Time Satellite Video) 2014 08 17 - Jetpac (AI) GLOBAL SCALE DATA ACQUISITION
- 28. teslamotors.com
- 29. nest.com
- 30. jawbone.com
- 31. EXPONENTIALLY GROWING COMPUTING POWER Artificial Intelligence NEEDS COMPUTING POWER
- 34. dwavesys.com
- 35. NEW ALGORITHMS
- 39. Wy Deep Learning is a Disruptive Technology
- 43. WE ARE AT THE BEGINNING OF THE END
- 44. We don’t know exactly how Intelligent Machines will evolve The only thing we know is that it will be an Exponential Growth … This mean that it will happen sooner than we expect
Editor's Notes
- WE ARE AT THE END OF THE BEGINNING Here Dr. Kelly is speaking about COGNITIVE COMPUTING This means we are EXITING the PIONEERING phase and we are ENTERING the INDUSTRIAL Phase
- At the beginning of the 20th century the humanity was around 1.5 billion people. During the last century we’ve seen an exponential grown.
- The Earth stored in GEOLOGICAL TIMES the energy coming from the sun in a compact form of FOSSIL FUELS. The INDUSTRIAL REVOLUTION began when humans overcame the limitations of our muscle power with fossil energy. In the SIXTIES the GREEN REVOLUTION made available synthetic FERTILIZERS and PESTICIDES to most of the world population. We’re now in the early stages of doing the SAME thing to our MENTAL CAPACITY.
- Some authors call it the SECOND MACHINE AGE It’s IMPACT on the society will be characterized by an EXPONENTIAL GROWTH We CANNOT PREDICT exactly is “HOW FAST” this process will be because we are still at an EARLY STAGE. Nevertheless the EFFECTS are ALREADY EVIDENT.
- Huge Capitals are invested by Major Companies in developing COGNITIVE MACHINES
- You can find an example in your pocket. Google translate can: +) Translate 90 languages +) Translate WITH THE CAMERA +) SPEECH TRANSLATION Some of those functions are also available in offline mode. It works on your mobile processor This is significant to understand how UBIQUITOUS this technology can be: from MAINFRAMES TO WEARABLE DEVICES.
- IBM Watson Watson competed on JEOPARDY, a quiz show, in 2011 +) Uses NATURAL LANGUAGE PROCESSING to understand grammar and context in unstructured data +) Understands COMPLEX QUESTIONS. Evaluates all possible meanings and determines what is being asked. +) Presents answers and solutions. Watson for ONCOLOGY analyze UNSTRUCTURED CLINICAL NOTES AND REPORTS in plain English. Identifies POTENTIAL TREATMENT PANS. Doctors can consider the treatment options when making decisions.
- There was a very interesting phenomenon with deep learning whereas industry (Facebook, Google etcetera) kept-up deep learning faster than academia. Development is taking place both in industry and academia. Is for this reason why companies are open to share their code and their knowledge. If you’re creating a start-up the window is closing very quickly on deep-learning. The most interesting applications are the vertical applications because anyone can download free software and create horizontal applications.
- AYLIEN - NATURAL LANGUAGE PROCESSING. Sentiment analysis. Classification ALCHEMY API - NATURAL LANGUAGE PROCESSING. Sentiment analysis. MONKEY LEARN - Semantic Text Analysis. DEXTRO - Analyze VIDEO. Make video SEARCHABLE, and discoverable. SECURITY video MONITORING METAMIND - IMAGE RECOGNITION and LANGUAGE UNDERSTANDING KAIROS - Face Recognition. EMOTION ANALYSIS. Crowd Analytics CLARIFAI - VISUAL RECOGNITION
- Cloud services to Train machine Learning Algorithms
- Advanced Libraries: TensorFlow has been open sourced two weeks ago TensorFlow is the internal tool used by Google to design its Deep Learning Algorithms
- Addfor s.r.l. Particular Recipe we use to design our virtual sensors. Engineering Represent VERTICAL DOMAIN KNOWLEDGE Data Science enables a much BROAD EXPLORATION OF THE DATA
- Our applications in Oil & Gas Industries: Wave Nowcasting Interpretation of Lab Data
- Military Prototypes Visible and Infrared Wavelengths FPGA and GPU Targets Systems are based on: Aggregated Channel Features as Regional Proposal Method Finetuned AlexNet (CNN) as Main Detector SVM as classificator
- Performance Traction Control is our control system based on the Sideslip estimator SSE. Can be used to increase the cornering speed of race cars and to add safety to the high performance sports cars. It’s used on the best race and passenger performance cars since 2012
- What’s Next ? A whole new scenario. History tells us that when a new technology paradigm comes around, the obvious applications are not the killer apps. The killer apps tend to be surprising. No one anticipates them. Speaking about robots we imagine something like this.
- Tomorrow’s Robots will be employed in completely different environments (our houses).
- The SECOND MACHINE AGE will impact our society at every level OXFORD UNIVERSITY calculated how susceptible to automation each job is based on 9 KEY SKILLS required to perform it It turned out that about 35% of current jobs in the UK are at high risk of computerization over the following 20 years.
- This will have a DIFFERENTIAL IMPACT: repetitive and simple jobs will be the first to be replaced by machines The same thing has already happened in industry
- Artificial Intelligence Learns From Data (RULES ARE NOT PRE-CODED) For this reason is DATA HUNGRY Big companies NEDD DATA TO FEED THEIR AI
- Skybox Imaging +) Provide Real-Time sub-meter resolution imaging and video for the whole earth +) Monitor people movements and infrastructure development +) Monitor high-value assets, pipelines, construction sites, monitor ships in ports +) Identify changes in relevant metrics like number of cars in a retailer’s parking lot or materials in ports to support investment decisions
- Tesla Autopilot Has been automatically installed on 60000 Tesla vehicles in October 2015 Autopilot allows Model S to steer within a lane, change lanes with the simple tap of a turn signal, and manage speed by using active, traffic-aware cruise control. The main point differentiating Tesla’s Autopilot from driving assist systems from other manufacturers is the fact that all cars are connected to each others and learn from each driver. The car driver is seen as an “expert trainer”, which will feed the collective network intelligence of the fleet simply by driving the vehicle on the Autopilot. The system updates the driving algorithm adding ~1 million miles of new data every day.
- Google Data Acquisition +) It learns what temperature you like and builds a schedule around yours. +) It lights up when you walk in the room. +) It automatically adapts as your life and seasons change. Just use it for a week and it programs itself: turn it off when you go to bed, it takes notes and builds your schedule. After you turned up heat a few days in a row, Nest learned you like eating breakfast at 70º
- Jawbone UP3 Tri-axis accelerometer Bio-impedance: Heart rate Respiration Galvanic Skin Response (GSR) By monitoring a heart rate, respiration rate, body temperature and galvanic skin response, it would be able to tell the difference between REM, light and deep sleep
- Tianhe-2 Most Powerful of the TOP 500 LIST 33,86 Petaflops = 33860 Teraflops = 33,860,000 Gigaflops For comparison my Macbook Pro is 0,32 Gigaflops. In other words Tianhe-2 is equivalent to 100M Macbook Pro National Supercomputer Center - Guangzhou
- Google The total computational capacity of Google is basically unknown. Nevertheless some analyst try to devise it from power consumption. This is a picture of the central cooling plant in Google’s Douglas County, Georgia datacenter
- D-Wave The D-Wave 2X is a 1000-qubit quantum computer. It is based on a novel type of superconducting processor that uses quantum mechanics to massively accelerate computation. It is best suited to tackling complex optimization problems
- At the beginning there were shallow neural networks. They were made by layers that multiplied inputs with weight and transformed it with transfer functions (typically sigmoids) Basically NN are HOMEOMORPHISMS - geometrical transformations that do not affect the topology Is like have your data (say Olive and Capperi) spread around your pizza dough. To classify Olive from Capperi means rolling out and stretching the dough until it will be possible to separate the two with a straight line. Neural Networks or Artificial Neural Networks were simple approximations of the brain’s neurons
- In 1974 Geoffrey Hinton and other colleagues fund the way to apply an algorithm called Backpropagation to the training of the ANN. Backpropagation is the key algorithm that makes training deep models computationally tractable. For modern neural networks, it can make training with gradient descent as much as ten million times faster, relative to a naive implementation. It’s a reverse-mode differentiation that tracks how every node affects one output.
- The problem with shallow NN is that they don’t adapt to very complex problems like recognizing a real-world image. Actually they can fit any problem by adding enough neurons in the hidden layer but this is a fake. Is like having a student that prepares an exams by memorizing any single example: he doesn’t understand the underlying concepts. When he found a slightly different problem, he can’t generalize what he learned and fail the exam. Memorizing everything is called overfitting. More shallow neurons give us more memory but not the understanding.
- Again in 2004 Hinton made a giant step forward by inventing the way to train Deep Neural Networks. DNN can tackle much complex problems for the following reasons: Learn the Underlying Explanatory Factors of a complex model The models are Hierarchical. This means that simple factors are learned at low level and complex factors are learned on top of the previous learned factors. Since the models are Hierarchical a semi-supervised approach can be applied
- Hierarchy means that higher complex concepts in an image are based on lower hierarchical features. In this case both the images on the right contain the “eye” feature but obviously one is a real picture while the other in a Picasso…
- This complex and hierarchical memory systems mimics the internal behavior of the human neocortex creating internal beliefs, memories and representations. Looking inside this internal states is like looking inside the “dreams” of the machine.
- Those are just some of the internal representations of the systems data. Those are the only one we can understand. In fact, images as any other concepts are reduces to multidimensional vectors (TENSORS) in the memory of the machine but we cannot interpret it due to their intrinsic high dimensionality. The question is: what is Google “dreaming” about you right now? Or in other words: which are the tensors associated with your Google (or Facebook, or Amazon) profile?
- For some people this is the BEGINNING of the END For sure we are on the verge of an epochal change, a new revolution.