Activations of deep convolutional neural networks are aligned with gamma band activity of human visual cortex

•

1 recomendación•561 vistas

Talk I have delivered at SfN 2018 about our work at Institute of Computer Science of University of Tartu in collaboration Lyon Neuroscience Research Center. We use deep intracranial recordings from humans to compare visual representations of human visual system with the visual representations learned by deep convolutional neural networks. Published paper: https://www.nature.com/articles/s42003-018-0110-y Code and data: https://github.com/kuz/Human-Intracranial-Recordings-and-DCNN-to-Compare-Biological-and-Artificial-Mechanisms-of-Vision

Ciencias

Activations of deep convolutional neural
networks are aligned with gamma band
activity of human visual cortex
Ilya Kuzovkin, Raul Vicente, Mathilde Petton, Jean-Philippe Lachaux,
Monica Baciu, Philippe Kahane, Sylvain Rheims, Juan R. Vidal and Jaan Aru

Is there a correspondence
between the hierarchies of features
of artiﬁcial and biological
systems of vision?

Güçlü, U. & van Gerven, M. A.
Deep neural networks reveal a gradient in the
complexity of neural representations across
the ventral stream.
J. Neurosci. 35, 10005–10014 (2015).
Yamins, D. L. & DiCarlo, J. J.
Using goal-driven deep learning models to understand sensory cortex.
Nat. Neurosci. 19, 356–365 (2016).
Eickenberg, M., Gramfort, A., Varoquaux, G. & Thirion, B.
Seeing it all: convolutional network layers map the function of the human
visual system.
Neuroimage 152, 184–194 (2016)
Cichy, R. M., Khosla, A., Pantazis,
D., Torralba, A. & Oliva, A.
Comparison of deep neural networks to spatio-temporal cortical dynamics of
human visual object recognition reveals hierarchical correspondence.
Sci. Rep. 6, (2016).

x100
~100
probes per
subject
9073
probes total

Quantify the diagonal trend
ρalign = Spearman(
Assignment to DNN layers,
Assignment to Brodmann areas)

- simple features (mapped to lower layers of DCNN)
- complex features (higher layers)

Activations of deep convolutional neural
networks are aligned with gamma band
activity of human visual cortex
https://github.com/kuz/Human-Intracranial-Recordings-and-DCNN-to-Compare-
Biological-and-Artiﬁcial-Mechanisms-of-Vision
https://www.nature.com/articles/s42003-018-0110-y

Más contenido relacionado

Más de Ilya Kuzovkin

Article overview: Unsupervised Learning of Visual Structure Using Predictive ...

Ilya Kuzovkin

The article presents the comparison of the complexity of the representation of visual features in the deep convolutional neural network and in our brain. DNN activity layer-by-layer is used to predict voxel activations and it is shown that lower layers of DNN are better at predicting V1,V2 and that higher layers of DNN are better in predicting activity in LO and higher areas of ventral stream. The result effectively demonstrates that layer-by-layer complexity of visual features we see in DNN is also present in the visual cortex.

Article overview: Deep Neural Networks Reveal a Gradient in the Complexity of...

Ilya Kuzovkin

NIPS2014 Article Overview: Do Deep Nets Really Need to be Deep?

Ilya Kuzovkin

Seminar overview of the third article produced by Google DeepMind. This one again contains conceptual novelties: adding external memory to machine learning pipeline (using an Artificial Neural Network as a Controller, which decides how to use this memory). System is differentiable, meaning that you can give it inputs, show the outputs it should produce, define an error-function (cross-entropy in this case) and then train the whole thing using gradient descent. The amazing outcome is that the system learns not the statistical relations between the input and the output as your usual ML, but attempts to learn an algorithm, which allows it to generalize well and perform correctly on problem instances which are bigger or different from what is has been trained on.

Neural Turing Machines

Ilya Kuzovkin

Neuroimaging: Intracortical, fMRI, EEG

Ilya Kuzovkin

Article Overview "Reach and grasp by people with tetraplegia using a neurally...

Ilya Kuzovkin

Introduction to Computing on GPU

Ilya Kuzovkin

Soft Introduction to Brain-Computer Interfaces and Machine Learning

Ilya Kuzovkin

Ilya Kuzovkin - Adaptive Interactive Learning for Brain-Computer Interfaces

Ilya Kuzovkin

Más de Ilya Kuzovkin (9)

Article overview: Unsupervised Learning of Visual Structure Using Predictive ...

Article overview: Deep Neural Networks Reveal a Gradient in the Complexity of...

NIPS2014 Article Overview: Do Deep Nets Really Need to be Deep?

Neural Turing Machines

Neuroimaging: Intracortical, fMRI, EEG

Article Overview "Reach and grasp by people with tetraplegia using a neurally...

Introduction to Computing on GPU

Soft Introduction to Brain-Computer Interfaces and Machine Learning

Ilya Kuzovkin - Adaptive Interactive Learning for Brain-Computer Interfaces

Último

Zoology 5th semester notes( Sumit_yadav).pdf

Sumit Kumar yadav

Phenolics: types, biosynthesis and functions.

Silpa

Human genetics..........................pptx

Silpa

Porella : features, morphology, anatomy, reproduction etc.

Silpa

Use of mutants in understanding seedling development.pptx

RenuJangid3

LUNULARIA -features, morphology, anatomy ,reproduction etc.

Silpa

development of diagnostic enzyme assay to detect leuser virus

NazaninKarimi6

TheCarringtoneventof1859hasbeenthestrongestsolarflareintheobservationalhistory.ItplaysacrucialroleinsheddinglightonthefrequencyandimpactsofthepastandfutureSolarEnergeticParticle(SEP)eventsonhumansocieties.WeaddresstheimpactoftheCarringtoneventbymeasuringtree‐ring14Cwithmultiplereplicationsfromhigh‐latitudelocationsaroundtheeventandbycomparingthemwithmid‐latitudemeasurements.Atransientoffsetin14Cfollowingtheeventisobservedwithhighstatisticalsignificance.Ourstate‐of‐the‐art14Cproductionandtransportmodeldoesnotreproducetheobservationalfinding,suggestingfeaturesbeyondpresentunderstanding.Particularly,ourobservationwouldrequirepartiallyfasttransportof14Cbetweenthestratosphereandtroposphereathighlatitudes.TheobservationisconsistentwiththepreviousfindingswiththeSEPeventsof774and993CEforwhichfasterintegrationof14Cintotreeringsisobservedathighlatitudes

TransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRings

Sérgio Sacani

POGONATUM : morphology, anatomy, reproduction etc.

Silpa

Cyanide resistant respiration pathway.pptx

Silpa

Ultrasound color Doppler imaging has been routinely used for the diagnosis of cardiovascular diseases, enabling real-time flow visualization through the Doppler effect. Yet, its inability to provide true flow velocity vectors due to its one-dimensional detection limits its efficacy. To overcome this limitation, various VFI schemes, including multi-angle beams, speckle tracking, and transverse oscillation, have been explored, with some already available commercially. However, many of these methods still rely on autocorrelation, which poses inherent issues such as underestimation, aliasing, and the need for large ensemble sizes. Conversely, speckle-tracking-based VFI enables lateral velocity estimation but suffers from significantly lower accuracy compared to axial velocity measurements. To address these challenges, we have presented a speckle-tracking-based VFI approach utilizing multi-angle ultrafast plane wave imaging. Our approach involves estimating axial velocity components projected onto individual steered plane waves, which are then combined to derive the velocity vector. Additionally, we've introduced a VFI visualization technique with high spatial and temporal resolutions capable of tracking flow particle trajectories. Simulation and flow phantom experiments demonstrate that the proposed VFI method outperforms both speckle-tracking-based VFI and autocorrelation VFI counterparts by at least a factor of three. Furthermore, in vivo measurements on carotid arteries using the Prodigy ultrasound scanner demonstrate the effectiveness of our approach compared to existing methods, providing a more robust imaging tool for hemodynamic studies. Learning objectives: - Understand fundamental limitations of color Doppler imaging. - Understand principles behind advanced vector flow imaging techniques. - Familiarize with the ultrasound speckle tracking technique and its implications in flow imaging. - Explore experiments conducted using multi-angle plane wave ultrafast imaging, specifically utilizing the pulse-sequence mode on a 128-channel ultrasound research platform.

(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...

Scintica Instrumentation

PATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICE low price Call me 8617370543 100%genuine sexy VIP call girl safe service WhatsApp chat. 8617370543 Normal call kijiye 8617370543 100% genuine young college girl and housewife Full enjoy open minded girl provide 24hour full cooperative model and full satisfactions☎️*8617370543*⭐Escorts service █▬█⓿▀█▀ call girls and bhabhi available for room Sex and video call service A-1 HIGH CLASS CALL GIRLS TOP MODEL 24X7 HOME/HOTEL Call Girls Safe & Secure High Class Sm Affordable Rate 100% Satisfaction, Unlimited Enjoyment. Any Time for Model/Escort in High class luxury and premium

PATNA CALL GIRLS 8617370543 LOW PRICE ESCORT SERVICE

Goa Call Girls High Profile Escorts

www.seribangash.com The Mariana Trench is one of the most remarkable geological features on Earth. Here are some details about it: Location: The Mariana Trench is located in the western Pacific Ocean, east of the Mariana Islands. It stretches for about 2,550 kilometers (1,580 miles) and is known as the deepest part of the world's oceans. Depth: The trench reaches incredible depths, with its deepest point known as the Challenger Deep, which plunges down to approximately 10,984 meters (36,037 feet) below sea level. To put this into perspective, if Mount Everest, the tallest mountain on Earth, were placed at the bottom of the Challenger Deep, its peak would still be over 2 kilometers (1.25 miles) underwater. Formation: The Mariana Trench was formed by the subduction of the Pacific Plate beneath the Mariana Plate. This process creates a deep trench as the heavier Pacific Plate is forced beneath the lighter Mariana Plate. Geological Features: The trench is characterized by steep, V-shaped valleys, and its walls are composed of highly compressed sedimentary rock. At the bottom of the trench, there are also large amounts of marine sediment. Pressure: The pressure at the bottom of the Mariana Trench is immense, reaching over 1,000 times the pressure at the surface. This extreme pressure creates a challenging environment for exploration and makes it difficult for organisms to survive. Exploration: Despite its extreme conditions, the Mariana Trench has been the subject of numerous scientific expeditions and explorations. One of the most famous explorations was the dive to the Challenger Deep by Swiss scientist Jacques Piccard and U.S. Navy Lieutenant Don Walsh in 1960. More recently, in 2012, filmmaker James Cameron made a solo dive to the bottom of the Challenger Deep in the Deepsea Challenger submersible. Biological Discoveries: Despite the harsh conditions, the Mariana Trench is home to a surprising variety of life forms, including unique species of deep-sea fish, crustaceans, and microbial life. Some organisms have adapted to survive in the extreme pressure and darkness of the trench. Environmental Importance: Studying the Mariana Trench provides valuable insights into the geology, biology, and oceanography of the deep sea. It also helps scientists better understand the processes that shape the Earth's crust and the distribution of life in the oceans. Conservation: Due to its remote location and extreme depths, the Mariana Trench has remained relatively untouched by human activity. However, there is growing concern about the potential impacts of deep-sea mining and pollution on this fragile ecosystem, highlighting the need for conservation efforts to protect this unique environment. https://seribangash.com/barber-shop-business-complete-guide-for-beginners/ https://seribangash.com/legend-virat-kohli-in-cricket-history/

The Mariana Trench remarkable geological features on Earth.pptx

seri bangash

Module for Grade 9 for Asynchronous/Distance learning

levieagacer

Factory Acceptance Test( FAT).pptx .

Poonam Aher Patil

Clean In Place(CIP).pptx .

Poonam Aher Patil

300003-World Science Day For Peace And Development.pptx

ryanrooker

Role of AI in seed science Predictive modelling and Beyond.pptx

Arvind Kumar

www.whatsapp.com+917728919243 HOT & SEXY MODELS // COLLEGE GIRLS AVAILABLE FOR COMPLETE ENJOYMENT WITH HIGH PROFILE INDIAN MODEL AVAILABLE HOTEL & HOME ★ SAFE AND SECURE HIGH CLASS SERVICE AFFORDABLE RATE SATISFACTION,UNLIMITED ENJOYMENT. ★ All Meetings are confidential and no information is provided to any one at any cost. ★ EXCLUSIVE PROFILes Are Safe and Consensual with Most Limits Respected ★ Service Available In: - HOME *Star Hotel Service .In Call & Out call SeRvIcEs : ★ A-Level ★ Strip-tease ★ BBBJ (Bareback Blowjob)Receive advanced sexual techniques in different mode make their life more pleasurable. ★ Spending time in hotel rooms ★ BJ (Blowjob Without a Condom) ★ Completion (Oral to completion) ★ Covered (Covered blowjob Without a Condom)

Call Girls Ahmedabad +917728919243 call me Independent Escort Service

shivanisharma5244

Selaginella: features, morphology ,anatomy and reproduction.

Silpa

Activations of deep convolutional neural networks are aligned with gamma band activity of human visual cortex

1. Activations of deep convolutional neural networks are aligned with gamma band activity of human visual cortex Ilya Kuzovkin, Raul Vicente, Mathilde Petton, Jean-Philippe Lachaux, Monica Baciu, Philippe Kahane, Sylvain Rheims, Juan R. Vidal and Jaan Aru

2. Biological system of vision

3. Biological system of vision

4. Biological system of vision

5. Artificial system of vision

6. Artificial system of vision

7. Artificial system of vision

8. Artificial system of vision

9. Artificial system of vision

10. Artificial system of vision

11. Is there a correspondence between the hierarchies of features of artiﬁcial and biological systems of vision?

12. Güçlü, U. & van Gerven, M. A. Deep neural networks reveal a gradient in the complexity of neural representations across the ventral stream. J. Neurosci. 35, 10005–10014 (2015). Yamins, D. L. & DiCarlo, J. J. Using goal-driven deep learning models to understand sensory cortex. Nat. Neurosci. 19, 356–365 (2016). Eickenberg, M., Gramfort, A., Varoquaux, G. & Thirion, B. Seeing it all: convolutional network layers map the function of the human visual system. Neuroimage 152, 184–194 (2016) Cichy, R. M., Khosla, A., Pantazis, D., Torralba, A. & Oliva, A. Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence. Sci. Rep. 6, (2016).

13. x100

14. x100

15. x100 ~100 probes per subject 9073 probes total

16.

17.

18.

19.

20.

21.

22.

23.

24. Quantify the diagonal trend ρalign = Spearman( Assignment to DNN layers, Assignment to Brodmann areas)

25. Quantify the diagonal trend ρalign = Spearman( Assignment to DNN layers, Assignment to Brodmann areas)

26. - simple features (mapped to lower layers of DCNN) - complex features (higher layers)

27. Activations of deep convolutional neural networks are aligned with gamma band activity of human visual cortex https://github.com/kuz/Human-Intracranial-Recordings-and-DCNN-to-Compare- Biological-and-Artiﬁcial-Mechanisms-of-Vision https://www.nature.com/articles/s42003-018-0110-y

Activations of deep convolutional neural networks are aligned with gamma band activity of human visual cortex

Recomendados

Recomendados

Más contenido relacionado

Más de Ilya Kuzovkin

Más de Ilya Kuzovkin (9)

Último

Último (20)

Activations of deep convolutional neural networks are aligned with gamma band activity of human visual cortex