Information updated and conveyed by the neural network systems

•

0 recomendaciones•584 vistas

inscit2006

The document discusses using neural networks and information theory to model how information is conveyed in the brain. It presents a neural network model that was trained on Walsh patterns as stimuli to test how much information could be encoded and decoded. Computational experiments showed the model was able to code and decode information by implementing an artificial neural network, though more research is still needed to apply this to practical communication systems.

Tecnología

Information updated and conveyed by the neural network systems Algis Garliauskas Institute of Mathematics and Informatics,Laboratory of Neuroinformatics,Akademijos 4, LT-8663, Vilnius, Lithuania

Abstract ,[object Object],[object Object]

Introduction ,[object Object],[object Object]

2.Information retrieval from an associative memory ,[object Object],[object Object]

3. Neural network model and computational experiment 3.1. The Walsh patterns as stimuli. Fig.1. Examples of the Walsh patterns

3.2. Modeling strategy of transmitted information by interconnection network s ,[object Object],[object Object]

3.3. Neural network structure and the learning algorithm ,[object Object],[object Object],[object Object]

3.4. Results of modeling Fig.2. The error changes versus epochs of training: (a) Training and testing errors dependent on epochs, (b) The errors with change of learning parameters

Fig. 3. The error changes versus epochs of training errors: (1) is the training, (2) is testing, and (3) is the output value errors

Table.1. The amount of information (bits) in the output of ANN. Numbeof Number of neurons hidden layers 1 5 10 15 20 1 2.8 2.74 0.12 0.2 0.11 2 3.4 0.23 0.17 0.12 0.15 3 5.1 0.15 0.21 0.17 0.15 4 7.0 0.22 0.13 0.14 0.11 6.1 0.44 0.15 0.16 0.14

4. Conclusions ,[object Object],[object Object]

References Abramson, N. 1963. Information Theory and Coding. MCGraw-Hill, New York. Hamming, R.W. 1990. Coding and Information Theory. Prentice-Hall, Englewood Cliffs, New Jersey. Hartley, R.V. 1928, Transmission of Information. Bell System Tech. J., 7, pp.535-564. Garliauskas, A. 2004. Conceptions and Modeling for Transmitted Information Evaluation by ANN. Informatica, vol.15, 4. Klimashauskas, C., Guiver J.and Pelton G. 1989. Neural Computing, 1. Ricke, F., Warland D. and W. Bialek W. 1993. Coding efficiency anf information rates in sensory neurons. Europhysics Letters, 22}, pp.151-156. Shannon, C.E. 1948. A mathematical theory of communication. Bell System Tech. J., pp.379-423, pp.623-656

Más contenido relacionado

La actualidad más candente

UPGMA

Shreya Feliz

Bioinformatics.Assignment

Naima Tahsin

Construction of phylogenetic tree from multiple gene trees using principal co...

IAEME Publication

Upgma

MUSKANKr

Improving Classifier Accuracy using Unlabeled Data..doc

butest

Phylogenetics: Tree building

Bioinformatics and Computational Biosciences Branch

Algorithm research project neighbor joining

Jay Mehta

Neural networks have been used successfully to a br oad range of areas such as business, data mining, d rug discovery and biology. In medicine, neural network s have been applied widely in medical diagnosis, detection and evaluation of new drugs and treatment cost estimation. In addition, neural networks have begin practice in data mining strategies for the a im of prediction, knowledge discovery. This paper will present the application of neural networks for the prediction and analysis of antitubercular activity of Oxazolines and Oxazoles derivatives. This study pre sents techniques based on the development of Single hidden layer neural network (SHLFFNN), Gradient Des cent Back propagation neural network (GDBPNN), Gradient Descent Back propagation with momentum neu ral network (GDBPMNN), Back propagation with Weight decay neural network (BPWDNN) and Quantile r egression neural network (QRNN) of artificial neural network (ANN) models Here, we comparatively evaluate the performance of five neural network techniques. The evaluation of the efficiency of eac h model by ways of benchmark experiments is an accepted application. Cross-validation and resampli ng techniques are commonly used to derive point estimates of the performances which are compared to identify methods with good properties. Predictiv e accuracy was evaluated using the root mean squared error (RMSE), Coefficient determination( ), mean absolute error(MAE), mean percentage error(MPE) and relative square error(RSE). We found that all five neural network models were able to produce feasible models. QRNN model is outperforms with all statistical tests amongst other four models.

Performance analysis of neural network models for oxazolines and oxazoles der...

ijistjournal

Phylogenetic tree construction

Uddalok Jana

Large-scale analysis of genome sequences is in progress around the world, the major application of which is to establish the evolutionary relationship among the species using phylogenetic trees. Hierarchical agglomerative algorithms can be used to generate such phylogenetic trees given the distance matrix representing the dissimilarity among the species. ClustalW and Muscle are two general purpose programs that generates distance matrix from the input DNA or protein sequences. The limitation of these programs is that they are based on Smith-Waterman algorithm which uses dynamic programming for doing the pair-wise alignment. This is an extremely time consuming process and the existing systems may even fail to work for larger input data set. To overcome this limitation, we have used the frequency of codons usage as an approximation to find dissimilarity among species. The proposed technique further reduces the complexity by extracting only the significant features of the species from the mtDNA sequences using the techniques like frequent codons, codons with maximum range value or PCA technique. We have observed that the proposed system produces nearly accurate results in a significantly reduced running time.

A Comparative Analysis of Feature Selection Methods for Clustering DNA Sequences

CSCJournals

Distance based method

Adhena Lulli

Phylogenetic trees

martyynyyte

K-NN Classifier Performs Better Than K-Means Clustering in Missing Value Imp...

IOSR Journals

A distance-based method for phylogenetic tree reconstruction using algebraic ...

Emily Castner

Poster genome engineering & Synthetic Biology 2016

Michiel Stock

There are very few examples of the use of various architectures for recurrent neural networks to predict student learning outcomes. In fact, the only architecture used to solve this problem is the LSTM architecture. In the works devoted to the use of LSTM to predict educational outcomes, the results of a detailed theoretical substantiation of the preference of this particular architecture of the RNN are not presented. In this regard, it seems advisable to provide such justification in the framework of this study. The main property of input data for prediction of educational outcomes is its temporary nature. Some sequence of user actions unfolds in time and is evaluated (classified) by an external observer as evidence of the presence or absence of an educational result (objective or metaobjective). In this regard, the RNN used to classify user actions should perform a procedure for adjusting the weights of neurons for a certain set of states in the past. At the same time, the length of the sequence of these states is not predetermined: it can be both short (for example, for objective results), and quite long.

Ijciet 10 01_153-2

IAEME Publication

This paper proposes an application of clonal selection immune system method for optimization of distribution network. The distribution network with high-performance is a network that has a low power loss, better voltage profile, and loading balance among feeders. The task for improving the performance of the distribution network is optimization of network configuration. The optimization has become a necessary study with the presence of DG in entire networks. In this work, optimization of network configuration is based on an AIS algorithm. The methodology has been tested in a model of 33 bus IEEE radial distribution networks with and without DG integration. The results have been showed that the optimal configuration of the distribution network is able to reduce power loss and to improve the voltage profile of the distribution network significantly.

APPLICATION OF CLONAL SELECTION IMMUNE SYSTEM METHOD FOR OPTIMIZATION OF DIST...

UniversitasGadjahMada

project_presentation

Russell Jarvis

Tools in phylogeny

bhavnesthakur

multiple sequence alignment

harshita agarwal

La actualidad más candente (20)

UPGMA

Bioinformatics.Assignment

Construction of phylogenetic tree from multiple gene trees using principal co...

Upgma

Improving Classifier Accuracy using Unlabeled Data..doc

Phylogenetics: Tree building

Algorithm research project neighbor joining

Performance analysis of neural network models for oxazolines and oxazoles der...

Phylogenetic tree construction

A Comparative Analysis of Feature Selection Methods for Clustering DNA Sequences

Distance based method

Phylogenetic trees

K-NN Classifier Performs Better Than K-Means Clustering in Missing Value Imp...

A distance-based method for phylogenetic tree reconstruction using algebraic ...

Poster genome engineering & Synthetic Biology 2016

Ijciet 10 01_153-2

APPLICATION OF CLONAL SELECTION IMMUNE SYSTEM METHOD FOR OPTIMIZATION OF DIST...

project_presentation

Tools in phylogeny

multiple sequence alignment

Similar a Information updated and conveyed by the neural network systems

The work is carried on the application of differential equation (DE) and its computational technique of genetic algorithm and neural (GANN) in C#, which is frequently used in globalised world by human wings. Diagrammatical and flow chart presentation is the major concerned for easy undertaking of these two concepts with indication of its present and future application is the new initiative taken in this paper along with computational approaches in C#. Little observation has been also pointed during working, functioning and development process of above algorithm in C# under given boundary value condition of DE for genetic and neural. Operations of fitness function and Genetic operations were completed for behavioural transmission of chromosome.

Model of Differential Equation for Genetic Algorithm with Neural Network (GAN...

Sarvesh Kumar

Artificial Neural Networks.pdf

Bria Davis

Research Paper - Vaibhav

Vaibhav Dhattarwal

The classification and recognition of type on the basis of individual features and behaviors constitute a preliminary measure and is an important target in the behavioral sciences. Current statistical methods do not always yield satisfactory answers. A Feed Forward Artificial Neural Network is the computer model inspired by the structure of the Human Brain. It views as in the set of artificial nerve cells that are interconnected with the other neurons. The primary aim of this paper is to demonstrate the process of developing the Artificial Neural network based classifier which classifies the Iris database. The problem concerns the identification of Iris plant species on the basis of plant attribute measurements. This paper is related to the use of feed forward neural networks towards the identification of iris plants on the basis of the following measurements: sepal length, sepal width, petal length, and petal width. Using this data set a Neural Network (NN) is used for the classification of iris data set. The EBPA is used for training of this ANN. The results of simulations illustrate the effectiveness of the neural system in iris class identification.

Classification Of Iris Plant Using Feedforward Neural Network

irjes

self operating maps

AltafSMT

Artificial neural network

Alexander Decker

Fuzzy Logic Final Report

Shikhar Agarwal

The back propagation algorithm is most popular algorithm in feed forward neural network with the multi-layer. It measures the output error and calculates the gradient of the error and adjusting the ANN weight moving along the descending gradient direction. Back propagation is used to learn and store by mapping relations of input- output model. A genetic algorithm is having a random probability distribution or pattern that may be analyses statistically but may not be predicted precisely. Genetic algorithm is an iterative procedure that generates new population for individual from the old one. In my paper I am proposing to implement the back propagation algorithm and genetic algorithm to compare the output accuracy percent for medical diagnosis on various chest diseases (Asthme, tuberculosis, lung cancer, pneumonia).

Diagnosis Chest Diseases Using Neural Network and Genetic Hybrid Algorithm

IJERA Editor

This paper presents an ensemble of neo-cognitron neural network base classifiers to enhance the accuracy of the system, along the experimental results. The method offers lesser computational preprocessing in comparison to other ensemble techniques as it ex-preempts feature extraction process before feeding the data into base classifiers. This is achieved by the basic nature of neo-cognitron, it is a multilayer feed-forward neural network. Ensemble of such base classifiers gives class labels for each pattern that in turn is combined to give the final class label for that pattern. The purpose of this paper is not only to exemplify learning behaviour of neo-cognitron as base classifiers, but also to purport better fashion to combine neural network based ensemble classifiers.

Employing Neocognitron Neural Network Base Ensemble Classifiers To Enhance Ef...

cscpconf

Weather forecasting is most challenging problem around the world. There are various reason because of its experimented values in meteorology, but it is also a typical unbiased time series forecasting problem in scientific research. A lots of methods proposed by various scientists. The motive behind research is to predict more accurate. This paper contribute the same using artificial neural network (ANN) and simulated in MATLAB to predict two important weather parameters i.e. maximum and minimum temperature. The model has been trained using past 60 years of real data collected from(1901-1960) and tested over 40 years to forecast maximum and minimum temperature. The results based on mean square error function (MSE) confirm, this model which is based on multilayer perceptron has the potential to successful application to weather forecasting

A Time Series ANN Approach for Weather Forecasting

ijctcm

E04423133

IOSR-JEN

Classification is a machine learning technique used to predict group membership for data instances. To simplify the problem of classification neural networks are being introduced. This paper focuses on IRIS plant classification using Neural Network. The problem concerns the identification of IRIS plant species on the basis of plant attribute measurements. Classification of IRIS data set would be discovering patterns from examining petal and sepal size of the IRIS plant and how the prediction was made from analyzing the pattern to form the class of IRIS plant. By using this pattern and classification, in future upcoming years the unknown data can be predicted more precisely. Artificial neural networks have been successfully applied to problems in pattern classification, function approximations, optimization, and associative memories. In this work, Multilayer feedforward networks are trained using back propagation learning algorithm.

An Approach for IRIS Plant Classification Using Neural Network

ijsc

AN APPROACH FOR IRIS PLANT CLASSIFICATION USING NEURAL NETWORK

ijsc

Project Report -Vaibhav

Vaibhav Dhattarwal

output screens, project output, python projects, machinelearning projects, data science projects, Artificial Intelegance projects, support vector machine, ramdom forest tree, Dession tree, linear Regression, logistic regression, Feature Selection, Naive Bayes, Machine learning Algorithms, Dimensionality Reduction Algorithms, Gradient Boosting algorithm, Logistic Regression, TensorFlow,Scikit-Learn,Numpy,Keras,PyTorch ,LightGBM, Eli5 ,SciPy,Theano,Pandas,imageProcessing Deep Learning,

Student intervention detection using deep learning technique

Venkat Projects

NEURAL NETWORKS

ESCOM

Artificial Neural Networks In Control And Optimization

Jim Webb

The behaviour of soil at the location of the project and interactions of the earth materials during and after construction has a major influence on the success, economy and safety of the work. Another complexity associated with some geotechnical engineering materials, such as sand and gravel, is the difficulty in obtaining undisturbed samples and time consuming involving skilled technician. Knowledge of California Bearing Ratio (C.B.R) is essential in finding the road thickness. To cope up with the difficulties involved, an attempt has been made to model C.B.R in terms of Fine Fraction, Liquid Limit, Plasticity Index, Maximum Dry density, and Optimum Moisture content. A multi-layer perceptron network with feed forward back propagation is used to model varying the number of hidden layers. For this purposes 50 soils test data was collected from the laboratory test results. Among the test data 30 soils data is used for training and remaining 20 soils for testing using 60-40 distribution. The architectures developed are 5-4-1, 5-5-1, and 5-6-1. Model with 5-6-1 architecture is found to be quite satisfactory in predicting C.B.R of soils. A graph is plotted between the predicted values and observed values of outputs for training and testing process, from the graph it is found that all the points are close to equality line, indicating predicted values are close to observed values

Artificial Neural Networks (ANNS) For Prediction of California Bearing Ratio ...

IJMER

Constructing a classification model based on some given patterns is a form of learning from the environment perception. This modelling aims to discover new knowledge embedded in the input observations. Learning behaviour of the neural network model enhances the classification properties. This paper considers artificial neural networks for learning two different medical data sets in term of number of instances. The experiment results confirm that the back-propagation supervised learning algorithm has proved its efficiency for such non-linear classification issues.

APPLYING NEURAL NETWORKS FOR SUPERVISED LEARNING OF MEDICAL DATA

IJDKP

The aim of this paper is to implement a Multilayer Perceptron (MLP) Neural Network to recognize and predict handwritten digits from 0 to 9. A dataset of 5000 samples were obtained from MNIST. The dataset was trained using gradient descent back-propagation algorithm and further tested using the feed-forward algorithm. The system performance is observed by varying the number of hidden units and the number of iterations. The performance was thereafter compared to obtain the network with the optimal parameters. The proposed system predicts the handwritten digits with an overall accuracy of 99.32%.

Intelligent Handwritten Digit Recognition using Artificial Neural Network

IJERA Editor

Similar a Information updated and conveyed by the neural network systems (20)

Model of Differential Equation for Genetic Algorithm with Neural Network (GAN...

Artificial Neural Networks.pdf

Research Paper - Vaibhav

Classification Of Iris Plant Using Feedforward Neural Network

self operating maps

Artificial neural network

Fuzzy Logic Final Report

Diagnosis Chest Diseases Using Neural Network and Genetic Hybrid Algorithm

Employing Neocognitron Neural Network Base Ensemble Classifiers To Enhance Ef...

A Time Series ANN Approach for Weather Forecasting

E04423133

An Approach for IRIS Plant Classification Using Neural Network

AN APPROACH FOR IRIS PLANT CLASSIFICATION USING NEURAL NETWORK

Project Report -Vaibhav

Student intervention detection using deep learning technique

NEURAL NETWORKS

Artificial Neural Networks In Control And Optimization

Artificial Neural Networks (ANNS) For Prediction of California Bearing Ratio ...

APPLYING NEURAL NETWORKS FOR SUPERVISED LEARNING OF MEDICAL DATA

Intelligent Handwritten Digit Recognition using Artificial Neural Network

Más de inscit2006

Information Searcher-Provider Fit through Information Presentation and Visual...

inscit2006

Difference of application of fuzzy rough sets and probability random on targe...

inscit2006

The Interaction of Navigation Instructions and Visual Attention in Dynamic Au...

inscit2006

Weighted Naïve Bayes Model for Semi-Structured Document Categorization

inscit2006

The role of education within the framework of information sciences and techno...

inscit2006

A Metadata-Driven Approach to Computing Financial Analytics in a Relational D...

inscit2006

A Comparative Study of RDBMs and OODBMs in Relation to Security of Data

inscit2006

iCE- Interactive Co-innovation Environment Software, Spatial Mapping Tools fo...

inscit2006

Designing People’s Interconnections in Mobile Social Networks

inscit2006

Visual Literacy: A Semiotic Analysis of Icons as Visual Information Represent...

inscit2006

Visualizing Search Term Relevance, Boolean Operators, and Phrases using the C...

inscit2006

Visualization of Multidimensional Information from Scientific Computations

inscit2006

High dimensional Data Visualization using Star Coordinates on Three Dimensions

inscit2006

Knowledge Discovery in Environmental Impact Report’s summary texts: an explor...

inscit2006

Improvement in Quality of Speech associated with Braille codes - A Review

inscit2006

Identificación de Nombres de Genes en la Literatura Biomédica

inscit2006

An Intuitive Natural Language Understanding System

inscit2006

Requirement analysis for mobile information exchange in the police using a ti...

inscit2006

Parametric Study to Enhance Genetic Algorithm's Performance using Ranked base...

inscit2006

Mensajería instantánea: una puerta para una nueva percepción del mundo para n...

inscit2006

Más de inscit2006 (20)