Adaptive Dynamic Back-Propagation (ADBP)

Index

A Bayesian transfer 246, 247, 248 Bayesian Ying Yang learning adaptive dynamic back-propagation (ADBP) 73, 74, 85, 86, 91, 93 algorithm 205 Bayesian Ying-Yang system 93 adaptive network-based fuzzy inference sys- Bayes theorem 483, 498 tems (ANFIS) 406, 413, 414, 415, biologically inspired algorithm 127 416, 417, 418, 419, 420, 421, 426 biometric 539, 540, 541, 542, 543, 544, adaptive resonance theory 6, 26 545, 549, 550, 551, 552, 553, 554, alternative ME (AME) 62, 92 555, 556, 557, 558, 559, 560 anemia 265, 266, 267, 269, 270, 273, 274, biometric fusion 542, 552, 554, 559, 560 275, 276 biometric system 544, 551, 560 ANN xvii, xviii, xxi biometric template anomaly detection 109, 110, 111, 112, 113, 539, 543, 544, 545, 551, 560 115, 116, 124, 125, 126, 127 BIRCH algorithm 4, 26 artificial immune system (AIS) 109, 110, 126 Boolean classification tasks 246 artificial intelligence 371, 374 bootstrap effect 619 artificial neural network (ANN) 38 7, 388, 389, bounded-input bounded-output (BIBO) 205 390, 391, 392, 396, 397, 399, 403, 429, 439, 575, 576, 579, 582, 585, C 586, 588, 598 calibration measure 131, 132, 133, 134, 146 artificial neuron 439 calibration technique 129, 146 asset valuation 376, 377, 378, 379, 380, 382 cascaded extensions 92 automatic model selection 60, 66, 67, 74, centroids 180, 181, 182, 186 75, 76, 78, 81, 93 class calibration 130, 146 autonomous mobile robots classification and regression trees (CART) 585, 588, 597, 598 502, 506, 509, 510, 513, 514, 515, autoregressive feedback 197, 200 517 B closed loop control system 439 closed world assumption 600, 619 Bayesian estimation 5 cluster analysis 1, 2, 3, 4, 21 Bayesian information criterion (BIC) clustering 176, 177, 191, 193, 194, 352, 390, 391, 393, 397, 403 362, 363, 367, 368, 369, 371, 372, Bayesian learning 537, 538 374 Bayesian model 246 clustering algorithms 1, 3, 4, 21, 22, 26 Bayesian techniques 495, 498 computational learning theory 376, 384

concept language 619 ensemble forecasting method 518 conditional random fields (CRF) entity recognition 302, 322, 323 338, 339, 340, 341 entropic prior 460, 473, 474, 477, 478, 480 confusion matrix 136, 146 erythropoiesis 276 corpus 304, 309, 310, 311, 312, 314, 315, erythropoietin 265, 266, 274, 276 316, 317, 321, 322, 323 Euclidean distance 13, 14 CURE algorithm 4, 24 evolutionary algorithm 114, 115, 127 evolutionary computation (EC) 375, 376, D 378, 379, 380, 383, 386, 389, 390, dairy goat 456 392, 403, 575, 598 data visualization 177, 179, 194 evolutionary multi-objective optimization decision tree (DT) 307, 309, 310, 311, 315, (EMO) 574, 575, 576, 577, 578, 317, 328, 333, 338, 340, 341, 404, 579, 581, 582, 585, 586, 588, 593, 406, 413, 415, 416, 417, 420, 421, 598 426, 429, 435, 439 evolutionary neural network (ENN) xvii, decision tree learning 376 387, 388, 390, 393, 394, 396, 397, defect content 520, 521, 522, 523, 526, 399, 403 527, 528, 531, 532, 535, 536, 537, evolutionary robotics 538 574, 575, 596, 597, 598 deflation 33 expanded range approximation (ERA) algo- detector 110, 111, 112, 113, 114, 115, 116, rithm 567, 573 117, 118, 119, 120, 123, 124, 127 expectation-maximization (EM) algorithm diagonal recurrent neural network (DRNN) 177, 180, 182, 183 202, 203, 204, 205, 212, 220 expert systems 375, 379, 380, 383, 385 differential evolution (DE) algorithm extended NRBF 92 577, 580, 598 F digital libraries 374 distributional accuracy 168, 173 fast Fourier transform 491, 498 distribution calibration in regression 130, 146 feature extraction 2 document clustering 4, 19, 24, 26, 27 feature selection document image understanding 368, 369, 374 2, 20, 521, 527, 528, 534, 538 document processing 348, 349, 350, 351, fidelity 404, 406, 421, 426 353, 370, 374 fitness landscape 96, 108 dynamic evolving neuro-fuzzy inference sys- flexibility test 572 tem (DENFIS) 501, 502, 506, 507, Fourier descriptors 498 510, 511, 512, 513, 514, 516, 518 frame problem, the 600, 619 dynamic neural networks 196, 222 fuzzy clustering 2, 22, 23 fuzzy inference system (FIS) 426 E fuzzy rule based systems 404, 426 elasticity test 572 G electromyography (EMG) 565, 573 elitism 99, 108 Gaussian process (GP) 177, 178, 180, 181, EM algorithm 464, 466, 468, 469, 470, 182, 187, 188, 189, 190, 191 471, 473, 474, 475, 478, 480 generalization 521, 530, 531, 533, 535, 538 empty space phenomenon 526, 538 generative topographic mapping end stage renal disease 276 176, 192, 193, 194

79 Index

generative topographic mapping through time iterative linear-quadratic regulator (ILQG) (GTM-TT) 176, 177, 178, 179, 180, method 205 181, 182, 183, 185, 187, 188, 189, 190, 191, 192 K genetic algorithms 376, 377, 385, 386, 429, k-means algorithm 4, 5, 28, 29, 34 432, 434, 438, 439 k-nearest neighbour (kNN) genetic programming 379, 383, 385, 386 307, 317, 329, 330, 340, 341 geographic information resolution (GIRE) 334, 335, 341 L geographic information retrieval (GIR) latent semantic analysis (LSA) 308, 311, 317 333, 334, 335, 341 latent variable model 177, 194 global minimum 567, 573 learning algorithm 432, 436, 439 group technology 20, 23, 27 limit plane 127 H locally connected recurrent neural networks 196, 201, 208, 222 hidden data structures 1, 2 locally recurrent neural networks 195, 200, hidden Markov model (HMM) 305, 310, 201, 214, 215, 217, 218, 219, 222 311, 317, 324, 335, 336, 338, 339, local minima 567, 573 340, 341, 457, 458, 459, 460, 464, local search 103, 104, 105, 106, 107, 108 465, 466, 467, 468, 469, 470, 472, look up table (LUT) 493, 498 475, 476, 477, 478, 479, 480 hierarchical clustering 2, 4, 11, 19, 26 M hierarchical transfer 247, 248 machine learning (ML) 1, 3, 303, 304, 305, Hilbert space 224, 225, 241 306, 307, 308, 309, 310, 312, 313, homonymy 313 314, 316, 317, 324, 375, 376, 377, Human Genome Project 277 378, 380, 381, 382, 383, 385, 386 hyperspectral imaging 498 machine vision 486, 488, 492, 494, 495, hypersphere 5, 6, 113, 127 496, 497, 498 I macro-averaging 306 marginalization 164, 173 image segmentation 482, 486, 487, 494, 498 Markov chain model (MCM) 332, 341 incremental learning 351, 355, 361, 374 Markov decision process (MDP) inductive bias 244, 245, 246, 257, 260, 264 249, 251, 256, 258 inductive learning 242, 243, 244, 245, 247, maximisation algorithm 59 257, 264 maximum likelihood 177, 180, 181 inductive logic programming 374 mean squared error (ER) 396 inductive transfer 245, 246, 248, 257, 259, mega-text 325, 326, 340, 347 260, 261, 262 mega-text language processing 325, 340, 347 infinite impulse response (IIR) filters198, meta-predicates 601, 607, 619 199, 200, 201, 202, 207, 211, 212, micro-averaging 306 213, 214, 217, 218, 221 milk yield 440, 442, 443, 454, 455, 456 information extraction (IE) missing at random (MAR) 151, 173, 175 303, 305, 306, 317, 332, 341 missing completely at random (MCAR) instance-based learning 376 151, 173, 175 isomorphic match 256

80 Index

missing data 147, 148, 149, 150, 151, 152, nonself 125, 127 153, 154, 155, 156, 157, 158, 159, normalized radial basis function (NRBF) 60, 160, 161, 163, 165, 166, 167, 168, 62, 63, 64, 66, 67, 68, 74, 77, 92 169, 170, 171, 172, 173 not missing at random (NMAR) missing data indicator matrix 173 151, 173, 175 missing data mechanism 151, 173 missing data pattern 173 O mixtures-of-experts (ME) 62, 64, 65, 66, objective function 95, 96, 97, 101, 104, 108 67, 68, 74, 77, 78, 83, 86, 90, 92 open loop control system 429, 439 model checking 619 opinion mining 325, 327, 328, 329, 330, model learning 473, 475, 481 331, 340, 343, 347 model selection 530, 531, 533, 535, 538 orthogonal projection 30 motif discovery 300, 301 outlier 439 multilayer perceptron (MLP) 201, 202, 215, overfitting 430, 436, 439, 521, 528, 530, 217, 430, 432, 435, 439, 442, 444, 531, 533, 535, 538 456, 501, 502, 503, 504, 510, 511, 512, 513, 514, 518 P multiple imputation 149, 153, 154, 155, pareto differential evolutionary algorithm 598 168, 172, 173 parsing 303, 304, 311, 312, 315, 323, 324 multispectral imaging 498 particle swarm optimization (PSO) 196, 212 multi-task learning 244, 245, 248, 264 partitional clustering 2, 4, 26 multivariate time series 176, 177, 194 part-of-speech tagging mutual information 520, 526, 527, 533, 538 302, 303, 304, 316, 323 N pattern classification 147, 148, 149, 150, 152, 157, 168, 173 naive Bayes model 244 pattern evaluation 301 naïve Bayes (NB) 307, 308, 315, 317, 333, pattern mining 279, 297, 298, 301 340, 341 phototaxis behavior 575, 576, 579, 582, name entity recognition (NER) 585, 586, 598 311, 317, 333, 337, 341 Poisson’s ratio 568, 572 natural language processing 302, 318, 320, population based algorithm 108 321, 323, 325, 326, 327, 328, 333, portfolio management 338, 341, 342, 343, 344, 345, 346, 376, 377, 379, 383, 384, 385 347 positive characterisation 127 Near InfraRed (NIR) 492, 493, 498 positive definite kernel negative characterisation 127 225, 227, 230, 231, 241 negative transfer 242, 244, 254, 255, 256, precision agriculture 498 257, 259, 264 predictive accuracy 173 nested learning 303, 309, 312, 323 principal component analysis (PCA) 29, 31, 3 neural gas 6, 13, 14, 23, 27 2, 33, 35, 49, 50, 52, 56, 58, neural logic network 382, 383, 386 430, 432 news monitoring 325, 331, 333, 335, 336, principal components 28, 31, 32, 33, 35, 340, 347 42, 48, 54, 55, 56, 59 nonlinear dimensionality reduction 194 principal cubic complexes 29, 47, 51 non-local recurrent principal graph 43, 44, 45, 46, 59 196, 209, 211, 212, 213, 222

81 Index

principal manifold 32, 35, 37, 39, 40, 41, self-organizing feature map (SOFM) 42, 48, 50, 53, 59 6, 11, 12, 14, 19, 26 privacy protection 325, 326, 337, 340, 347 self-organizing maps (SOM) 29, 35, 36, probabilistic calibration for classification 177, 193, 448, 449, 450, 451, 452, 130, 146 454, 456 probabilistic calibration for regression semantic structures 457, 458, 459, 460, 131, 146 461, 462, 463, 465, 466, 472, 474, problem distribution 619 476, 477, 478, 480 sequence alignment 282, 301 Q sequence motif 301 Q-learning 265, 266, 268, 269, 272, 273, shoe upper xxi, 561, 562, 563, 564, 565, 276 566, 569, 570, 572 software cost estimation R 500, 501, 508, 514, 516, 518 software inspection 519, 534, 538 radial basis function network (RBFN) 404, source task 243, 244, 246, 250, 251, 252, 406, 409, 413, 414, 416, 417, 418, 253, 254, 255, 256, 258, 259, 264 419, 420, 421, 426, 501, 502, 503, spectral decomposition 33 504, 514, 518 sports video analysis 458, 479, 480 radial basis function (RBF) 60, 61, 64, 65, steady-state regime 439 66, 78, 85, 86, 87, 89, 90, 91, 92 stem recognition 498 radio frequency localization behavior 598 stochastic algorithm 103, 104, 108 real time operation 498 subspace based functions recurrent neural networks 195, 196, 200, 60, 62, 78, 79, 86, 92 201, 205, 208, 214, 215, 216, 217, support vector clustering (SVC) 5, 6 218, 219, 221, 222, 456 support vector machine (SVM) 5, 254, 305, regularization 528, 538 307, 308, 311, 312, 315, 317, 318, reinforcement learning 242, 243, 249, 255, 329, 330, 331, 335, 336, 338, 339, 256, 257, 258, 259, 260, 261, 262, 340, 341, 343, 404, 405, 406, 407, 263, 264, 265, 275, 276, 376, 384 408, 413, 414, 415, 416, 417, 418, reliability diagrams 146 419, 420, 421, 426, 501, 502, 507, rival penalized competitive learning (RPCL) 508, 510, 511, 512, 513, 514, 518 60, 66, 67, 74, 77, 81, 90, 92 synaptic weight 207, 212 rule extraction 404, 405, 406, 413, 422, 426 T S target task 242, 243, 244, 245, 246, 247, sales forecasting xvii, 387, 389, 396, 397, 248, 250, 251, 252, 253, 254, 255, 399, 400, 401, 403 256, 257, 258, 259, 264 SARIMA (seasonal autoregressive in- text classification tegrated moving average model) 325, 326, 331, 340, 342, 347 387, 388, 396, 397, 399, 403 time series 389, 390, 391, 392, 393, 394, search algorithms 301 396, 397, 398, 399, 400, 403 search and rescue (SAR) 575, 598 transfer learning 242, 243, 244, 245, 246, segmental HMM 460, 464, 465, 469 248, 257, 258, 259, 260, 261, 262, self-consistent approximation 59 264 self-nonself discrimination 125, 127

82 Index

transient regime 439 W traveling salesman problem 4, 17, 18, 24, 25, 27 wavelet representation 230, 241 word-sense disambiguation U 302, 303, 304, 315, 323 utility problem 606, 607, 619 Y V Young’s modulus 568, 572 variational Bayesian methods 194 very-large-scale integration (VLSI) 7 video mining 457, 458, 459, 460, 461, 462, 463, 464, 477, 478, 479, 480