Self Organization And Associative Memory

Self-Organization and Associative Memory

While the present edition is bibliographically the third one of Vol. 8 of the Springer Series in Information Sciences (IS 8), the book actually stems from Vol. 17 of the series Communication and Cybernetics (CC 17), entitled Associative Memory - A System-Theoretical Approach, which appeared in 1977. That book was the first monograph on distributed associative memories, or "content-addressable memories" as they are frequently called, especially in neural-networks research. This author, however, would like to reserve the term "content-addressable memory" for certain more traditional constructs, the memory locations of which are selected by parallel search. Such devices are discussed in Vol. 1 of the Springer Series in Information Sciences, Content-Addressable Memories. This third edition of IS 8 is rather similar to the second one. Two new discussions have been added: one to the end of Chap. 5, and the other (the L VQ 2 algorithm) to the end of Chap. 7. Moreover, the convergence proof in Sect. 5.7.2 has been revised.

Self-organization and Associative Memory

Self-Organization and Associative Memory

Two significant things have happened since the writing of the first edition in 1983. One of them is recent arousal of strong interest in general aspects of "neural computing", or "neural networks", as the previous neural models are nowadays called. The incentive, of course, has been to develop new com puters. Especially it may have been felt that the so-called fifth-generation computers, based on conventional logic programming, do not yet contain in formation processing principles of the same type as those encountered in the brain. All new ideas for the "neural computers" are, of course, welcome. On the other hand, it is not very easy to see what kind of restrictions there exist to their implementation. In order to approach this problem systematically, cer tain lines of thought, disciplines, and criteria should be followed. It is the pur pose of the added Chapter 9 to reflect upon such problems from a general point of view. Another important thing is a boom of new hardware technologies for dis tributed associative memories, especially high-density semiconductor circuits, and optical materials and components. The era is very close when the parallel processors can be made all-optical. Several working associative memory archi tectures, based solely on optical technologies, have been constructed in recent years. For this reason it was felt necessary to include a separate chapter (Chap. 10) which deals with the optical associative memories. Part of its con tents is taken over from the first edition.