User menu

Accès à distance ? S'identifier sur le proxy UCLouvain

Cognitive and brain mechanisms in sensory substitution of vision: a contribution to the study of human perception.

Primary tabs

Renier, Laurent [UCL] De Volder, Anne [UCL]

Sensory substitution refers to the use of one sense to pick up information normally gathered by another sensory organ. With recent technological advances and scientific progress, sensory substitution appears as an interesting alternative for restoring some functions of a defective sensory organ (e.g., the sight in case of blindness). At the same time, our knowledge about cognitive and brain mechanisms involved in sensory substitution has grown considerably, bringing new insights into human perception and neural plasticity. From this perspective, sensory substitution can be considered as both a tool to investigate human cognition and brain functions, and a research topic in its own right. This paper addresses some of the major questions raised by sensory substitution, demonstrates how the study of sensory substitution enhances our understanding of human perception and brain plasticity and provides an overview of rehabilitation potentialities.

Document type Article de périodique (Journal article) – Article de recherche
Access type Accès restreint
Publication date 2005
Journal information "Journal of integrative neuroscience" - Vol. 4, no. 4, p. 489-503 (2005)
Peer reviewed yes
issn 0219-6352
Publication status Publié
Affiliation UCL - MD/FSIO - Département de physiologie et pharmacologie
MESH Subject Blindness - rehabilitation ; Brain - physiology ; Cognition - physiology ; Humans ; Neuronal Plasticity - physiology ; Visual Perception - physiology
Keywords Sensory substitution ; Brain plasticity ; Early blindness ; Functional imaging ; Crossmodal perception
Links
  1. Amedi Amir, Raz Noa, Pianka Pazit, Malach Rafael, Zohary Ehud, Early 'visual' cortex activation correlates with superior verbal memory performance in the blind, 10.1038/nn1072
  2. Arno Patricia, Capelle Christian, Wanet-Defalque Marie-Chantal, Catalan-Ahumada Mitzi, Veraart Claude, Auditory Coding of Visual Patterns for the Blind, 10.1068/p281013
  3. Arno Patricia, De Volder Anne G., Vanlierde Annick, Wanet-Defalque Marie-Chantal, Streel Emmanuel, Robert Annie, Sanabria-Bohórquez Sandra, Veraart Claude, Occipital Activation by Pattern Recognition in the Early Blind Using Auditory Substitution for Vision, 10.1006/nimg.2000.0731
  4. Arno P., Vanlierde A., Streel E., Wanet-Defalque M.-C., Sanabria-Bohorquez S., Veraart C., Auditory substitution of vision: pattern recognition by the blind, 10.1002/acp.720
  5. Bach-y-Rita P., Brain Mechanisms in Sensory Substitution (1972)
  6. Bach-y-Rita P., Nonsynaptic Diffusion Neurotransmission and Late Brain Reorganization (1995)
  7. Bach-y-Rita P., Perception et Intermodalité (1997)
  8. BACH-Y-RITA PAUL, Tactile Sensory Substitution Studies, 10.1196/annals.1305.006
  9. BACH-Y-RITA PAUL, COLLINS CARTER C., SAUNDERS FRANK A., WHITE BENJAMIN, SCADDEN LAWRENCE, Vision Substitution by Tactile Image Projection, 10.1038/221963a0
  10. Bach-y-Rita P., J. Rehabil. Res. Dev., 35, 427
  11. Bach-y-Rita Paul, W. Kercel Stephen, Sensory substitution and the human–machine interface, 10.1016/j.tics.2003.10.013
  12. Bach-y-Rita Paul, Tyler Mitchell E., Kaczmarek Kurt A., Seeing with the Brain, 10.1207/s15327590ijhc1502_6
  13. Bliss James, Katcher Michael, Rogers Charles, Shepard Raymond, Optical-to-Tactile Image Conversion for the Blind, 10.1109/tmms.1970.299963
  14. J. A. Brabyn, Electronic Spatial Sensing for the Blind, eds. D. H. Warren and E. R. Strelow (Martinus Nijhoff, Boston, 1985) p. 544.
  15. Brindley G. S., J. Physiol., 96, 479
  16. Buchel C, Different activation patterns in the visual cortex of late and congenitally blind subjects, 10.1093/brain/121.3.409
  17. Büchel Christian, Price Cathy, Friston Karl, 10.1038/28389
  18. Burton H., Adaptive Changes in Early and Late Blind: A fMRI Study of Verb Generation to Heard Nouns, 10.1152/jn.00129.2002
  19. Capelle C., Trullemans C., Arno P., Veraart C., A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution, 10.1109/10.720206
  20. Collins Carter Compton, On Mobility Aids for the Blind, Electronic Spatial Sensing for the Blind (1985) ISBN:9789048182930 p.35-64, 10.1007/978-94-017-1400-6_4
  21. Collins Carter C., Bach-y-Rita Paul, Transmission of Pictorial Information Through the Skin, Advances in Biological and Medical Physics (1973) ISBN:9780120052141 p.285-315, 10.1016/b978-0-12-005214-1.50010-8
  22. Crandall William, Bentzen Billie Louise, Myers Linda, Brabyn John, New orientation and accessibility option for persons with visual impairment: transportation applications for remote infrared audible signage, 10.1111/j.1444-0938.2001.tb04955.x
  23. Crandall W., J. Rehabil. Res. Dev., 36, 341
  24. De Volder Anne G, Catalan-Ahumada Mitzi, Robert Annie, Bol Anne, Labar Daniel, Coppens Ann, Michel Christian, Veraart Claude, Changes in occipital cortex activity in early blind humans using a sensory substitution device, 10.1016/s0006-8993(99)01275-5
  25. De Volder Anne G., Toyama Hinako, Kimura Yuichi, Kiyosawa Motohiro, Nakano Hideki, Vanlierde Annick, Wanet-Defalque Marie-Chantal, Mishina Masahiro, Oda Keiichi, Ishiwata Kiichi, Senda Michio, Auditory Triggered Mental Imagery of Shape Involves Visual Association Areas in Early Blind Humans, 10.1006/nimg.2001.0782
  26. Dobelle Wm. H., Turkel Joseph, Henderson David C., Evans Jerald R., Mapping the Representation of the Visual Field by Electrical Stimulation of Human Visual Cortex, 10.1016/0002-9394(79)90673-1
  27. Farmer L. W., Bull. Prosthet. Res., 14, 47
  28. Gougoux Frédéric, Lepore Franco, Lassonde Maryse, Voss Patrice, Zatorre Robert J., Belin Pascal, Neuropsychology: Pitch discrimination in the early blind, 10.1038/430309a
  29. GREGORY R. L., Distortion of Visual Space as Inappropriate Constancy Scaling, 10.1038/199678a0
  30. Gregory R. L., Eye and Brain: The Psychology of Seeing (1997)
  31. R. E. Hoover, Blindness, ed. P. A. Zahl (Princeton University Press, Princeton NJ, 1950) p. 589.
  32. Howard I. P., Seeing in Depth Volume 1 Basic Mechanisms (2002)
  33. Humayun Mark S., Visual Perception Elicited by Electrical Stimulation of Retina in Blind Humans, 10.1001/archopht.1996.01100130038006
  34. Humayun Mark S., de Juan Jr. Eugene, Weiland James D., Dagnelie Gislin, Katona Steve, Greenberg Robert, Suzuki Satoshi, Pattern electrical stimulation of the human retina, 10.1016/s0042-6989(99)00052-8
  35. Kaczmareck K. A., CRC Handbook of Biomedical Engineering (1995)
  36. Kaczmarek K.A., Webster J.G., Bach-y-Rita P., Tompkins W.J., Electrotactile and vibrotactile displays for sensory substitution systems, 10.1109/10.68204
  37. Kay L., Br. Commun. Electron., 8, 582
  38. Kay L., New Outlook Blind, 67, 7
  39. Kay L., A sonar aid to enhance spatial perception of the blind: engineering design and evaluation, 10.1049/ree.1974.0148
  40. L. Kay, Electronic Spatial Sensing for the Blind, eds. D. H. Warren and E. R. Strelow (Martinus Nijhoff, Boston, 1985) p. 544.
  41. Kellogg W. N., Sonar System of the Blind: New research measures their accuracy in detecting the texture, size, and distance of objects "by ear.", 10.1126/science.137.3528.399
  42. Kujala Teija, Alho Kimmo, Paavilainen Petri, Summala Heikki, Näätänen Risto, Neural plasticity in processing of sound location by the early blind: an event-related potential study, 10.1016/0168-5597(92)90034-9
  43. Kujala Teija, Huotilainen Minna, Sinkkonen Janne, Ahonen Antti I., Alho Kimmo, Hämälä:inen Matti S., Ilmoniemi Risto J., Kajola Matti, Knuutila Jukka E.T., Lavikainen Juha, Salonen Oili, Simola Juha, Standertskjöld-Nordenstam Carl-Gustaf, Tiitinen Hannu, Tissari Satu O., Näätänen Risto, Visual cortex activation in blind humans during sound discrimination, 10.1016/0304-3940(94)11135-6
  44. Künnapas Theodor M., The vertical-horizontal illusion and the visual field., 10.1037/h0048637
  45. Kupers R., Neuroimage, 19
  46. Lambert S, Sampaio E, Mauss Y, Scheiber C, Blindness and brain plasticity: contribution of mental imagery?, 10.1016/j.cogbrainres.2003.12.012
  47. Leclerc Charles, Saint-Amour Dave, Lavoie Marc E., Lassonde Maryse, Lepore Franco, Brain functional reorganization in early blind humans revealed by auditory event-related potentials : , 10.1097/00001756-200002280-00024
  48. Lessard N., Nature, 395, 278
  49. J. M. Loomis, R. G. Golledge and R. L. Klatzky, Fundamentals of Wearable Computers and Augmented Reality, eds. W. Barfield and T. Caudell (Lawrence Erlbaum Associates, Mahwah NJ, 2000) p. 797.
  50. LOOMIS JACK M., KLATZKY ROBERTA L., GOLLEDGE and REGINALD G., Navigating without Vision: Basic and Applied Research : , 10.1097/00006324-200105000-00011
  51. Margalit Eyal, Maia Mauricio, Weiland James D, Greenberg Robert J, Fujii Gildo Y, Torres Gustavo, Piyathaisere Duke V, O'Hearn Thomas M, Liu Wentai, Lazzi Gianluca, Dagnelie Gislin, Scribner Dean A, de Juan Eugene, Humayun Mark S, Retinal Prosthesis for the Blind, 10.1016/s0039-6257(02)00311-9
  52. Meijer P.B.L., An experimental system for auditory image representations, 10.1109/10.121642
  53. Morgan M. J., Molyneux's Question (1977)
  54. Niemeyer W., Starlinger I., Do the Blind Hear Better? Investigations on Auditory Processing in Congenital or Early Acquired Blindness II. Central Functions, 10.3109/00206098109072719
  55. Normann R.A., Visual neuroprosthetics-functional vision for the blind, 10.1109/51.340752
  56. O'Regan J. Kevin, Noë Alva, A sensorimotor account of vision and visual consciousness, 10.1017/s0140525x01000115
  57. Pietrini P., Furey M. L., Ricciardi E., Gobbini M. I., Wu W.-H. C., Cohen L., Guazzelli M., Haxby J. V., Beyond sensory images: Object-based representation in the human ventral pathway, 10.1073/pnas.0400707101
  58. Ptito M., Cross-modal plasticity revealed by electrotactile stimulation of the tongue in the congenitally blind, 10.1093/brain/awh380
  59. Rauschecker Josef P., Compensatory plasticity and sensory substitution in the cerebral cortex, 10.1016/0166-2236(95)93948-w
  60. Rauschecker J. P., J. Neurosci., 13, 4538
  61. RENIER L, COLLIGNON O, POIRIER C, TRANDUY D, VANLIERDE A, BOL A, VERAART C, DEVOLDER A, Cross-modal activation of visual cortex during depth perception using auditory substitution of vision, 10.1016/j.neuroimage.2005.01.047
  62. Renier L., Annual Meeting of the Belgian Psychological Society (2003)
  63. Renier L., Perception, 34, 851
  64. Rice C. E., Psychol. Rec., 19, 1
  65. I. Rock, J. Gallant and P. Kube, Vision Science, ed. S. E. Palmer (MIT Press, Cambridge MA, 1999) p. 760.
  66. Röder Brigitte, Rösler Frank, Hennighausen Erwin, Näcker Fritz, Event-related potentials during auditory and somatosensory discrimination in sighted and blind human subjects, 10.1016/0926-6410(96)00024-9
  67. Röder Brigitte, Stock Oliver, Bien Siegfried, Neville Helen, Rösler Frank, Speech processing activates visual cortex in congenitally blind humans : Plasticity of language functions in blind adults, 10.1046/j.1460-9568.2002.02147.x
  68. Röder Brigitte, Teder-Sälejärvi Wolfgang, Sterr Anette, Rösler Frank, Hillyard Steven A., Neville Helen J., 10.1038/22106
  69. Sadato Norihiro, Okada Tomohisa, Honda Manabu, Yonekura Yoshiharu, Critical Period for Cross-Modal Plasticity in Blind Humans: A Functional MRI Study, 10.1006/nimg.2002.1111
  70. Sadato N, Neural networks for Braille reading by the blind, 10.1093/brain/121.7.1213
  71. Sadato Norihiro, Pascual-Leone Alvaro, Grafman Jordan, Ibañez Vicente, Deiber Marie-Pierre, Dold George, Hallett Mark, Activation of the primary visual cortex by Braille reading in blind subjects, 10.1038/380526a0
  72. Sampaio Eliana, Maris Stéphane, Bach-y-Rita Paul, Brain plasticity: ‘visual’ acuity of blind persons via the tongue, 10.1016/s0006-8993(01)02667-1
  73. Squire L., Memory and Brain (1987)
  74. Talairach J., Co-Planar Stereotaxic Atlas of the Human Brain (1988)
  75. E. Tulving, The Cognitive Neurosciences, ed. M. S. Gazzaniga (MIT Press, Cambridge MA, 1995) p. 1447.
  76. Uhl F., Franzen P., Lindinger G., Lang W., Deecke L., On the functionality of the visually deprived occipital cortex in early blind persons, 10.1016/0304-3940(91)90107-5
  77. Vanlierde Annick, De Volder Anne G, Wanet-Defalque Marie-Chantal, Veraart Claude, Occipito-parietal cortex activation during visuo-spatial imagery in early blind humans, 10.1016/s1053-8119(03)00153-8
  78. Veraart C., Neurophysiological approach to the design of visual prostheses: a theoretical discussion, 10.3109/03091908909030196
  79. Veraart Claude, Duret Florence, Brelén Marten, Oozeer Medhy, Delbeke Jean, Vision rehabilitation in the case of blindness, 10.1586/17434440.1.1.139
  80. Veraart Claude, Raftopoulos Christian, Mortimer J.Thomas, Delbeke Jean, Pins Delphine, Michaux Géraldine, Vanlierde Annick, Parrini Simone, Wanet-Defalque Marie-Chantal, Visual sensations produced by optic nerve stimulation using an implanted self-sizing spiral cuff electrode, 10.1016/s0006-8993(98)00977-9
  81. Veraart Claude, Wanet-Defalque Marie-Chantal, Gerard Benoit, Vanlierde Annick, Delbeke Jean, Pattern Recognition with the Optic Nerve Visual Prosthesis, 10.1046/j.1525-1594.2003.07305.x
  82. Weeks R., J. Neurosci., 20, 2664
  83. White Benjamin W., Saunders Frank A., Scadden Lawrence, Bach-Y-Rita Paul, Collins Carter C., Seeing with the skin, 10.3758/bf03210126
  84. Zappe Anne-Catherin, Maucher Thorsten, Meier Karlheinz, Scheiber Christian, Evaluation of a pneumatically driven tactile stimulator device for vision substitution during fMRI studies, 10.1002/mrm.20021
  85. Zrenner E., Stett A., Weiss S., Aramant R.B., Guenther E., Kohler K., Miliczek K.-D., Seiler M.J., Haemmerle H., Can subretinal microphotodiodes successfully replace degenerated photoreceptors?, 10.1016/s0042-6989(98)00312-5
Bibliographic reference Renier, Laurent ; De Volder, Anne. Cognitive and brain mechanisms in sensory substitution of vision: a contribution to the study of human perception.. In: Journal of integrative neuroscience, Vol. 4, no. 4, p. 489-503 (2005)
Permanent URL http://hdl.handle.net/2078.1/10440