The Technology of Binaural Understanding
Hardcover
Series: Modern Acoustics and Signal Processing
Technology & EngineeringPhysics
ISBN13: 9783030003852
Publisher: Springer Nature
Published: Aug 13 2020
Pages: 815
Weight: 2.92
Height: 1.75 Width: 6.14 Depth: 9.21
Language: English
Sound, devoid of meaning, would not matter to us. It is the information sound conveys that helps the brain to understand its environment. Sound and its underlying meaning are always associated with time and space. There is no sound without spatial properties, and the brain always organizes this information within a temporal-spatial framework. This book is devoted to understanding the importance of meaning for spatial and related further aspects of hearing, including cross-modal inference.
This semiotic maxim may not always apply, for instance, when the reactions are reflexive. But, where it does apply, it poses a major challenge to the builders of models of the auditory system. Take, for example, an auditory model that is meant to be implemented on a robotic agent for autonomous search-&-rescue actions. Or think of a system that can performjudgments on the sound quality of multimedia-reproduction systems. It becomes immediately clear that such a system needs
- Cognitive capabilities, including substantial inherent knowledge
- The ability to integrate information across different sensory modalities
To realize these functions, the auditory system provides a pair of sensory organs, the two ears, and the means to perform adequate preprocessing of the signals provided by the ears. This is realized in the subcortical parts of the auditory system. In the title of a prior book, the term Binaural Listening is used to indicate a focus on sub-cortical functions. Psychoacoustics and auditory signal processing contribute substantially to this area.
The preprocessed signals are then forwarded to the cortical parts of the auditory system where, among other things, recognition, classification, localization, scene analysis, assignment of meaning, quality assessment, and action planning take place. Also, information from different sensory modalities is integrated at this level. Between sub-cortical and cortical regions of the auditory system, numerous feedback loops exist that ultimately support the high complexity and plasticity of the auditory system.
The current book concentrates on these cognitive functions. Instead of processing signals, processing symbols is now the predominant modeling task. Substantial contributions to the field draw upon the knowledge acquired by cognitive psychology. The keyword Binaural Understanding in the book title characterizes this shift.
Both books, The Technology of Binaural Listening and the current one, have been stimulated and supported by AABBA, an open research group devoted to the development and application of models of binaural hearing. The current book is dedicated to technologies that help explain, facilitate, apply, and support various aspects of binaural understanding. It is organized into five parts, each containing three to six chapters in order to provide a comprehensive overview of this emerging area. Each chapter was thoroughly reviewed by at least two anonymous, external experts.
The first part deals with the psychophysical and physiological effects of Forming and Interpreting Aural Objects as well as the underlying models. The fundamental concepts of reflexive and reflective auditory feedback are introduced. Mechanisms of binaural attention and attention switching are covered--as well as how auditory Gestalt rules facilitate binaural understanding. A general blackboard architecture is introduced as an example of how machines can learn to form and interpret aural objects to simulate human cognitive listening.
The second part, Configuring and Understanding Aural Space, focuses on the human understanding of complex three-dimensional environments--covering the psychological and biological fundamentals of auditory space formation. This part further addresses the human mechanisms used to process information and interact in complex reverberant environments, such as concert halls and forests, and additionally examines how the auditory system can learn to understand and adapt to these environments.
The third part is dedicated to Processing Cross-Modal Inference and highlights the fundamental human mechanisms used to integrate auditory cues with cues from other modalities to localize and form perceptual objects. This part also provides a general framework for understanding how complex multimodal scenes can be simulated and rendered.
The fourth part, Evaluating Aural-scene Quality and Speech Understanding, focuses on the object-forming aspects of binaural listening and understanding. It addresses cognitive mechanisms involved in both the understanding of speech and the processing of nonverbal information such as Sound Quality and Quality-of- Experience. The aesthetic judgment of rooms is also discussed in this context. Models that simulate underlying human processes and performance are covered in addition to techniques for rendering virtual environments that can then be used to test these models.
The fifth part deals with the Application of Cognitive Mechanisms to Audio Technology. It highlights how cognitive mechanisms can be utilized to create spatial auditory illusions using binaural and other 3D-audio technologies. Further, it covers how cognitive binaural technologies can be applied to improve human performance in auditory displays and to develop new auditory technologies for interactive robots. The book concludes with the application of cognitive binaural technologies to the next generation of hearing aids.
Also in
Technology & Engineering
All Data Are Local: Thinking Critically in a Data-Driven Society
Loukissas, Yanni Alexander
Paperback
The Age of Living Machines: How Biology Will Build the Next Technology Revolution
Hockfield, Susan
Paperback
Ingenious Patents: Bubble Wrap, Barbed Wire, Bionic Eyes, and Other Pioneering Inventions
Ikenson, Ben
Bennett, Jay
Hardcover
The Reverse Centaur's Guide to Life After AI: How to Think about Artificial Intelligence--Before It's Too Late
Doctorow, Cory
Paperback
The Agi Chronicles: The Inside Story of the Race to Create an Artificial Superintelligence
Roose, Kevin
Hardcover
Improvised Munitions Black Book: Complete and Unabridged in One Volume: Complete and Unabridged in One Volume
U S Government
Paperback
You Don't Need a Smartphone: A Practical Guide to Downgrading Your Phone and Upgrading Your Life
Lamm, August
Paperback
AI for Good: How Real People Are Using Artificial Intelligence to Fix Things That Matter
Tyrangiel, Josh
Hardcover
The Story of Your Life: How Social Media Shapes the Way We Experience Everything
Jezer-Morton, Kathryn
Hardcover
The Infinity Machine: Demis Hassabis, Deepmind, and the Quest for Superintelligence
Mallaby, Sebastian
Hardcover
Ultimate Guide: Wiring, Updated 10th Edition: Meets Current National Electrical Code Standards
The Editors of Creative Homeowner
Paperback
Basic Butchering of Livestock & Game: Beef, Veal, Pork, Lamb, Poultry, Rabbit, Venison
Mettler, John J.
Paperback
Lightning Beneath the Sea: The Race to Wire the World and the Dawn of the Information Age
Tabor, James M.
Hardcover
Like, Follow, Subscribe: Influencer Kids and the Cost of a Childhood Online
Latifi, Fortesa
Hardcover
Kobuk the Destroyer: And Other Tales from the Wild, Unseen World of Test Engineering
Davies, Alex
Hardcover
Empire of Ink: The Printers, Rogues, and Radicals Who Invented the American Newspaper
Wright, Alex
Hardcover
Midnight in Chernobyl: The Untold Story of the World's Greatest Nuclear Disaster
Higginbotham, Adam
Paperback
No One's Coming: The Rogue Heroes Our Government Turns to When There's Nowhere Else to Turn
Hazzard, Kevin
Hardcover
The Home Blacksmith: Tools, Techniques, and 40 Practical Projects for the Home Blacksmith
Ridgway, Ryan
Paperback
The Ultimate Guide to Rebuilding a Civilization: A Technical Manual for the Post-Collapse Era
Evans, James
Paperback
City on the Edge: Technology, Politics, and the Fight for the Soul of San Francisco
Weber, Jonathan
Hardcover
Curved Air: A Biography of Sickle Cell Anemia and the Quest to Cure the First Molecular Disease
Davies, Kevin
Hardcover
The Elements of Power: A Story of War, Technology, and the Dirtiest Supply Chain on Earth
Niarchos, Nicolas
Hardcover
Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence
Crawford, Kate
Paperback
The Problem with Plastic: How We Can Save Ourselves and Our Planet Before It's Too Late
Beyond Plastics
Enck, Judith
Mahoney, Adam
Hardcover
AI Snake Oil: What Artificial Intelligence Can Do, What It Can't, and How to Tell the Difference
Narayanan, Arvind
Kapoor, Sayash
Paperback
Generation Regeneration: Codesigning the Future of Cities Through Regenerative Placemaking
Cho, Tony
Hardcover
CompTIA Tech+ Certification All-in-One Exam Guide, Third Edition (Exam FC0-U71)
Wempen, Faithe
Paperback
Crisis Engineering: Time-Tested Tools for Turning Chaos Into Clarity
Dickerson, Mikey
Nitze, Marina
Weaver, Matthew
Paperback
A Brief History of Cities in 32 Inventions: The Ideas and Technologies That Made Modernity Possible
Elledge, Jonn
Hardcover
The Boy Who Harnessed the Wind: Creating Currents of Electricity and Hope
Mealer, Bryan
Kamkwamba, William
Paperback
Bringing Columbia Home: The Untold Story of a Lost Space Shuttle and Her Crew
Ward, Jonathan H.
Leinbach, Michael D.
Paperback
Artificial Intelligence: A Guide for Thinking Humans (with a New Preface)
Mitchell, Melanie
Paperback
Human + Machine, Updated and Expanded: Reimagining Work in the Age of AI
Daugherty, Paul R.
Wilson, H. James
Hardcover
The Bitter Struggle: Superintelligence, Superpowers, and the Fate of the World
Collins, Tantum
Buchanan, Ben
Hardcover
Cadillac Desert: The American West and Its Disappearing Water, Revised Edition
Reisner, Marc
Paperback
Meat: How the Next Agricultural Revolution Will Transform Humanity's Favorite Food--And Our Future
Friedrich, Bruce
Hardcover
Make: Electronics: Learning by Discovery: A Hands-On Primer for the New Electronics Enthusiast
Platt, Charles
Paperback
Pilot's Handbook of Aeronautical Knowledge: Faa-H-8083-25c
Federal Aviation Administration (FAA)
Hardcover
The New Age of Sexism: How AI and Emerging Technologies Are Reinventing Misogyny
Bates, Laura
Hardcover
Inconspicuous Consumption: The Environmental Impact You Don't Know You Have
Schlossberg, Tatiana
Paperback
The Bullwhip's Algorithm: Artificial Intelligence and America's Racial Caste System
Bobb, Kamau
Hardcover
CNC Woodworking for the Absolute Beginner: Winning Tips, Techniques & 5 Skill-Building Projects
Bagnall, Ralph
Paperback
Bioinspired: How Nature Made Us Modern, Drives Today's Technological Innovation, and Inspires a Future Worth Inventing
Stier, Samuel Cord
Hardcover
Tubes: A Journey to the Center of the Internet with a New Introduction by the Author
Blum, Andrew
Paperback
AI Projects with Raspberry Pi: High-Performance Artificial Intelligence for Robotics, Security, Home Automation, and Vision
Hattersley, Lucy
Jepson, Brian
Paperback
High-Wing Aircraft Visualized Flight Maneuvers Manual: For Pilots in Training
ASA Test Prep Board
Paperback
ASE Technician Test Preparation Automotive Maintenance and Light Repair (G1)
Delmar Cengage Learning
Paperback
The Baofeng Radio Revolution: The Beginner Guerrilla's Guide to Break Through the Complexity, Secure Communications, and Prepare for Disaster With Pre
Code Publishing, Morse
Hardcover
Broken Money: Why Our Financial System is Failing Us and How We Can Make it Better
Alden, Lyn
Paperback
The Trillion Dollar War Machine: How Runaway Military Spending Drives America Into Foreign Wars and Bankrupts Us at Home
Hartung, William D.
Freeman, Ben
Hardcover
Disneyland and the Rise of Automation: How Technology Created the Happiest Place on Earth
Betancourt, Roland
Hardcover
Agentic Artificial Intelligence: Harnessing AI Agents to Reinvent Business, Work, and Life
Wirtz, Jochen
Davenport, Thomas H.
Bornet
Paperback
How to Use an Oscilloscope 2026: Master Measurement Skills for Electronics Beginners and Pros
Grant, Nathaniel Cole
Paperback
Air Force Handbook 10-644 Survival Evasion Resistance Escape SERE Operations: 27 March 2017
The Air Force, Department of
Paperback
The Coming Wave: Technology, Power, and the Twenty-First Century's Greatest Dilemma
Suleyman, Mustafa
Hardcover
Drawing Lessons with Da Vinci: An Artist's Guide to Geometry, Anatomy and Proportion
Roig, Gabriel Martín
Paperback
AI Snake Oil: What Artificial Intelligence Can Do, What It Can't, and How to Tell the Difference
Kapoor, Sayash
Narayanan, Arvind
Hardcover
Texas DMV Driver's Handbook: Practice for the Texas Permit Test with 350+ Driving Questions and Answers
Prep, Discover
Paperback
Reinventing Wool: How a Natural Fiber Survived the Synthetic Revolution
Littlefield, Melissa M.
Hardcover
Essential Off-Grid Survival Projects: 50 Life-Saving Solutions for Shelter, Water, Food, and Safety
Furneaux, Ky
Hardcover
The Powerful Primate: How Controlling Energy Enabled Us to Build Civilization
Ennos, Roland
Hardcover
The Shortest History of Innovation: From the Wheel to Gene Editing, Ai, and Beyond - How New Ideas Shape Our World
Leigh, Andrew
Paperback
Spec Ops: Case Studies in Special Operations Warfare: Theory and Practice
McRaven, William H.
Paperback
The Unaccountability Machine: Why Big Systems Make Terrible Decisions--And How the World Lost Its Mind
Davies, Dan
Paperback
Longitude: The True Story of a Lone Genius Who Solved the Greatest Scientific Problem of His Time
Sobel, Dava
Paperback
