Sign-In
Cart
Information Theory Meets Power Laws: Stochastic Processes and Language Models
Hardcover
LinguisticsTechnology & Engineering
ISBN13: 9781119625278
Publisher: Wiley
Published: Dec 10 2020
Pages: 384
Weight: 1.55
Height: 0.90 Width: 6.00 Depth: 9.10
Language: English
Discover new theoretical connections between stochastic phenomena and the structure of natural language with this powerful volume!
Information Theory Meets Power Laws: Stochastic Processes and Language Models presents readers with a novel subtype of a probabilistic approach to language, which is based on statistical laws of texts and their analysis by means of information theory. The distinguished author insightfully and rigorously examines the linguistic and mathematical subject matter while eschewing needlessly abstract and superfluous constructions.
The book begins with a less formal treatment of its subjects in the first chapter, introducing its concepts to readers without mathematical training and allowing those unfamiliar with linguistics to learn the book's motivations. Despite its inherent complexity, Information Theory Meets Power Laws: Stochastic Processes and Language Models is a surprisingly approachable treatment of idealized mathematical models of human language.
The author succeeds in developing some of the theory underlying fundamental stochastic and semantic phenomena, like strong nonergodicity, in a way that has not previously been seriously attempted. In doing so, he covers topics including:
- Zipf's and Herdan's laws for natural language
- Power laws for information, repetitions, and correlations
- Markov, finite-state, and Santa Fe processes
- Bayesian and frequentist interpretations of probability
- Ergodic decomposition, Kolmogorov complexity, and universal coding
- Theorems about facts and words
- Information measures for fields
- Rényi entropies, recurrence times, and subword complexity
- Asymptotically mean stationary processes
Written primarily for mathematics graduate students and professionals interested in information theory or discrete stochastic processes, Information Theory Meets Power Laws: Stochastic Processes and Language Models also belongs on the bookshelves of doctoral students and researchers in artificial intelligence, computational and quantitative linguistics as well as physics of complex systems.
Also in
Technology & Engineering
Improvised Munitions Black Book: Complete and Unabridged in One Volume: Complete and Unabridged in One Volume
U S Government
Paperback
Off-Grid Solar Power Made Easy: Design and Installation of Photovoltaic system For Rvs, Vans, Cabins, Boats and Tiny Homes
Jordan, William
Hardcover
The New Age of Sexism: How AI and Emerging Technologies Are Reinventing Misogyny
Bates, Laura
Hardcover
Musashi's Book of Five Rings: The Definitive Interpretation of Miyamoto Musashi's Classic Book of Strategy
Kaufman, Stephen F.
Musashi, Miyamoto
Paperback
The Problem with Plastic: How We Can Save Ourselves and Our Planet Before It's Too Late
Mahoney, Adam
Beyond Plastics
Enck, Judith
Hardcover
Rocket Dreams: Musk, Bezos, and the Inside Story of the New, Trillion-Dollar Space Race
Davenport, Christian
Hardcover
The Home Blacksmith: Tools, Techniques, and 40 Practical Projects for the Home Blacksmith
Ridgway, Ryan
Paperback
ASE Technician Test Preparation Automotive Maintenance and Light Repair (G1)
Delmar Cengage Learning
Paperback
AI Snake Oil: What Artificial Intelligence Can Do, What It Can't, and How to Tell the Difference
Narayanan, Arvind
Kapoor, Sayash
Hardcover
Midnight in Chernobyl: The Untold Story of the World's Greatest Nuclear Disaster
Higginbotham, Adam
Paperback
Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence
Crawford, Kate
Paperback
CNC Woodworking for the Absolute Beginner: Winning Tips, Techniques & 5 Skill-Building Projects
Bagnall, Ralph
Paperback
The Trillion Dollar War Machine: How Runaway Military Spending Drives America Into Foreign Wars and Bankrupts Us at Home
Hartung, William D.
Freeman, Ben
Hardcover
The Fourth Intelligence Revolution: The Future of Espionage and the Battle to Save America
Vinci, Anthony
Hardcover
Broken Money: Why Our Financial System is Failing Us and How We Can Make it Better
Alden, Lyn
Paperback
The Pacific Circuit: A Globalized Account of the Battle for the Soul of an American City
Madrigal, Alexis
Hardcover
The Baofeng Radio Revolution: The Beginner Guerrilla's Guide to Break Through the Complexity, Secure Communications, and Prepare for Disaster With Pre
Code Publishing, Morse
Hardcover
Agentic Artificial Intelligence: Harnessing AI Agents to Reinvent Business, Work, and Life
Davenport, Thomas H.
Bornet
Wirtz, Jochen
Paperback
Pilot's Handbook of Aeronautical Knowledge (2025): Faa-H-8083-25c
Federal Aviation Administration (FAA)
Paperback
The Unaccountability Machine: Why Big Systems Make Terrible Decisions--And How the World Lost Its Mind
Davies, Dan
Paperback
The Big Hop: The First Non-Stop Flight Across the Atlantic Ocean and Into the Future
Rooney, David
Hardcover
The Coming Wave: Technology, Power, and the Twenty-First Century's Greatest Dilemma
Suleyman, Mustafa
Hardcover
Engineering in Plain Sight: An Illustrated Field Guide to the Constructed Environment
Hillhouse, Grady
Hardcover
AI Snake Oil: What Artificial Intelligence Can Do, What It Can't, and How to Tell the Difference
Kapoor, Sayash
Narayanan, Arvind
Paperback
Tubes: A Journey to the Center of the Internet with a New Introduction by the Author
Blum, Andrew
Paperback
Artificial Intelligence: A Guide for Thinking Humans (with a New Preface)
Mitchell, Melanie
Paperback
The Cybernetic Society: How Humans and Machines Will Shape the Future Together
Husain, Amir
Hardcover
The Book of Five Rings: Including the Book of Family Traditions on the Art of War by Yagyu Munenori
Musashi, Miyamoto
Paperback
Adventures on the Wine Route: A Wine Buyer's Tour of France (25th Anniversary Edition)
Lynch, Kermit
Paperback
Beast in the Machine: How Robotics and AI Will Transform Warfare and the Future of Human Conflict
Dougherty, George M.
Hardcover
The Elements of Power: A Story of War, Technology, and the Dirtiest Supply Chain on Earth
Niarchos, Nicolas
Hardcover
The Natural Dye Handbook: A Comprehensive Guide to Dyeing with Plants for Beginners and Beyond
Iverson, Heidi
Hardcover
What Is Intelligence?: Lessons from AI about Evolution, Computing, and Minds
Aguera Y. Arcas, Blaise
Paperback
Power and Progress: Our Thousand-Year Struggle Over Technology and Prosperity
Johnson, Simon
Acemoglu, Daron
Paperback
Basic Butchering of Livestock & Game: Beef, Veal, Pork, Lamb, Poultry, Rabbit, Venison
Mettler, John J.
Paperback
Agentic Artificial Intelligence: Harnessing AI Agents to Reinvent Business, Work, and Life
Wirtz, Jochen
Davenport, Thomas H.
Bornet, Pascal
Hardcover
Pilot's Handbook of Aeronautical Knowledge: Faa-H-8083-25c
Federal Aviation Administration (FAA)
Hardcover
Trapped Under the Sea: One Engineering Marvel, Five Men, and a Disaster Ten Miles Into the Darkness
Swidey, Neil
Paperback
The Body Digital: A Brief History of Humans and Machines from Cuckoo Clocks to ChatGPT
Chang, Vanessa
Paperback
Longitude: The True Story of a Lone Genius Who Solved the Greatest Scientific Problem of His Time
Sobel, Dava
Paperback
Genesis: Artificial Intelligence, Hope, and the Human Spirit
Mundie, Craig
Kissinger, Henry a.
Schmidt, Eric
Hardcover
The Magic of Code: How Digital Language Created and Connects Our World--And Shapes Our Future
Arbesman, Samuel
Hardcover
Rad Future: The Untold Story of Nuclear Electricity and How It Will Save the World
Boemeke, Isabelle
Hardcover
The Color of North: The Molecular Language of Proteins and the Future of Life
Fink, Maggie M.
Rizk, Shahir S.
Hardcover
The Boy Who Harnessed the Wind: Creating Currents of Electricity and Hope
Mealer, Bryan
Kamkwamba, William
Paperback
Cadillac Desert: The American West and Its Disappearing Water, Revised Edition
Reisner, Marc
Paperback
Make: Electronics: Learning by Discovery: A Hands-On Primer for the New Electronics Enthusiast
Platt, Charles
Paperback
Guía práctica en gestión de proyectos: Aprende a aplicar las técnicas de gestión de proyectos a proyectos reales
Garriga Rodriguez, Albert
Paperback
Essential Electric Circuits: Analysis and Design with Practical Considerations and Applications
Hanselman, Duane
Paperback
The Wildcrafting Brewer: Creating Unique Drinks and Boozy Concoctions from Nature's Ingredients
Baudar, Pascal
Paperback
Chassis Engineering: Chassis Design, Building & Tuning for High Performance Cars
Adams, Herb
Paperback
Designing for People: An Introduction to Human Factors Engineering
Wickens, Christopher D.
Liu, Yili
Boyle, Linda Ng
Paperback
Bringing Columbia Home: The Untold Story of a Lost Space Shuttle and Her Crew
Ward, Jonathan H.
Leinbach, Michael D.
Paperback
Deadliest Sea: The Untold Story Behind the Greatest Rescue in Coast Guard History
Thompson, Kalee
Paperback
AI for Business: The Beginner's Fast Track to ChatGPT for Productivity, Profit, and Growth (2 books in 1)
Grant, Russel
Paperback
U.S. Army Special Forces Guide to Unconventional Warfare: Devices and Techniques for Incendiaries
Army
United States Department of the Army
Paperback
Energy-Based Safety: A Scientific Approach to Preventing Serious Injuries and Fatalities (Sifs)
Hallowell, Matthew R.
Hardcover
Texas DMV Driver's Handbook: Practice for the Texas Permit Test with 350+ Driving Questions and Answers
Prep, Discover
Paperback
forgot password: A great book to keep all confidential info handy for websites/usernames/passwords with tabs alphabetical A-Z
Henderson, Maya Lp
Paperback
Introduction to Live Sound Reinforcement: The Science, the Art, and the Practice
Boyce, Teddy
Paperback
The Lost Subways of North America: A Cartographic Guide to the Past, Present, and What Might Have Been
Berman, Jake
Hardcover
Grid Systems in Graphic Design: A Visual Communication Manual for Graphic Designers, Typographers and Three Dimensional Designers
Müller-Brockmann, Josef
Hardcover