Sign-In
Cart
Approximate Dynamic Programmin
Hardcover
Series: Wiley Probability and Statistics
Technology & EngineeringGeneral MathematicsProbability & Statistics
ISBN13: 9780470604458
Publisher: John Wiley & Sons
Published: Sep 22 2011
Pages: 656
Weight: 2.20
Height: 1.50 Width: 6.50 Depth: 9.40
Language: English
Finally, a book devoted to dynamic programming and written using the language of operations research (OR)! This beautiful book fills a gap in the libraries of OR specialists and practitioners.
--Computing Reviews
This new edition showcases a focus on modeling and computation for complex classes of approximate dynamic programming problems
Understanding approximate dynamic programming (ADP) is vital in order to develop practical and high-quality solutions to complex industrial problems, particularly when those problems involve making decisions in the presence of uncertainty. Approximate Dynamic Programming, Second Edition uniquely integrates four distinct disciplines--Markov decision processes, mathematical programming, simulation, and statistics--to demonstrate how to successfully approach, model, and solve a wide range of real-life problems using ADP.
The book continues to bridge the gap between computer science, simulation, and operations research and now adopts the notation and vocabulary of reinforcement learning as well as stochastic search and simulation optimization. The author outlines the essential algorithms that serve as a starting point in the design of practical solutions for real problems. The three curses of dimensionality that impact complex problems are introduced and detailed coverage of implementation challenges is provided. The Second Edition also features:
-
A new chapter describing four fundamental classes of policies for working with diverse stochastic optimization problems: myopic policies, look-ahead policies, policy function approximations, and policies based on value function approximations
-
A new chapter on policy search that brings together stochastic search and simulation optimization concepts and introduces a new class of optimal learning strategies
-
Updated coverage of the exploration exploitation problem in ADP, now including a recently developed method for doing active learning in the presence of a physical state, using the concept of the knowledge gradient
-
A new sequence of chapters describing statistical methods for approximating value functions, estimating the value of a fixed policy, and value function approximation while searching for optimal policies
The presented coverage of ADP emphasizes models and algorithms, focusing on related applications and computation while also discussing the theoretical side of the topic that explores proofs of convergence and rate of convergence. A related website features an ongoing discussion of the evolving fields of approximation dynamic programming and reinforcement learning, along with additional readings, software, and datasets.
Requiring only a basic understanding of statistics and probability, Approximate Dynamic Programming, Second Edition is an excellent book for industrial engineering and operations research courses at the upper-undergraduate and graduate levels. It also serves as a valuable reference for researchers and professionals who utilize dynamic programming, stochastic programming, and control theory to solve problems in their everyday work.
Also from
Powell
Statistical Tables for the Social, Biological and Physical Sciences
Powell
F. C., Powell
Powell, F. C.
Paperback
Also in
Technology & Engineering
All Data Are Local: Thinking Critically in a Data-Driven Society
Loukissas, Yanni Alexander
Paperback
The Age of Living Machines: How Biology Will Build the Next Technology Revolution
Hockfield, Susan
Paperback
Ingenious Patents: Bubble Wrap, Barbed Wire, Bionic Eyes, and Other Pioneering Inventions
Ikenson, Ben
Bennett, Jay
Hardcover
The Reverse Centaur's Guide to Life After AI: How to Think about Artificial Intelligence--Before It's Too Late
Doctorow, Cory
Paperback
Improvised Munitions Black Book: Complete and Unabridged in One Volume: Complete and Unabridged in One Volume
U S Government
Paperback
The Infinity Machine: Demis Hassabis, Deepmind, and the Quest for Superintelligence
Mallaby, Sebastian
Hardcover
AI for Good: How Real People Are Using Artificial Intelligence to Fix Things That Matter
Tyrangiel, Josh
Hardcover
The Story of Your Life: How Social Media Shapes the Way We Experience Everything
Jezer-Morton, Kathryn
Hardcover
Ultimate Guide: Wiring, Updated 10th Edition: Meets Current National Electrical Code Standards
The Editors of Creative Homeowner
Paperback
Like, Follow, Subscribe: Influencer Kids and the Cost of a Childhood Online
Latifi, Fortesa
Hardcover
Lightning Beneath the Sea: The Race to Wire the World and the Dawn of the Information Age
Tabor, James M.
Hardcover
No One's Coming: The Rogue Heroes Our Government Turns to When There's Nowhere Else to Turn
Hazzard, Kevin
Hardcover
Basic Butchering of Livestock & Game: Beef, Veal, Pork, Lamb, Poultry, Rabbit, Venison
Mettler, John J.
Paperback
Empire of Ink: The Printers, Rogues, and Radicals Who Invented the American Newspaper
Wright, Alex
Hardcover
The Problem with Plastic: How We Can Save Ourselves and Our Planet Before It's Too Late
Mahoney, Adam
Beyond Plastics
Enck, Judith
Hardcover
The Elements of Power: A Story of War, Technology, and the Dirtiest Supply Chain on Earth
Niarchos, Nicolas
Hardcover
Midnight in Chernobyl: The Untold Story of the World's Greatest Nuclear Disaster
Higginbotham, Adam
Paperback
The Agi Chronicles: The Inside Story of the Race to Create an Artificial Superintelligence
Roose, Kevin
Hardcover
The Home Blacksmith: Tools, Techniques, and 40 Practical Projects for the Home Blacksmith
Ridgway, Ryan
Paperback
City on the Edge: Technology, Politics, and the Fight for the Soul of San Francisco
Weber, Jonathan
Hardcover
AI Snake Oil: What Artificial Intelligence Can Do, What It Can't, and How to Tell the Difference
Kapoor, Sayash
Narayanan, Arvind
Paperback
Generation Regeneration: Codesigning the Future of Cities Through Regenerative Placemaking
Cho, Tony
Hardcover
Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence
Crawford, Kate
Paperback
The New Age of Sexism: How AI and Emerging Technologies Are Reinventing Misogyny
Bates, Laura
Hardcover
The Baofeng Radio Revolution: The Beginner Guerrilla's Guide to Break Through the Complexity, Secure Communications, and Prepare for Disaster With Pre
Code Publishing, Morse
Hardcover
Inconspicuous Consumption: The Environmental Impact You Don't Know You Have
Schlossberg, Tatiana
Paperback
Meat: How the Next Agricultural Revolution Will Transform Humanity's Favorite Food--And Our Future
Friedrich, Bruce
Hardcover
The Trillion Dollar War Machine: How Runaway Military Spending Drives America Into Foreign Wars and Bankrupts Us at Home
Hartung, William D.
Freeman, Ben
Hardcover
Crisis Engineering: Time-Tested Tools for Turning Chaos Into Clarity
Weaver, Matthew
Dickerson, Mikey
Nitze, Marina
Paperback
Human + Machine, Updated and Expanded: Reimagining Work in the Age of AI
Daugherty, Paul R.
Wilson, H. James
Hardcover
Artificial Intelligence: A Guide for Thinking Humans (with a New Preface)
Mitchell, Melanie
Paperback
The Boy Who Harnessed the Wind: Creating Currents of Electricity and Hope
Kamkwamba, William
Mealer, Bryan
Paperback
You Don't Need a Smartphone: A Practical Guide to Downgrading Your Phone and Upgrading Your Life
Lamm, August
Paperback
Bringing Columbia Home: The Untold Story of a Lost Space Shuttle and Her Crew
Ward, Jonathan H.
Leinbach, Michael D.
Paperback
Broken Money: Why Our Financial System is Failing Us and How We Can Make it Better
Alden, Lyn
Paperback
CNC Woodworking for the Absolute Beginner: Winning Tips, Techniques & 5 Skill-Building Projects
Bagnall, Ralph
Paperback
Curved Air: A Biography of Sickle Cell Anemia and the Quest to Cure the First Molecular Disease
Davies, Kevin
Hardcover
Pilot's Handbook of Aeronautical Knowledge: Faa-H-8083-25c
Federal Aviation Administration (FAA)
Hardcover
CompTIA Tech+ Certification All-in-One Exam Guide, Third Edition (Exam FC0-U71)
Wempen, Faithe
Paperback
AI Projects with Raspberry Pi: High-Performance Artificial Intelligence for Robotics, Security, Home Automation, and Vision
Hattersley, Lucy
Jepson, Brian
Paperback
The Ultimate Guide to Rebuilding a Civilization: A Technical Manual for the Post-Collapse Era
Evans, James
Paperback
Disneyland and the Rise of Automation: How Technology Created the Happiest Place on Earth
Betancourt, Roland
Hardcover
Tubes: A Journey to the Center of the Internet with a New Introduction by the Author
Blum, Andrew
Paperback
Make: Electronics: Learning by Discovery: A Hands-On Primer for the New Electronics Enthusiast
Platt, Charles
Paperback
The Powerful Primate: How Controlling Energy Enabled Us to Build Civilization
Ennos, Roland
Hardcover
AI Snake Oil: What Artificial Intelligence Can Do, What It Can't, and How to Tell the Difference
Narayanan, Arvind
Kapoor, Sayash
Hardcover
Cadillac Desert: The American West and Its Disappearing Water, Revised Edition
Reisner, Marc
Paperback
Agentic Artificial Intelligence: Harnessing AI Agents to Reinvent Business, Work, and Life
Davenport, Thomas H.
Bornet
Wirtz, Jochen
Paperback
Drawing Lessons with Da Vinci: An Artist's Guide to Geometry, Anatomy and Proportion
Roig, Gabriel Martín
Paperback
The Fourth Intelligence Revolution: The Future of Espionage and the Battle to Save America
Vinci, Anthony
Hardcover
Texas DMV Driver's Handbook: Practice for the Texas Permit Test with 350+ Driving Questions and Answers
Prep, Discover
Paperback
The Mercury 13: The True Story of Thirteen Women and the Dream of Space Flight
Ackmann, Martha
Paperback
Agentic Artificial Intelligence: Harnessing AI Agents to Reinvent Business, Work, and Life
Wirtz, Jochen
Davenport, Thomas H.
Bornet, Pascal
Hardcover
The Ultimate Guide to Skinning and Tanning: A Complete Guide to Working with Pelts, Fur, and Leather
Burch, Monte
Paperback
The Unaccountability Machine: Why Big Systems Make Terrible Decisions--And How the World Lost Its Mind
Davies, Dan
Paperback
Inconspicuous Consumption: The Environmental Impact You Don't Know You Have
Schlossberg, Tatiana
Hardcover
Bioinspired: How Nature Made Us Modern, Drives Today's Technological Innovation, and Inspires a Future Worth Inventing
Stier, Samuel Cord
Hardcover
Trapped Under the Sea: One Engineering Marvel, Five Men, and a Disaster Ten Miles Into the Darkness
Swidey, Neil
Paperback
The Coming Wave: Technology, Power, and the Twenty-First Century's Greatest Dilemma
Suleyman, Mustafa
Hardcover
Engineering in Plain Sight: An Illustrated Field Guide to the Constructed Environment
Hillhouse, Grady
Hardcover
What Is Intelligence?: Lessons from AI about Evolution, Computing, and Minds
Aguera Y. Arcas, Blaise
Paperback
Feed the People!: Why Industrial Food Is Good and How to Make It Even Better
Rosenberg, Gabriel N.
Dutkiewicz, Jan
Hardcover
Longitude: The True Story of a Lone Genius Who Solved the Greatest Scientific Problem of His Time
Sobel, Dava
Paperback
Designing for People: An Introduction to Human Factors Engineering
Liu, Yili
Boyle, Linda Ng
Wickens, Christopher D.
Paperback