Sign-In
Cart
Stochastic Control Theory: Dynamic Programming Principle
Hardcover
Series: Probability Theory and Stochastic Modelling, Book 72
General MathematicsGeneral ScienceProbability & Statistics
ISBN13: 9784431551225
Publisher: Springer Nature
Published: Dec 9 2014
Pages: 250
Weight: 1.22
Height: 0.63 Width: 6.14 Depth: 9.21
Language: English
This book offers a systematic introduction to the optimal stochastic control theory via the dynamic programming principle, which is a powerful tool to analyze control problems.
First we consider completely observable control problems with finite horizons. Using a time discretization we construct a nonlinear semigroup related to the dynamic programming principle (DPP), whose generator provides the Hamilton-Jacobi-Bellman (HJB) equation, and we characterize the value function via the nonlinear semigroup, besides the viscosity solution theory. When we control not only the dynamics of a system but also the terminal time of its evolution, control-stopping problems arise. This problem is treated in the same frameworks, via the nonlinear semigroup. Its results are applicable to the American option price problem.
Zero-sum two-player time-homogeneous stochastic differential games and viscosity solutions of the Isaacs equations arising from such games are studied via a nonlinear semigroup related to DPP (the min-max principle, to be precise). Using semi-discretization arguments, we construct the nonlinear semigroups whose generators provide lower and upper Isaacs equations.
Concerning partially observable control problems, we refer to stochastic parabolic equations driven by colored Wiener noises, in particular, the Zakai equation. The existence and uniqueness of solutions and regularities as well as Itô's formula are stated. A control problem for the Zakai equations has a nonlinear semigroup whose generator provides the HJB equation on a Banach space. The value function turns out to be a unique viscosity solution for the HJB equation under mild conditions.
This edition provides a more generalized treatment of the topic than does the earlier book Lectures on Stochastic Control Theory (ISI Lecture Notes 9), where time-homogeneous cases are dealt with. Here, for finite time-horizon control problems, DPP was formulated as a one-parameter nonlinear semigroup, whose generator provides the HJB equation, by using a time-discretization method. The semigroup corresponds to the value function and is characterized as the envelope of Markovian transition semigroups of responses for constant control processes. Besides finite time-horizon controls, the book discusses control-stopping problems in the same frameworks.
1 different editions
Also available
Also in
Probability & Statistics
R for Data Science: Import, Tidy, Transform, Visualize, and Model Data
Wickham, Hadley
Grolemund, Garrett
Paperback
AP Statistics Premium, 2027: 9 Practice Tests + Comprehensive Review + Online Practice
Sternstein, Martin, PH. D.
Paperback
R for Data Science: Import, Tidy, Transform, Visualize, and Model Data
Wickham, Hadley
Grolemund, Garrett
Cetinkaya-Rundel, Mine
Paperback
Graph Paper Composition Notebook: Quad Ruled 5x5, Grid Paper for Students in Math and Science
Wizo, Math
Paperback
Stat 208 Statistical Thinking: A Book for Stat 208 at Virginia Commonwealth University
Street IV, W. Scott
Durfee, Becky
Paperback
Forecasting: Principles and Practice, the Pythonic Way
Hyndman, Rob J.
Athanasopoulos, George
Paperback
The Art of Uncertainty: How to Navigate Chance, Ignorance, Risk and Luck
Spiegelhalter, David
Paperback
Introduction to Statistics: An Intuitive Guide for Analyzing Data and Unlocking Discoveries
Frost, Jim
Paperback
The Art of Uncertainty: How to Navigate Chance, Ignorance, Risk and Luck
Spiegelhalter, David
Hardcover
Mastering Claude AI: Practical Journey from First Prompts to Pro with Claude AI
Dickey, Ryan
Paperback
How the World Really Works: The Science Behind How We Got Here and Where We're Going
Smil, Vaclav
Paperback
The Random Universe: How Models and Probability Help Us Make Sense of the Cosmos
Jaffe, Andrew H.
Hardcover
Scale: The Universal Laws of Life, Growth, and Death in Organisms, Cities, and Companies
West, Geoffrey
Paperback
Ai-Assisted Statistics for Data Scientists: 50+ Essential Concepts Using R and Python
Gedeck, Peter
Bruce, Peter
Bruce, Andrew
Paperback
An Introduction to Statistical Learning: With Applications in R
James, Gareth
Witten, Daniela
Hastie, Trevor
Paperback
Advanced Statistics in Research: Reading, Understanding, and Writing Up Data Analysis Results
Hatcher, Larry
Paperback
Schaum's Outline of Probability and Statistics, 4th Edition: 897 Solved Problems + 20 Videos
Srinivasan, R. Alu
Spiegel, Murray R.
Schiller, John J.
Paperback
Mathematical Foundations of Quantum Computing: A Scaffolding Approach
Cheng, Ran
Lee, Peter
Yu, James
Hardcover
The Only Math Book You'll Ever Need, Revised Edition: Hundreds of Easy Solutions and Shortcuts for Mastering Everyday Numbers
Kogelman, Stanley
Heller, Barbara R.
Paperback
SQL Server 2025 Unveiled: The Ai-Ready Enterprise Database with Microsoft Fabric Integration
Ward, Bob
Paperback
Mathletics: How Gamblers, Managers, and Fans Use Mathematics in Sports, Second Edition
Winston, Wayne L.
Nestler, Scott
Pelechrinis, Konstantinos
Paperback
Building Large Language Models from Scratch: Design, Train, and Deploy Llms with Pytorch
Grigorov, Dilyan
Paperback
How the World Really Works: The Science Behind How We Got Here and Where We're Going
Smil, Vaclav
Hardcover
Regression Modeling Strategies: With Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis
Harrell Jr, Frank E.
Paperback
Schaum's Outline of Probability, Random Variables, and Random Processes, Fourth Edition
Hsu, Hwei P.
Paperback
Challenging Mathematical Problems with Elementary Solutions, Vol. I: Volume 1
Yaglom, A. M.
Yaglom, I. M.
Paperback
Quantum Computing and Quantum Machine Learning for Engineers and Developers
Rosas-Bustos, Jose
Fraser, Roydon Andrew
Van Griensven Thé, Jesse
Hardcover
Probably Overthinking It: How to Use Data to Answer Questions, Avoid Statistical Traps, and Make Better Decisions
Downey, Allen B.
Paperback
Making ChatGPT Work for You: Getting the Most Out of Generative AI as a Non-Techie
Evelyn, Lydia
Paperback
Probably the Best Book on Statistics Ever Written: How to Beat the Odds and Make Better Decisions
Shapira, Haim
Hardcover
Databricks Data Intelligence Platform: Unlocking the Genai Revolution
Yip, Jason
Gupta, Nikhil
Paperback
The End of Average: Unlocking Our Potential by Embracing What Makes Us Different
Rose, Todd
Paperback
The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World
Domingos, Pedro
Paperback
Probably Overthinking It: How to Use Data to Answer Questions, Avoid Statistical Traps, and Make Better Decisions
Downey, Allen B.
Hardcover
Scorecasting: The Hidden Influences Behind How Sports Are Played and Games Are Won
Wertheim, L. Jon
Moskowitz, Tobias
Paperback
AI for Robotics: Toward Embodied and General Intelligence in the Physical World
Imran, Alishba
Gopalakrishnan, Keerthana
Paperback
Time Series Analysis and Its Applications: With R Examples
Stoffer, David S.
Shumway, Robert H.
Hardcover
Large Language Models: A Deep Dive: Bridging Theory and Practice
Somers, Garrett
Kamath, Uday
Keenan, Kevin
Hardcover
Learning Statistics with Jamovi: A Tutorial for Beginners in Statistical Analysis
Navarro, Danielle
Foxcroft, David
Paperback
Guide to Methods for Students of Political Science: Property, Proof, and Dispute in Catalonia Around the Year 1000
Van Evera, Stephen
Paperback
An Introduction to Statistical Learning: With Applications in Python
James, Gareth
Witten, Daniela
Hastie, Trevor
Hardcover
Challenging Mathematical Problems with Elementary Solutions, Vol. II: Volume 2
Yaglom, A. M.
Yaglom, I. M.
Paperback
Building Generative AI Agents: Using Langgraph, Autogen, and Crewai
Deshmukh, Gaurav
Taulli, Tom
Paperback
The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of C
McGrayne, Sharon Bertsch
Paperback
Observability for Large Language Models: Site Reliability and Chaos Engineering for AI at Scale
Sharma, Ankush
Paperback
Machine Learning Q and AI: 30 Essential Questions and Answers on Machine Learning and AI
Raschka, Sebastian
Paperback
Modern Time Series Forecasting with Python - Second Edition: Industry-ready machine learning and deep learning time series analysis with PyTorch and p
Tackes, Jeffrey
Joseph, Manu
Paperback
High-Dimensional Probability: An Introduction with Applications in Data Science
Vershynin, Roman
Hardcover
Deep Learning in Computational Mechanics: An Introductory Course
Weeger, Oliver
Jokeit, Moritz
Herrmann, Leon
Hardcover
The ESRI Guide to GIS Analysis, Volume 2: Spatial Measurements and Statistics
Griffin, Lauren Scott
Mitchell, Andy
Paperback
Mathematical Foundations of Quantum Computing: A Scaffolding Approach
Cheng, Ran
Lee, Peter
Yu, James
Paperback
Guesstimation: Solving the World's Problems on the Back of a Cocktail Napkin
Adam, John a.
Weinstein, Lawrence
Paperback
The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition
Hastie, Trevor
Tibshirani, Robert
Friedman, Jerome
Hardcover
Unlocking Dbt: Design and Deploy Transformations in Your Cloud Data Warehouse
Dorsey, Dustin
Cyr, Cameron
Paperback
ACCUPLACER Math Prep: ACCUPLACER Math Test Study Guide with Two Practice Tests [Includes Detailed Answer Explanations]
Tpb Publishing
Paperback
System Design with AI Interview Guide: Designing Scalable, Agentic, and Defensible Systems
Bhardwaj, Rohit
Paperback
Damned Lies and Statistics: Untangling Numbers from the Media, Politicians, and Activists
Best, Joel
Hardcover
The Design Inference: Eliminating Chance through Small Probabilities
Ewert, Winston
Dembski, William A.
Hardcover
An Introduction to Statistical Learning: With Applications in Python
James, Gareth
Witten, Daniela
Hastie, Trevor
Paperback
Large Language Model Recipes: A Hands-On Guide to Fine-Tuning, Optimization, Deployment, and Real-World Applications
Subbaiah, Kalpa
Kaata, Sashi Kiran
Bolla, Bharath Kumar
Paperback
Bayesian Analysis with Python - Third Edition: A practical guide to probabilistic modeling
Martin, Osvaldo
Paperback
Prompt Engineering for Everyone: A Self-Taught, Human-Centered Approach to AI Programming
Tavakoli, Hamid
Paperback
Introduction to Statistics: An Intuitive Guide for Analyzing Data and Unlocking Discoveries
Frost, Jim
Hardcover
Enterprise Guide for Implementing Generative AI and Agentic AI: A Practical Guide to Developing, Deploying, and Operationalizing Ai-Driven Application
Sinha, Vikas
Edward, Shakuntala Gupta
Bhattacharya, Rahul
Paperback
Student's Solutions Guide for Introduction to Probability, Statistics, and Random Processes
Pishro-Nik, Hossein
Paperback
Large Language Models: From Theory to Production
Pacheco Aznar, David
Vanegas, Esteban
Noguer I. Alonso, Miquel
Paperback
From Data to Dollars: Getting Started with Data Analytics and AI in Startups
Sidoruk, Piotr
Paperback
A Modern Introduction to Probability and Statistics: Understanding Why and How
Lopuhaä, H. P.
Dekking, F. M.
Kraaikamp, C.
Hardcover
The Improbability Principle: Why Coincidences, Miracles, and Rare Events Happen Every Day
Hand, David J.
Paperback
Android and IOS Mobile Forensics: Leveraging Blockchain, Machine Learning, and Deep Learning for Digital Investigations
Parekha, Chandresh
Kaushik, Keshav
Sheth, Ravi
Paperback
Practical Generative Ai: From Concept to Deployment: Building and Deploying Ethical AI-Powered Solutions
McKeone, James
Singh, Pramod
Paperback