Sign-In
Cart
Markov Chains: Models, Algorithms and Applications
Hardcover
Series: International Operations Research & Management Science, Book 189
Business GeneralManagementProbability & Statistics
ISBN13: 9781461463115
Publisher: Springer
Published: Mar 28 2013
Pages: 243
Weight: 1.19
Height: 0.63 Width: 6.14 Depth: 9.21
Language: English
This new edition of Markov Chains: Models, Algorithms and Applications has been completely reformatted as a text, complete with end-of-chapter exercises, a new focus on management science, new applications of the models, and new examples with applications in financial risk management and modeling of financial data.
This book consists of eight chapters. Chapter 1 gives a brief introduction to the classical theory on both discrete and continuous time Markov chains. The relationship between Markov chains of finite states and matrix theory will also be highlighted. Some classical iterative methods for solving linear systems will be introduced for finding the stationary distribution of a Markov chain. The chapter then covers the basic theories and algorithms for hidden Markov models (HMMs) and Markov decision processes (MDPs).
Chapter 2 discusses the applications of continuous time Markov chains to model queueing systems and discrete time Markov chain for computing the PageRank, the ranking of websites on the Internet. Chapter 3 studies Markovian models for manufacturing and re-manufacturing systems and presents closed form solutions and fast numerical algorithms for solving the captured systems. In Chapter 4, the authors present a simple hidden Markov model (HMM) with fast numerical algorithms for estimating the model parameters. An application of the HMM for customer classification is also presented.
Chapter 5 discusses Markov decision processes for customer lifetime values. Customer Lifetime Values (CLV) is an important concept and quantity in marketing management. The authors present an approach based on Markov decision processes for the calculation of CLV using real data.
Chapter 6 considers higher-order Markov chain models, particularly a class of parsimonious higher-order Markov chain models. Efficient estimation methods for model parameters based on linear programming are presented. Contemporary research results on applications to demand predictions, inventory control and financial risk measurement are also presented. In Chapter 7, a class of parsimonious multivariate Markov models is introduced. Again, efficient estimation methods based on linear programming are presented. Applications to demand predictions, inventory control policy and modeling credit ratings data are discussed. Finally, Chapter 8 re-visits hidden Markov models, and the authors present a new class of hidden Markov models with efficient algorithms for estimating the model parameters. Applications to modeling interest rates, credit ratings and default data are discussed.
This book is aimed at senior undergraduate students, postgraduate students, professionals, practitioners, and researchers in applied mathematics, computational science, operational research, management science and finance, who are interested in the formulation and computation of queueing networks, Markov chain models and related topics. Readers are expected to have some basic knowledge of probability theory, Markov processes and matrix theory.Also in
Probability & Statistics
R for Data Science: Import, Tidy, Transform, Visualize, and Model Data
Grolemund, Garrett
Wickham, Hadley
Paperback
AP Statistics Premium, 2027: 9 Practice Tests + Comprehensive Review + Online Practice
Sternstein, Martin, PH. D.
Paperback
R for Data Science: Import, Tidy, Transform, Visualize, and Model Data
Wickham, Hadley
Grolemund, Garrett
Cetinkaya-Rundel, Mine
Paperback
Graph Paper Composition Notebook: Quad Ruled 5x5, Grid Paper for Students in Math and Science
Wizo, Math
Paperback
Stat 208 Statistical Thinking: A Book for Stat 208 at Virginia Commonwealth University
Durfee, Becky
Street IV, W. Scott
Paperback
Forecasting: Principles and Practice, the Pythonic Way
Athanasopoulos, George
Hyndman, Rob J.
Paperback
The Art of Uncertainty: How to Navigate Chance, Ignorance, Risk and Luck
Spiegelhalter, David
Paperback
Introduction to Statistics: An Intuitive Guide for Analyzing Data and Unlocking Discoveries
Frost, Jim
Paperback
Mastering Claude AI: Practical Journey from First Prompts to Pro with Claude AI
Dickey, Ryan
Paperback
How the World Really Works: The Science Behind How We Got Here and Where We're Going
Smil, Vaclav
Paperback
The Art of Uncertainty: How to Navigate Chance, Ignorance, Risk and Luck
Spiegelhalter, David
Hardcover
Ai-Assisted Statistics for Data Scientists: 50+ Essential Concepts Using R and Python
Bruce, Andrew
Gedeck, Peter
Bruce, Peter
Paperback
Scale: The Universal Laws of Life, Growth, and Death in Organisms, Cities, and Companies
West, Geoffrey
Paperback
An Introduction to Statistical Learning: With Applications in R
Hastie, Trevor
James, Gareth
Witten, Daniela
Paperback
The Random Universe: How Models and Probability Help Us Make Sense of the Cosmos
Jaffe, Andrew H.
Hardcover
Schaum's Outline of Probability and Statistics, 4th Edition: 897 Solved Problems + 20 Videos
Srinivasan, R. Alu
Spiegel, Murray R.
Schiller, John J.
Paperback
Advanced Statistics in Research: Reading, Understanding, and Writing Up Data Analysis Results
Hatcher, Larry
Paperback
The Only Math Book You'll Ever Need, Revised Edition: Hundreds of Easy Solutions and Shortcuts for Mastering Everyday Numbers
Heller, Barbara R.
Kogelman, Stanley
Paperback
Mathematical Foundations of Quantum Computing: A Scaffolding Approach
Yu, James
Cheng, Ran
Lee, Peter
Hardcover
Schaum's Outline of Probability, Random Variables, and Random Processes, Fourth Edition
Hsu, Hwei P.
Paperback
Mathletics: How Gamblers, Managers, and Fans Use Mathematics in Sports, Second Edition
Winston, Wayne L.
Nestler, Scott
Pelechrinis, Konstantinos
Paperback
SQL Server 2025 Unveiled: The Ai-Ready Enterprise Database with Microsoft Fabric Integration
Ward, Bob
Paperback
Building Large Language Models from Scratch: Design, Train, and Deploy Llms with Pytorch
Grigorov, Dilyan
Paperback
How the World Really Works: The Science Behind How We Got Here and Where We're Going
Smil, Vaclav
Hardcover
Regression Modeling Strategies: With Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis
Harrell Jr, Frank E.
Paperback
Challenging Mathematical Problems with Elementary Solutions, Vol. I: Volume 1
Yaglom, I. M.
Yaglom, A. M.
Paperback
Quantum Computing and Quantum Machine Learning for Engineers and Developers
Van Griensven Thé, Jesse
Rosas-Bustos, Jose
Fraser, Roydon Andrew
Hardcover
Databricks Data Intelligence Platform: Unlocking the Genai Revolution
Gupta, Nikhil
Yip, Jason
Paperback
Making ChatGPT Work for You: Getting the Most Out of Generative AI as a Non-Techie
Evelyn, Lydia
Paperback
The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World
Domingos, Pedro
Paperback
Probably Overthinking It: How to Use Data to Answer Questions, Avoid Statistical Traps, and Make Better Decisions
Downey, Allen B.
Paperback
Probably the Best Book on Statistics Ever Written: How to Beat the Odds and Make Better Decisions
Shapira, Haim
Hardcover
The End of Average: Unlocking Our Potential by Embracing What Makes Us Different
Rose, Todd
Paperback
Large Language Models: A Deep Dive: Bridging Theory and Practice
Keenan, Kevin
Somers, Garrett
Kamath, Uday
Hardcover
Scorecasting: The Hidden Influences Behind How Sports Are Played and Games Are Won
Wertheim, L. Jon
Moskowitz, Tobias
Paperback
Learning Statistics with Jamovi: A Tutorial for Beginners in Statistical Analysis
Navarro, Danielle
Foxcroft, David
Paperback
Guide to Methods for Students of Political Science: Property, Proof, and Dispute in Catalonia Around the Year 1000
Van Evera, Stephen
Paperback
Probably Overthinking It: How to Use Data to Answer Questions, Avoid Statistical Traps, and Make Better Decisions
Downey, Allen B.
Hardcover
Time Series Analysis and Its Applications: With R Examples
Shumway, Robert H.
Stoffer, David S.
Hardcover
An Introduction to Statistical Learning: With Applications in Python
James, Gareth
Witten, Daniela
Hastie, Trevor
Hardcover
AI for Robotics: Toward Embodied and General Intelligence in the Physical World
Gopalakrishnan, Keerthana
Imran, Alishba
Paperback
Machine Learning Q and AI: 30 Essential Questions and Answers on Machine Learning and AI
Raschka, Sebastian
Paperback
A Modern Introduction to Probability and Statistics: Understanding Why and How
Kraaikamp, C.
Lopuhaä, H. P.
Dekking, F. M.
Hardcover
Challenging Mathematical Problems with Elementary Solutions, Vol. II: Volume 2
Yaglom, I. M.
Yaglom, A. M.
Paperback
Observability for Large Language Models: Site Reliability and Chaos Engineering for AI at Scale
Sharma, Ankush
Paperback
The Theory That Would Not Die: How Bayes' Rule Cracked the Enigma Code, Hunted Down Russian Submarines, and Emerged Triumphant from Two Centuries of C
McGrayne, Sharon Bertsch
Paperback
Modern Time Series Forecasting with Python - Second Edition: Industry-ready machine learning and deep learning time series analysis with PyTorch and p
Joseph, Manu
Tackes, Jeffrey
Paperback
Mathematical Foundations of Quantum Computing: A Scaffolding Approach
Yu, James
Cheng, Ran
Lee, Peter
Paperback
High-Dimensional Probability: An Introduction with Applications in Data Science
Vershynin, Roman
Hardcover
Building Generative AI Agents: Using Langgraph, Autogen, and Crewai
Taulli, Tom
Deshmukh, Gaurav
Paperback
The Design Inference: Eliminating Chance through Small Probabilities
Ewert, Winston
Dembski, William A.
Hardcover
Unlocking Dbt: Design and Deploy Transformations in Your Cloud Data Warehouse
Cyr, Cameron
Dorsey, Dustin
Paperback
The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Second Edition
Hastie, Trevor
Tibshirani, Robert
Friedman, Jerome
Hardcover
Prompt Engineering for Everyone: A Self-Taught, Human-Centered Approach to AI Programming
Tavakoli, Hamid
Paperback
Damned Lies and Statistics: Untangling Numbers from the Media, Politicians, and Activists
Best, Joel
Hardcover
ACCUPLACER Math Prep: ACCUPLACER Math Test Study Guide with Two Practice Tests [Includes Detailed Answer Explanations]
Tpb Publishing
Paperback
Deep Learning in Computational Mechanics: An Introductory Course
Herrmann, Leon
Weeger, Oliver
Jokeit, Moritz
Hardcover
The ESRI Guide to GIS Analysis, Volume 2: Spatial Measurements and Statistics
Mitchell, Andy
Griffin, Lauren Scott
Paperback
System Design with AI Interview Guide: Designing Scalable, Agentic, and Defensible Systems
Bhardwaj, Rohit
Paperback
An Introduction to Statistical Learning: With Applications in Python
James, Gareth
Witten, Daniela
Hastie, Trevor
Paperback
Large Language Model Recipes: A Hands-On Guide to Fine-Tuning, Optimization, Deployment, and Real-World Applications
Kaata, Sashi Kiran
Bolla, Bharath Kumar
Subbaiah, Kalpa
Paperback
Bayesian Analysis with Python - Third Edition: A practical guide to probabilistic modeling
Martin, Osvaldo
Paperback
Databricks Data Intelligence Platform: Powering the Agentic Era
Gupta, Nikhil
Wojtyczka, Marcin
Yip, Jason
Paperback
R in Action, Third Edition: Data Analysis and Graphics with R and Tidyverse
Kabacoff, Robert I.
Paperback
Guesstimation: Solving the World's Problems on the Back of a Cocktail Napkin
Adam, John a.
Weinstein, Lawrence
Paperback
Introduction to Statistics: An Intuitive Guide for Analyzing Data and Unlocking Discoveries
Frost, Jim
Hardcover
From Data to Dollars: Getting Started with Data Analytics and AI in Startups
Sidoruk, Piotr
Paperback
The Practical Guide to Large Language Models: Hands-On AI Applications with Hugging Face Transformers
Gridin, Ivan
Paperback
Large Language Models: From Theory to Production
Vanegas, Esteban
Noguer I. Alonso, Miquel
Pacheco Aznar, David
Paperback
Practical Generative Ai: From Concept to Deployment: Building and Deploying Ethical AI-Powered Solutions
Singh, Pramod
McKeone, James
Paperback
The Improbability Principle: Why Coincidences, Miracles, and Rare Events Happen Every Day
Hand, David J.
Paperback
Making Statistics Work: Information Theory and Bayesian Inference
Scharfenaker, Ellis
Foley, Duncan
Paperback