Search Results - "Markov processes"

Asymptotic Nash Equilibria of Finite-State Ergodic Markovian Mean Field Games.

Authors: Cohen, Asaf Zell, Ethan

Source: Mathematics of Operations Research (INFORMS). May2026, Vol. 51 Issue 2, p1139-1173. 35p.

A New Finite Approximation Method for Evaluating Steady-State Performance of a Continuous-State Markov Chain with an Application to Queues with Customer Abandonment.

Authors: Li, Shukai Mehrotra, Sanjay

Source: Mathematics of Operations Research (INFORMS). May2026, Vol. 51 Issue 2, p1626-1658. 33p.

Online Regret Bounds for Satisficing in Markov Decision Processes.

Authors: Hajiabolhassan, Hossein Ortner, Ronald

Source: Mathematics of Operations Research (INFORMS). May2026, Vol. 51 Issue 2, p1097-1119. 23p.

On the Convergence of Modified Policy Iteration in Risk-Sensitive Exponential Cost Markov Decision Processes.

Authors: Murthy, Yashaswini Moharrami, Mehrdad Srikant, Rayadurgam

Source: Operations Research. May/Jun2026, Vol. 74 Issue 3, p1425-1436. 12p.

Linear Mean-Field Games with Discounted Cost.

Authors: Saldi, Naci¹ (AUTHOR) naci.saldi@bilkent.edu.tr

Source: Mathematics of Operations Research (INFORMS). Feb2026, Vol. 51 Issue 1, p358-397. 40p.

Square-Root Regret Bounds for Continuous-Time Episodic Markov Decision Processes.

Authors: Gao, Xuefeng Zhou, Xunyu

Source: Mathematics of Operations Research (INFORMS). Feb2026, Vol. 51 Issue 1, p333-357. 25p.

Exponential Concentration in Stochastic Approximation.

Authors: Law, Kody J. H. Walton, Neil Yang, Shangda

Source: Operations Research. Jan/Feb2026, Vol. 74 Issue 1, p446-463. 18p.

Digging Deep: Finding and Maximizing the Throughput Capacity of Multideep Storage Systems.

Authors: Lehmann, Timo de Koster, René

Source: Transportation Science (INFORMS). Mar/Apr2026, Vol. 60 Issue 2, p343-365. 23p.

On Average Optimality for Non-Stationary Markov Decision Processes in Borel Spaces.

Authors: Guo, Xin Huang, Yonghui Zhang, Yi

Source: Mathematics of Operations Research (INFORMS). Nov2025, Vol. 50 Issue 4, p2552-2576. 25p.

Relaxed Equilibria for Time-Inconsistent Markov Decision Processes.

Authors: Bayraktar, Erhan Huang, Yu-Jui Wang, Zhenhua et al.

Source: Mathematics of Operations Research (INFORMS). Nov2025, Vol. 50 Issue 4, p2666-2687. 22p.

Stochastic First-Order Methods for Average-Reward Markov Decision Processes.

Authors: Li, Tianjiao Wu, Feiyang Lan, Guanghui

Source: Mathematics of Operations Research (INFORMS). Nov2025, Vol. 50 Issue 4, p3125-3160. 36p.

Risk-Averse Markov Decision Processes Through a Distributional Lens.

Authors: Cheng, Ziteng Jaimungal, Sebastian

Source: Mathematics of Operations Research (INFORMS). Aug2025, Vol. 50 Issue 3, p1707-1733. 27p.

On the Convex Formulations of Robust Markov Decision Processes.

Authors: Grand-Clément, Julien Petrik, Marek

Source: Mathematics of Operations Research (INFORMS). Aug2025, Vol. 50 Issue 3, p1681-1706. 26p.

Optimal Abort Policy for Mission-Critical Systems Under Imperfect Condition Monitoring.

Authors: Sun, Qiuzhuang Hu, Jiawen Ye, Zhi-Sheng

Source: Operations Research. Sep/Oct2025, Vol. 73 Issue 5, p2396-2416. 21p.

Off-line Estimation of Controlled Markov Chains: Minimaxity and Sample Complexity.

Authors: Banerjee, Imon Honnappa, Harsha Rao, Vinayak

Source: Operations Research. Jul/Aug2025, Vol. 73 Issue 4, p2281-2295. 15p.

Optimal Control of Service Systems with Heterogeneous Servers and Priority Customers.

Authors: Chen, David Chen, Ruoran Wang, Rowan et al.

Source: Management Science (INFORMS). Aug2025, Vol. 71 Issue 8, p6559-6579. 21p.

Club convergence and spatial spillovers in tourism high-quality development: a spatial Markov approach.

Authors: Shan, Zheng Li, Zhengze Wu, Zhixiang et al.

Source: Applied Economics Letters. Apr2026, p1-4. 4p. 1 Illustration.

Maintenance optimization for a multi-stage system characterized by multiple mechanisms.

Authors: Fang, Chen Wang, Jie

Source: Quality Technology & Quantitative Management. Apr2026, p1-19. 19p. 10 Illustrations.

The local limit of rooted directed animals on the square lattice.

Authors: Hénard, Olivier Maurel-Segala, Édouard Singh, Arvind

Source: Probability Theory & Related Fields. Apr2026, Vol. 194 Issue 3/4, p1537-1600. 64p.

An adaptive model-based deep reinforcement learning approach for matching-while-learning problem in shared manufacturing platforms.

Authors: Yang, Liu Qu, Yuan Yan, Pengyu et al.

Source: International Journal of Production Research. May2026, Vol. 64 Issue 9, p3495-3517. 23p.