Sciweavers

135 search results - page 2 / 27
» Dynamic Workflow Composition using Markov Decision Processes
Sort
View
AI
2008
Springer
13 years 4 months ago
Reachability analysis of uncertain systems using bounded-parameter Markov decision processes
Verification of reachability properties for probabilistic systems is usually based on variants of Markov processes. Current methods assume an exact model of the dynamic behavior a...
Di Wu, Xenofon D. Koutsoukos
FGR
2006
IEEE
121views Biometrics» more  FGR 2006»
13 years 10 months ago
Learning to Identify Facial Expression During Detection Using Markov Decision Process
While there has been a great deal of research in face detection and recognition, there has been very limited work on identifying the expression on a face. Many current face detect...
Ramana Isukapalli, Ahmed M. Elgammal, Russell Grei...
PAMI
2007
186views more  PAMI 2007»
13 years 4 months ago
Value-Directed Human Behavior Analysis from Video Using Partially Observable Markov Decision Processes
—This paper presents a method for learning decision theoretic models of human behaviors from video data. Our system learns relationships between the movements of a person, the co...
Jesse Hoey, James J. Little
CDC
2008
IEEE
140views Control Systems» more  CDC 2008»
13 years 11 months ago
Information state for Markov decision processes with network delays
We consider a networked control system, where each subsystem evolves as a Markov decision process (MDP). Each subsystem is coupled to its neighbors via communication links over wh...
Sachin Adlakha, Sanjay Lall, Andrea J. Goldsmith
TACAS
2007
Springer
165views Algorithms» more  TACAS 2007»
13 years 11 months ago
Multi-objective Model Checking of Markov Decision Processes
We study and provide efficient algorithms for multi-objective model checking problems for Markov Decision Processes (MDPs). Given an MDP, M, and given multiple linear-time (ω-regu...
Kousha Etessami, Marta Z. Kwiatkowska, Moshe Y. Va...