Sciweavers

829 search results - page 26 / 166
» A time aggregation approach to Markov decision processes
Sort
View
AIPS
2003
15 years 3 months ago
Synthesis of Hierarchical Finite-State Controllers for POMDPs
We develop a hierarchical approach to planning for partially observable Markov decision processes (POMDPs) in which a policy is represented as a hierarchical finite-state control...
Eric A. Hansen, Rong Zhou
ISCC
2000
IEEE
104views Communications» more  ISCC 2000»
15 years 6 months ago
Dynamic Routing and Wavelength Assignment Using First Policy Iteration
With standard assumptions the routing and wavelength assignment problem (RWA) can be viewed as a Markov Decision Process (MDP). The problem, however, defies an exact solution bec...
Esa Hyytiä, Jorma T. Virtamo
AAAI
1994
15 years 3 months ago
Control Strategies for a Stochastic Planner
We present new algorithms for local planning over Markov decision processes. The base-level algorithm possesses several interesting features for control of computation, based on s...
Jonathan Tash, Stuart J. Russell
ICDE
2006
IEEE
141views Database» more  ICDE 2006»
15 years 8 months ago
Dealing with Overload in Distributed Stream Processing Systems
Overload management has been an important problem for large-scale dynamic systems. In this paper, we study this problem in the context of our Borealis distributed stream processin...
Nesime Tatbul, Stanley B. Zdonik
81
Voted
ICPR
2008
IEEE
15 years 8 months ago
A Mixed Markov model for change detection in aerial photos with large time differences
In the paper we propose a novel multi-layer Mixed Markov model for detecting relevant changes in registered aerial images taken with significant time differences. The introduced ...
Csaba Benedek, Tamás Szirányi