Stochastic control problems of linear systems in high dimensions are solved by modeling a structured Markov Decision Process (MDP). A state space for the MDP is a polyhedron in a Euclidean space and one or more actions that are feasible in a state of the state space are linearly constrained with respect to the state. One or more approximations are built from above and from below to a value function for the state using representations that facilitate the computation of approximately optimal actions at any given state by linear programming.

 
Web www.patentalert.com

< CNC control unit with learning ability for machining centers

< Method and apparatus for digital signal filtering

> System and method for maintaining target response times in business methods

> Method, system, and apparatus for casual discovery and variable selection for classification

~ 00291