Interface Documentation

This page describes the finite horizon interface. In order to fully define one the user has to also use methods from POMDPs.jl interface defined here.

Docstrings for FiniteHorizonPOMDPs.jl interface members can be accessed through Julia's built-in documentation system or in the list below.

Contents

Index

Types

FiniteHorizonPOMDPs.HorizonLengthType
HorizonLength(::Type{<:Union{MDP,POMDP})
HorizonLength(::Union{MDP,POMDP})

Check whether MDP is Finite or Infinite Horizon and return corresponding struct (FiniteHorizon or InfiniteHorizon).

Model Functions

FiniteHorizonPOMDPs.horizonFunction

Return the number of steps that will be taken in the (PO)MDP, given it is Finite Horizon.

A simulation of a (PO)MDP with horizon(m) == d should contain d+1 states and d actions and rewards.

FiniteHorizonPOMDPs.fixhorizonFunction
fixhorizon(m::Union{MDP,POMDP}, horizon::Int)

Wrap infinite horizon (PO)MDP m and horizon to the new structure creating Finite Horizon (PO)MDP.

FiniteHorizonPOMDPs.stageFunction
stage(m::Union{MDP,POMDP}, ss)::Int
stage(m::Union{MDP,POMDP}, o)::Int
stage(d)::Int

Considering a variable or distribution containing its stage assignment, return the number of its stage.