Levels and Goals

Things that cause a change of state of the environment/world, whether that be performed by the player, NPC, or other.

A common way to structure action/Reaction time frames among players.

Can be any length of time. E.g., Pokemon has long decision times for turns, and a fair number of turns, while Tekken can be very interchanged in turns.

Episodic: experience divided into atomic episodes (perceiving and acting)
-next episode does not depend on previous episodes, no learning from previous decisions required.

Sequential: experience is in a linear path
-previous actions can effect future decisions and outcomes

For a given current state and an input symbol, the automaton can only jump to one and only one state.

Linear.

An automaton that, after reading an input symbol, may jump into any one of a number of state, as licensed by its transition relation.

Branching paths.

A simulation that incorporates elements of randomness and unpredictability.

A sequence of states connected by turns and the probability that turn happens, in which the probability is not affected by any previous action.

Stored as a transition matrix (T) that can be graphically represented as a weighted directed graph.

Determines the mean number of turns required to reach one of the goals for the first time from a given state.

The probability of reaching a certain game configuration in n steps.

A logical formula of a particular rule-like form, used in logic programming.

Used in procedural generation to determine whether a given world state is beatable.

Uses horn clauses on a tree of nodes to determine whether it is a valid or optimal state.

Each state represents a resource/subgoal to be obtained/solved.

Can be done forwards or backwards, working from the start state to the final one or vice-versa.