A C D E F G I L M N P Q R S T V X Y Z

A

ACTION_SIZE - Variable in class SGameModelController

ACTION_SIZE - Variable in class SGameQController

alpha - Variable in class SarsaController

alphaFixed - Variable in class Q10_Controller

alphaFixed - Variable in class Q_Controller

C

crashReward - Variable in class SGameEnv

currX - Variable in class Q_Env

currX - Variable in class SGameEnv

currX - Variable in class TGameEnv

currY - Variable in class Q_Env

currY - Variable in class SGameEnv

currY - Variable in class TGameEnv

D

DAMAGE_SIZE - Variable in class SGameModelController

DAMAGE_SIZE - Variable in class SGameQController

damaged - Variable in class SGameEnv

discount - Variable in class Q10_Controller

discount - Variable in class Q_Controller

discount - Variable in class SarsaController

doreset(double) - Method in class Q10_Controller

resets the Q-values sets all of the Q-values to initVal, and all of the visit counts to 0

doreset() - Method in class Q10_GUI

doreset(double) - Method in class Q_Controller

resets the Q-values sets all of the Q-values to initVal, and all of the visit counts to 0

doreset() - Method in class Q_Env

resets the steps and the reward.

doreset() - Method in class Q_GUI

doreset(double) - Method in class SarsaController

resets the Q-values sets all of the Q-values to initVal, and the eligibility to 0

doreset() - Method in class SarsaGUI

doreset(double) - Method in class SGameController

resets the parameters this is overridden by learning controllers

doreset() - Method in class SGameEnv

resets the number of steps and the reward.

doreset(double) - Method in class SGameFAController

resets the weights.

doreset() - Method in class SGameGUI

doreset(double) - Method in class SGameModelController

resets the Q-values, and all of the transitions.

doreset(double) - Method in class SGameQController

resets the Q-values.

doreset(double) - Method in class TGameController

resets the Q-values.

doreset() - Method in class TGameEnv

resets the number of steps and the reward.

doreset() - Method in class TGameEnvRand

doreset() - Method in class TGameGUI

doreset(double) - Method in class TGameQController

resets the Q-values.

dostep(int, double, double) - Method in class Q10_Controller

does one step carries out the action, and sets the discount and the alpha value

dostep(int) - Method in class Q10_Controller

does one step carries out the action

dostep(int) - Method in class Q10_GUI

dostep(int, double, double) - Method in class Q_Controller

does one step carries out the action, and sets the discount and the alpha value

dostep(int) - Method in class Q_Controller

does one step carries out the action

dostep(int) - Method in class Q_Env

does one step carries out the action

dostep(int) - Method in class Q_GUI

dostep(int, double, double, double) - Method in class SarsaController

does one step carries out the action, and sets the discount and the alpha value

dostep(int) - Method in class SarsaController

does one step carries out the action

dostep(int) - Method in class SarsaGUI

dostep(int) - Method in class SGameAdvController

does one step.

dostep(int, int) - Method in class SGameAdvEnv

does one step.

dostep(int) - Method in class SGameController

does one step.

dostep(int) - Method in class SGameEnv

does one step.

dostep(int) - Method in class SGameFAController

does one step.

dostep(int) - Method in class SGameGUI

dostep(int) - Method in class SGameModelController

does one step.

dostep(int) - Method in class SGameQController

does one step.

dostep(int) - Method in class TGameController

does one step.

dostep(int) - Method in class TGameEnv

does one step.

dostep(int) - Method in class TGameEnvRand

does one step.

dostep(int) - Method in class TGameGUI

dostep(int) - Method in class TGameQController

does one step.

doSteps(int, double, double, double) - Method in class Q10_Controller

does count number of steps whether each step is greedy or random is determine by greedyProb

doSteps(int, double, double, double) - Method in class Q_Controller

does count number of steps whether each step is greedy or random is determine by greedyProb

doSteps(int, double, double, double, double) - Method in class SarsaController

does count number of steps whether each step is greedy or random is determine by greedyProb

doSteps(int, double) - Method in class SGameController

does count number of steps This is where you would put your controller

doSteps(int, double) - Method in class SGameFAController

does count number of steps This is where you would put your controller

doSteps(int, double) - Method in class SGameModelController

do numsteps number of steps This is where you would put your controller

doSteps(int, double) - Method in class SGameQController

do count number of steps This is where you would put your controller

doSteps(int, double) - Method in class TGameController

does count number of steps This is where you would put your controller

doSteps(int, double) - Method in class TGameQController

does count number of steps This is where you would put your controller

E

e - Variable in class SarsaController

The the eligibility trace for state (xpos,ypos) and action

F

featureValues(int, int, int, boolean, int) - Method in class SGameFeatureSet

Returns the feature values for a state action pair.

G

getAlpha() - Method in class SGameController

getAlpha() - Method in class TGameController

getAlphaFixed() - Method in class SGameController

getAlphaFixed() - Method in class TGameController

getCounts(int, int, int) - Method in class SGameController

This is not used in this controller, but is overridden by learning controllers.

getCounts(int, int, int) - Method in class SGameModelController

The GUI uses getCounts(x,y,a) to display counts.

getCounts(int, int, int) - Method in class SGameQController

The GUI uses getCounts(x,y,a) to display counts.

getDiscount() - Method in class SGameController

getDiscount() - Method in class TGameController

getEnvironment() - Method in class SGameController

getEnvironment() - Method in class TGameController

getTitle() - Method in class SGameController

getTitle() - Method in class TGameController

greedyProb - Variable in class SarsaController

I

init() - Method in class Q10_GUI

init() - Method in class Q_GUI

init() - Method in class SarsaGUI

init() - Method in class SGameGUI

init() - Method in class TGameGUI

L

lambda - Variable in class SarsaController

M

m03 - Variable in class SGameEnv

m13 - Variable in class SGameEnv

m21 - Variable in class SGameEnv

m33 - Variable in class SGameEnv

m42 - Variable in class SGameEnv

minReward - Variable in class SGameEnv

minReward - Variable in class TGameEnv

minStep - Variable in class SGameEnv

minStep - Variable in class TGameEnv

N

num_updates() - Method in class SGameModelController

numberOfSteps - Variable in class Q_Env

numberOfSteps - Variable in class SGameEnv

numberOfSteps - Variable in class TGameEnv

NumFeatures - Variable in class SGameFeatureSet

The number of features.

P

prevAction - Variable in class SarsaController

prevX - Variable in class SarsaController

prevY - Variable in class SarsaController

prize - Variable in class SGameEnv

Prize Location.

PRIZE_SIZE - Variable in class SGameModelController

PRIZE_SIZE - Variable in class SGameQController

Q

Q10_Controller - Class in <Unnamed>

This applet demonstrates Q-learning for a particular grid world problem.

Q10_GUI - Class in <Unnamed>

This applet demonstrates Q-learning for a particular grid world problem.

Q10_GUI() - Constructor for class Q10_GUI

Q_Controller - Class in <Unnamed>

This applet demonstrates Q-learning for a particular grid world problem.

Q_Env - Class in <Unnamed>

This applet demonstrates Q-learning for a particular grid world problem.

Q_Env() - Constructor for class Q_Env

Q_GUI - Class in <Unnamed>

This applet demonstrates Q-learning for a particular grid world problem.

Q_GUI() - Constructor for class Q_GUI

qvalue(int, int, int) - Method in class SGameController

This is not used in this controller, but is overridden by learning controllers.

qvalue(int, int, int) - Method in class SGameFAController

This is gives the q-values to be drawn by the GUI.

qvalue(int, int, int) - Method in class SGameModelController

The GUI uses qvalue(x,y,a) to display values and arrows.

qvalue(int, int, int) - Method in class SGameQController

The GUI uses qvalue(x,y,a) to display values and arrows.

qvalue(int, int, int) - Method in class TGameController

This is not used in this controller, but is overridden by learning controllers.

qvalue(int, int, int) - Method in class TGameQController

The GUI uses qvalue(x,y,a) to display values and for the arrows.

qvalues - Variable in class Q10_Controller

The Q values: Q[xpos,ypos,action]

qvalues - Variable in class Q_Controller

The Q values: Q[xpos,ypos,action]

qvalues - Variable in class SarsaController

The Q values: Q[xpos,ypos,action]

R

replacingTrace - Variable in class SarsaController

reward - Variable in class SarsaController

reward - Variable in class TGameEnv

S

sarsa - Variable in class TGameController

SarsaController - Class in <Unnamed>

This applet demonstrates SARSA(lambda)-learning for a particular grid world problem.

SarsaGUI - Class in <Unnamed>

This applet demonstrates SARSA(lambda)-learning for a particular grid world problem.

SarsaGUI() - Constructor for class SarsaGUI

setAlpha(double) - Method in class SGameController

setAlpha(double) - Method in class TGameController

setAlphaFixed(boolean) - Method in class SGameController

setAlphaFixed(boolean) - Method in class TGameController

setDiscount(double) - Method in class SGameController

setDiscount(double) - Method in class TGameController

SGameAdvController - Class in <Unnamed>

This applet demonstrates a simple game.

SGameAdvEnv - Class in <Unnamed>

This applet demonstrates a simple game.

SGameAdvEnv() - Constructor for class SGameAdvEnv

SGameController - Class in <Unnamed>

This applet demonstrates a simple game.

SGameEnv - Class in <Unnamed>

This applet demonstrates a simple game.

SGameEnv() - Constructor for class SGameEnv

SGameFAController - Class in <Unnamed>

This applet demonstrates a simple game.

SGameFeatureSet - Class in <Unnamed>

This applet demonstrates a simple game.

SGameFeatureSet() - Constructor for class SGameFeatureSet

SGameGUI - Class in <Unnamed>

This applet demonstrates a simple grid-world game.

SGameGUI() - Constructor for class SGameGUI

SGameModelController - Class in <Unnamed>

This applet demonstrates a simple game.

SGameQController - Class in <Unnamed>

This applet demonstrates a simple game.

state(int, int, int, boolean) - Method in class SGameModelController

gets the state from the xpos, ypos, prize, damage

state(int, int, int, boolean) - Method in class SGameQController

gets the state from the xpos, ypos, prize, damage

STATE_SIZE - Variable in class SGameModelController

STATE_SIZE - Variable in class SGameQController

T

TGameController - Class in <Unnamed>

This applet demonstrates a simple game.

TGameEnv - Class in <Unnamed>

This applet demonstrates a simple game.

TGameEnv() - Constructor for class TGameEnv

TGameEnvRand - Class in <Unnamed>

TGameEnvRand(TGameEnv, int) - Constructor for class TGameEnvRand

TGameGUI - Class in <Unnamed>

This applet demonstrates a simple grid-world game.

TGameGUI() - Constructor for class TGameGUI

TGameQController - Class in <Unnamed>

This applet demonstrates a simple game.

toDisplay() - Method in class SGameController

This can optionally return a set of real values to dosplay.

toDisplay() - Method in class SGameFAController

toDisplay() - Method in class TGameController

This can optionally return a set of real values to dosplay.

totalReward - Variable in class Q_Env

totalReward - Variable in class SGameEnv

totalReward - Variable in class TGameEnv

tracing - Variable in class Q10_Controller

tracing - Variable in class Q_Controller

tracing - Variable in class Q_Env

tracing - Variable in class SarsaController

tracing - Variable in class SGameController

tracing - Variable in class SGameEnv

tracing - Variable in class TGameController

tracing - Variable in class TGameEnv

V

value(int, int) - Method in class Q10_Controller

determines the value of a location the value is the maximum, for all actions, of the q-value

value(int, int) - Method in class Q_Controller

determines the value of a location the value is the maximum, for all actions, of the q-value

value(int, int) - Method in class SarsaController

determines the value of a location the value is the maximum, for all actions, of the q-value

value(int, int, int, boolean) - Method in class SGameFAController

determines the value of a state the value is the maximum, for all actions, of the q-value

value(int) - Method in class SGameModelController

determines the value of a state the value is the maximum, for all actions, of the q-value

value(int) - Method in class SGameQController

determines the value of a state the value is the maximum, for all actions, of the q-value

value(int, int) - Method in class TGameQController

determines the value of a state the value is the maximum, for all actions, of the q-value

visits - Variable in class Q10_Controller

The number of times the agent has been at (xpos,ypos) and done action

visits - Variable in class Q_Controller

The number of times the agent has been at (xpos,ypos) and done action

X

X_SIZE - Variable in class SGameModelController

X_SIZE - Variable in class SGameQController

xDim - Variable in class SGameEnv

xDim - Variable in class TGameEnv

Y

Y_SIZE - Variable in class SGameModelController

Y_SIZE - Variable in class SGameQController

yDim - Variable in class SGameEnv

yDim - Variable in class TGameEnv

Z

zeroCrossing - Variable in class SGameEnv

zeroCrossing - Variable in class TGameEnv

A C D E F G I L M N P Q R S T V X Y Z