[Feature Request] Tensorboard Support

[araffin]

As stable-baselines has now integrated tensorflow support, that could be cool to enable it in the toolbox repo (and to add it to the pytorch RL algo: SAC, CMA-ES, ARS).

[huiwenzhang]

Hi,
To support tensorboard in stable-baselines, we need to define a tb log location for the RL agent. In this repo, arguments of the RL agent are defined by the train_kwargs, see here

robotics-rl-srl/rl_baselines/train.py

Line 333 in 1ab1bd3

algo.train(args, callback, env_kwargs=env_kwargs, train_kwargs=hyperparams)

However, the train_kwargs only accept hyper-parameters of the specific rl agent. Alternatively, we can set the log args in the 'train' method of the agent, take ppo2 as an example,

robotics-rl-srl/rl_baselines/rl_algorithm/ppo2.py

Lines 59 to 68 in 1ab1bd3

	param_kwargs = {
	"verbose": 1,
	"n_steps": 128,
	"ent_coef": 0.01,
	"learning_rate": lambda f: f * 2.5e-4,
	"vf_coef": 0.5,
	"max_grad_norm": 0.5,
	"gamma": 0.99,
	"lam": 0.95,
	"nminibatches": 4,

But it would be better to define the arg outside the specific agent, for example, the train file. So some small modifications may be done here.