Loss improves super slowly after first epoch in LSTM based sequential model.

[snemistry]

LSTM based sequential model seems to fit data really well on first epoch, but validation accuracy doesn't improve after first epoch and even loss halts improving after second epoch. I tried different optimizer paramters like lr, l2, etc., but it doesn't improve beyond certain point.

@maciejkula Any idea how can improve that?