Skip to content

Commit

Permalink
update token positions
Browse files Browse the repository at this point in the history
  • Loading branch information
lucidrains committed Dec 2, 2024
1 parent 77ba312 commit d4c96d1
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion pi_zero_pytorch/pi_zero.py
Original file line number Diff line number Diff line change
Expand Up @@ -53,7 +53,7 @@
# vision and language tokens are autoregressive causal mask, actions, interal states + joint bidirectional amongst own tokens, but still autoregressive with respect to other tokens

# [state token groups] [action token groups]
# [external state] [visual tokens] [language tokens] [joint state + internal state] [maybe reward / condition token] [action registers] [actions]
# [external state] [visual tokens] [language tokens] [maybe reward / condition token] [action registers] [joint state + internal state] [actions]

# constants

Expand Down

0 comments on commit d4c96d1

Please sign in to comment.