revert dp changes, make act and tdmpc batch friendly

这个提交包含在:
Alexander Soare
2024-03-18 19:18:21 +00:00
父节点 09ddd9bf92
当前提交 88347965c2
共有 8 个文件被更改,包括 32 次插入 和 58 次删除

查看文件

@ -84,6 +84,9 @@ def test_abstract_policy_forward():
self.n_action_steps = n_action_steps
self.n_policy_invocations = 0
def update(self):
pass
def select_action(self):
self.n_policy_invocations += 1
return torch.stack([torch.tensor([i]) for i in range(self.n_action_steps)]).unsqueeze(0)