提交图

342 次代码提交

作者 SHA1 备注 提交日期
86365adf9f revision 2024-04-08 14:44:46 +01:00
0a721f3d94 empty commit 2024-04-08 13:21:38 +01:00
863f28ffd8 ready for review 2024-04-08 13:10:19 +01:00
1bab4a1dd5 Eval reproduction works with gym_aloha 2024-04-08 10:23:26 +01:00
e982c732f1 Merge remote-tracking branch 'Cadene/user/rcadene/2024_03_31_remove_torchrl' into refactor_act_remove_torchrl 2024-04-08 09:25:45 +01:00
e1ac5dc62f fix aloha pixels env test 2024-04-07 17:20:54 +00:00
4371a5570d Remove latency, tdmpc policy passes tests (TODO: make it work with online RL) 2024-04-07 16:01:22 +00:00
44656d2706 test_envs are passing 2024-04-05 23:27:12 +00:00
8d2463f45b backup wip 2024-04-05 18:46:30 +01:00
ecc7dd3b17 Merge remote-tracking branch 'Cadene/user/rcadene/2024_03_31_remove_torchrl' into refactor_act_remove_torchrl 2024-04-05 18:35:13 +01:00
5eff40b3d6 rename task, sim_transfer -> transfer 2024-04-05 17:18:37 +00:00
a2d3588fca wrap dm_control aloha into gymnasium (TODO: properly seeding the env) 2024-04-05 17:17:31 +00:00
29032fbcd3 wrap dm_control aloha into gymnasium (TODO: properly seeding the env) 2024-04-05 17:17:14 +00:00
ab2286025b Merge remote-tracking branch 'Cadene/user/rcadene/2024_03_31_remove_torchrl' into refactor_act_remove_torchrl 2024-04-05 18:06:00 +01:00
1e71196fe3 backup wip 2024-04-05 17:38:29 +01:00
26602269cd test_envs.py are passing, remove simxarm and pusht directories 2024-04-05 16:21:07 +00:00
9c28ac8aa4 re-add pre-commit check 2024-04-05 15:25:11 +01:00
f56b1a0e16 WIP tdmpc 2024-04-05 13:40:31 +00:00
ab3cd3a7ba (WIP) Add gym-xarm 2024-04-05 15:35:20 +02:00
0b8d27ff2c Merge remote-tracking branch 'Cadene/user/rcadene/2024_03_31_remove_torchrl' into refactor_act_remove_torchrl 2024-04-05 12:48:11 +01:00
c17dffe944 policies/utils.py 2024-04-05 11:47:15 +00:00
8ba88ba250 Merge remote-tracking branch 'Cadene/user/rcadene/2024_03_31_remove_torchrl' into refactor_act_remove_torchrl 2024-04-05 12:34:14 +01:00
a420714ee4 fix: action_is_pad was missing in compute_loss 2024-04-05 11:33:39 +00:00
4863e54ce9 Merge remote-tracking branch 'Cadene/user/rcadene/2024_03_31_remove_torchrl' into refactor_act_remove_torchrl 2024-04-05 12:00:31 +01:00
ad3379a73a fix memory leak due to itertools.cycle 2024-04-05 10:59:32 +00:00
9d77f5773d Merge remote-tracking branch 'Cadene/user/rcadene/2024_03_31_remove_torchrl' into refactor_act_remove_torchrl 2024-04-05 11:41:11 +01:00
edb125b351 backup wip 2024-04-05 11:03:28 +01:00
5af00d0c1e fix train.py, stats, eval.py (training is running) 2024-04-05 09:31:39 +00:00
3a4dfa82fe backup wip 2024-04-04 18:34:41 +01:00
c93ce35d8c WIP stats (TODO: run tests on stats + cmpute them) 2024-04-04 16:36:03 +00:00
1cdfbc8b52 WIP
WIP

WIP train.py works, loss going down

WIP eval.py

Fix

WIP (eval running, TODO: verify results reproduced)

Eval works! (testing reproducibility)

WIP

pretrained model pusht reproduces same results as torchrl

pretrained model pusht reproduces same results as torchrl

Remove AbstractPolicy, Move all queues in select_action

WIP test_datasets passed (TODO: re-enable NormalizeTransform)
2024-04-04 15:31:03 +00:00
278336a39a backup wip 2024-04-03 19:23:22 +01:00
110ac5ffa1 backup wip 2024-04-03 14:21:07 +01:00
c7d70a8db9 Merge remote-tracking branch 'upstream/main' into refactor_act 2024-04-03 10:08:12 +01:00
920e0d118b Merge pull request #66 from alexander-soare/fix_stats_computation
fix stats computation
2024-04-03 10:03:47 +01:00
caf4ffcf65 add TODO 2024-04-03 09:56:46 +01:00
a6ec4fbf58 remove try-catch 2024-04-03 09:53:15 +01:00
c50a62dd6d clarifying math 2024-04-03 09:47:38 +01:00
e9eb262293 numerically sound mean computation 2024-04-03 09:44:20 +01:00
7242953197 revision 2024-04-02 19:19:13 +01:00
65ef8c30d0 backup wip 2024-04-02 19:13:49 +01:00
2b928eedd4 backup wip 2024-04-02 19:11:53 +01:00
c3234adc7d fix indentation 2024-04-02 16:59:19 +01:00
148df1c1d5 add comment on test 2024-04-02 16:57:25 +01:00
a6edb85da4 Remove random sampling 2024-04-02 16:52:38 +01:00
95293d459d fix stats computation 2024-04-02 16:40:33 +01:00
11cbf1bea1 Merge pull request #53 from alexander-soare/finish_examples
Add examples 2 and 3
2024-04-01 11:52:41 +01:00
f1148b8c2d Merge remote-tracking branch 'upstream/main' into finish_examples 2024-04-01 11:31:31 +01:00
2a98cc71ed Merge pull request #56 from huggingface/user/aliberts/2024_03_27_improve_ci
Add code coverage, more end-to-end tests
2024-03-28 10:57:44 +01:00
a7c9b78e56 Deactivate eval ACT on Aloha (policy is None) 2024-03-28 10:55:11 +01:00