v0.4.9

API Change

1. refactor the implementation of Decision Transformer, DI-engine supports both discrete and continuous DT outputs with the multi-modal observation now (example: ding/example/dt.py)
2. Update the multi-GPU Distributed Data Parallel (DDP) example (link)
3. Change the return value of InteractionSerialEvaluator, simplifying redundant results

Env

1. add cliffwalking env (#677)
2. add lunarlander ppo config and example

Algorithm

1. add BCQ offline RL algorithm (#640)
2. add Dreamerv3 model-based RL algorithm (#652)
3. add tensor stream merge network tools (#673)
4. add scatter connection model (#680)
5. refactor Decision Transformer in new pipeline and support img input and discrete output (#693)
6. add three variants of Bilinear classes and a FiLM class (#703)

Enhancement

1. polish offpolicy RL multi-gpu DDP training (#679)
2. add middleware for Ape-X distributed pipeline (#696)
3. add example for evaluating trained DQN (#706)

Fix

1. fix to_ndarray fails to assign dtype for scalars (#708)
2. fix evaluator return episode_info compatibility bug
3. fix cql example entry wrong config bug
4. fix enable_save_figure env interface
5. fix redundant env info bug in evaluator
6. fix to_item unittest bug

Style

1. polish and simplify requirements (#672)
2. add Hugging Face Model Zoo badge (#674)
3. add openxlab Model Zoo badge (#675)
4. fix py37 macos ci bug and update default pytorch from 1.7.1 to 1.12.1 (#678)
5. fix mujoco-py compatibility issue for cython<3 (#711)
6. fix type spell error (#704)
7. fix pypi release actions ubuntu 18.04 bug
8. update contact information (e.g. wechat)
9. polish algorithm doc tables

New Repo

1. DOS: [CVPR 2023] ReasonNet: End-to-End Driving with Temporal and Global Reasoning

Full Changelog: v0.4.8...v0.4.9

Contributors: @PaParaZz1 @zjowowen @zhangpaipai @AltmanD @puyuan1996 @Cloud-Pku @Super1ce @kxzxvbk @jayyoung0802 @Mossforest @lxl2gf @Privilger