client.ppo_client

The PPO client module contains the sampling loop for PPO on worker nodes.

Note

The implementation of PPO is synchronous. Therefore, the client and server are currently not resilient against disconnects.

soulsai.distributed.client.ppo_client.ppo_client(config: SimpleNamespace)

PPO client main function.

Data processing, sample encodings etc. are configurable to customize the client for different environments. Messages to the redis client have to be encoded since redis messages can’t use arbitrary data types.

Parameters:

config – The training configuration.