Evaluation of learned policy error

[E-Cylab]

Hello,

I was trying to run the example evaluation script given in "csle/examples/eval/stopping_game_pomdp_defender/eval.py", but i am getting this error message :

(base) vagrant@CSLE-Leader:~/csle/examples/eval/stopping_game_pomdp_defender$ python3 eval.py Traceback (most recent call last): File "/home/vagrant/csle/examples/eval/stopping_game_pomdp_defender/eval.py", line 36, in <module> test_env() File "/home/vagrant/csle/examples/eval/stopping_game_pomdp_defender/eval.py", line 27, in test_env StoppingGamePomdpDefenderEnv.emulation_evaluation( AttributeError: type object 'StoppingGamePomdpDefenderEnv' has no attribute 'emulation_evaluation'
Any trouble shooting steps are greatly appreciated !!!

Best regards,
Elli

[Kim-Hammar]

Hi @E-Cylab ,

The helper function for "emulation evaluation" was deprecated, I will update the example when I have time. I found that it is better to implement your own emulation evaluation function rather than having it built-in to the environment class because there is so much variability. You can see the old codes here:

https://github.com/Limmen/csle/blob/44c549d3fcf113222ac048c86c693d71864339c7/simulation-system/libs/gym-csle-stopping-game/src/gym_csle_stopping_game/envs/stopping_game_pomdp_defender_env.py#L107

https://github.com/Limmen/csle/blob/31d9198a6fbc80c8e5884d9dcfa0e8cea8718636/simulation-system/libs/gym-csle-stopping-game/src/gym_csle_stopping_game/envs/stopping_game_env.py#L383