> WHY Getting minimal score for solution that works locally

Hello organizers,
I've uploaded my solution that worked locally using run_local_test.py. But it failed in the sense that it received the minimal possible score.
In fact, I set a time limit for each environment, but I found that they may not complete the training and error occurred.
The error.log gave very limited information:
"WARNING: Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap."

And so did the output:
2021-06-26 06:43:45,786 INFO evaluate.py: Checking /tmp/codalab/tmpKzmfof/run/input/res_2
2021-06-26 06:43:45,786 WARNING evaluate.py: /tmp/codalab/tmpKzmfof/run/input/res_2 does not exist. Default values will be used.
2021-06-26 06:43:45,787 INFO evaluate.py: Checking /tmp/codalab/tmpKzmfof/run/input/res_3
2021-06-26 06:43:45,787 WARNING evaluate.py: /tmp/codalab/tmpKzmfof/run/input/res_3 does not exist. Default values will be used.
2021-06-26 06:43:45,787 INFO evaluate.py: Checking /tmp/codalab/tmpKzmfof/run/input/res_4
2021-06-26 06:43:45,787 WARNING evaluate.py: /tmp/codalab/tmpKzmfof/run/input/res_4 does not exist. Default values will be used.
2021-06-26 06:43:45,787 INFO evaluate.py: Checking /tmp/codalab/tmpKzmfof/run/input/res_5
2021-06-26 06:43:45,787 WARNING evaluate.py: /tmp/codalab/tmpKzmfof/run/input/res_5 does not exist. Default values will be used.
2021-06-26 06:43:45,788 INFO evaluate.py: Checking /tmp/codalab/tmpKzmfof/run/input/res_6
2021-06-26 06:43:45,788 WARNING evaluate.py: /tmp/codalab/tmpKzmfof/run/input/res_6 does not exist. Default values will be used.
2021-06-26 06:43:45,788 INFO evaluate.py: [+] Results validation done.
2021-06-26 06:43:45,789 INFO evaluate.py: [+] Score reading done.
2021-06-26 06:43:45,789 INFO evaluate.py: Score list: [-99999999.0, -99999999.0, -99999999.0, -99999999.0, -99999999.0]
2021-06-26 06:43:45,790 INFO evaluate.py: [+] Score writing done.
2021-06-26 06:43:45,790 INFO evaluate.py: [+] Learning curve writing done.
2021-06-26 06:43:45,790 INFO evaluate.py: [+] Parent scoring program finished!

Could you give me more information about the error? Thank you very much in advance!

Posted by: hongsq @ June 27, 2021, 3:57 a.m.

Hi, Dear participant,

Your submission failed because your zip file contains one extra level of directory "my_rl".
To get through the system correctly, you should first 'cd $your_submission_dir' and 'zip -r $your_submission.zip ./*'. Then try to submit your zip solution again.

Best,
AutoRL 2021 Organizer

Posted by: automlai @ June 28, 2021, 4:42 a.m.
Post in this thread