Submission Guidelines
Participants must make submission through our
EvalAI page. There are three phases in the challenge.
Phase 1: Minival
This phase evaluates MultiON agents on the val set of the MultiON dataset. The results from this phase are not visible on the leaderboard. This phase is meant to be used for sanity checking the results of remote evaluation against your local evaluations.
Phase 2: Test-Standard
This results of this phase will be used to prepare the public leaderboard. We suggest using this phase for reporting results in papers and for comparing with other methods. Each team is allowed a maximum of 1 submission per day for this phase.
Phase 3: Test-Challenge
Only submissions made in this phase are considered as entries to the
MultiON Challenge since this will be used to decide the winners. Each team is allowed a total of 3 submissions to this phase until the end of this phase.
For detailed submission instruction, please refer
this.