Robust Vision Challenge 2018

In conjunction with CVPR 2018

Submission Guidelines

Please carefully read the following guidelines before submitting. If you do not comply with our guidlines your method will be removed from our leaderboard.

The goal of ROB is to foster development of algorithms which are robust across various datasets. Thus, each participating method must be trained and tested on all datasets involved in the respective challenge. It is not allowed to use different methods or alter the parameters of a method for each individual benchmark of a challenge. By submitting to ROB you agree to hand your source code to the organizing team upon request for inspection. Moreover, a paper, technical report or Arxiv paper must be published by the time of the workshop which covers the algorithmic details of the approach. External training data may be used as long as the dataset is public. The winner and the runner-up of each category will receive prize money, are invited to present the method at the ROB 2018 workshop and participate in a joint dinner, as well as co-author a joint TPAMI submission. Participants may submit to a single or multiple challenges.

All methods submitted may be trained on the provided training data as well as on additional data as long as the additional datasets are published (such that they can be used by other participants as well and thus the competition is fair). Examples: It is ok to pre-train on ImageNet or use the Mapillary Vistas dataset annotations for training. It is not ok to use your internal (eg, company) data which is not publicly available for training, pre-training or fine-tuning.

Submission Process

We are very much looking forward to your submission. To submit to ROB 2018, follow these steps:

  1. Download the development kit using the link below
  2. Download and convert all datasets into a common format using the devkit
  3. Train your model on the unified training set and run your trained model on the unified test set
  4. Use the devkit to convert your results back to the original dataset format(s)
  5. Upload your results to each indivdiual benchmark, use the suffix _ROB for your method name
  6. Register your method to the ROB challenge using the form below

Challenges

ROB 2018 features 6 challenges: stereo, multi-view stereo (MVS), optical flow, single image depth prediction, semantic segmentation and instance segmentation. Participants are free to submit to a single challenge or to multiple challenges. For each challenge, the results of a single model must be submitted to all benchmarks (indicated with an x below). For each challenge we will award a price to the winner and the runner-up.

Stereo
MVS
Flow
Depth
Semantic
Instance

ROB Development Kit

For downloading the ROB devkit please provide your email, we will send you download instructions. We will use your email address solely for sending you updates about the status of the challenge and the associated workshop. We will not share your email address with any third party or use it for any other purpose.

Register Method to ROB

For downloading the ROB development kit, please provide your email below. We will use your email address solely for sending you updates about the status of the challenge and the associated workshop. We will not share your email address with any third party or use it for any other purpose.

Fields marked with an asterisk (*) are mandatory.


Sponsors



eXTReMe Tracker