OmniNavBench: Beyond Isolation

Abstract

A Unified Platform for General-Purpose Navigation

Compositional Complexity

Composite instructions interleave sub-tasks from PointNav, VLN, ObjectNav, HumanFollow, SocialNav, and EQA, compelling agents to seamlessly transition between exploration, interaction, and social compliance within a single unified episode.

Morphological Universality

A high-fidelity Isaac Sim platform evaluates wheeled (NVIDIA Carter), quadrupedal (Unitree Aliengo), and humanoid (Unitree H1) robots under a modular sensor interface with continuous physical dynamics.

Human Expert Demonstrations

Reference trajectories are collected via human teleoperation rather than shortest-path planners, preserving exploratory glances, hesitations, and anticipatory avoidance that characterize natural human navigation.

Submission Protocol

Offline Result Submission

Accepted Input

Upload a single .zip archive of per-episode JSON files generated from the current official test download. The server validates benchmark coverage, identities, and duplicates automatically.

Reported Metrics

Leaderboard columns include navigation and interaction metrics — SR, CSR, SGC, OSR, SPL, HFS, HFR, SII, EQA — recomputed offline against the private ground truth.

Publishing Workflow

Uploads are queued for asynchronous evaluation. Once a submission succeeds, you can publish it from My Submissions to make it appear on the public leaderboard.

Results

Leaderboard

Choose a track and robot, then click a method to show or hide its instruction variants.

#	Method	User	Affiliation	Variant	{{ m }}{{ lbSort===m ? (lbMeta.lower_is_better.includes(m) ? '▲' : '▼') : '' }}
{{ e.rank }}		{{ displayUser(e) }}	{{ displayAffiliation(e) }}	{{ variantLabel('original') }}	{{ formatMetric(e, 'original', m) }}
↳				{{ variantLabel(variant) }}	{{ formatMetric(e, variant, m) }}

No published entries yet. Sign in to submit the first result archive.

Tasks & Metrics

What the leaderboard measures

SRSuccess Rate — fraction of fully successful episodes

CSRCompletion Success Rate — ratio of strictly completed sub-instructions

SGCSub-Goal Completion — continuous progress across sub-tasks

OSROracle Success Rate — success if the goal was ever reached

SPLSuccess weighted by Path Length — efficiency-weighted success

HFS / HFRHuman-Follow final success and following-phase coverage

SII ↓Social Intrusion Index (Hall's personal distance, 1.2 m) — lower is better

Account Required

Submit and manage results

Create an account to upload episode result archives, monitor evaluation jobs, and publish successful submissions to the public leaderboard. On the Static deployment, use your email address in the username field.

{{ legacyBinding ? 'Bind email' : (authMode === 'login' ? 'Sign in' : 'Create account') }}

Submit

Upload a results archive

Submissions must be .zip archives containing per-episode JSON files. Precomputed summary metrics are ignored — all leaderboard metrics are recomputed server-side from raw trajectories against the private ground truth.

Need help? Contact the maintainer at SamsonSun@163.com. Please include your submission ID and error message, if available.

Submit Results

Method name

Benchmark track

Click or drop a result .zip here

Each included instruction style must contain the complete required test results exactly once.

Submission History

My Submissions

Successful submissions can be published to the public leaderboard.

Previously loaded records are shown below; their status may be out of date.

Loading submissions…

No submissions yet.

{{ s.method_name }} {{ statusLabel(s.status) }} Published

Submission #{{ s.id }} · {{ trackLabel(s.benchmark_track) }} · {{ s.filename }} · {{ new Date(s.created_at).toLocaleString() }}

{{ formatStoredMetric(k, v) }} {{ k }}

{{ s.error_message }}