Data for autonomy at the edge

Task-based embodiment data for real-world autonomy at the edge

Skilled work on real sites, with the rain, low light, rough ground, slips and all the chaos that the real world brings

gcloud storage cp -r gs://rockautonomy/heavy-industry .Copy
aws s3 sync s3://rockautonomy/heavy-industry .Copy
git lfs clone git@rockautonomy.com:datasets/heavy-industry.gitCopy
Set up Rock Autonomy and run a first training jobCopy
Sample · videoEgo · L wrist · R wrist · Depth00:00:00
Heavy industry · inspecting piping, running cleaning and maintenance tooling
Sample · videoEgo · L wrist · R wrist · Depth00:00:00
Construction sites · moving goods from a trailer to a staging site
Show more training environments ↓
The datasets

End-to-end datasets and evaluation

Variants of tasks, captured in one collection

CaptureExpert-guided skilled work, on site
EmbodimentMotion labeled and annotated as actions
CompliancePII removed, data cleansed
VariantsThe same task across weather, light and terrain
EvaluationExpert rubrics and a baseline score
LicenceExclusive and recurring licences

Real-world conditions, not the lab

Where things break and the work has to react

Field capture
Weather
Low illumination
Blocked views
Rough ground
Slips and drops
Training environments

Skilled labor where it happens

Egocentric stereo · dual wrist cameras · IMU ×3 · depth · 3D hand pose · frame-level action labels · one shared clock · MCAP / LeRobot / RLDS
Data clip
Heavy industryNavigating and visually inspecting piping; operating cleaning and maintenance toolinggs://rockautonomy/heavy-industryCopy
Data clip
Construction sitesLoading and unloading physical goods from a trailer to a staging sitegs://rockautonomy/construction-sitesCopy
Mining sitesNavigating uneven, low-ceiling or difficult terrain; excavating earth and moving equipment
Fine dexterityHigh-precision, skilled handwork on a single jewel
Hard laborTrenching, hauling and planting in open, unstructured ground
Hazardous duty sitesNavigating corrosive or bio-hazardous environments; stripping and removing nonstandard material
Forward operating basesLoading and moving ammunition from one site to another
Need another environment?Tell us the task and the specGet in touch
Frontier Labs · Neo Labs ·
Research Groups · Startups
ResearchersOut of distributionWhat lab and teleoperated data leaves out
  • Weather and low light
  • Rough ground, blocked views
  • Slips, drops, recoveries
Data opsTask-basedA logically grouped dataset, with an end and a success criterion for every task
  • Variants of each task
  • Labels on one shared clock
  • PII removed, evals included
Partnerships and StrategyLicence and exclusivityLicensed, not sold, with rights cleared at the source
  • Multi-year, recurring
  • Exclusive by task or term
  • One contract, end to end

Monetize your data for the future of work

Your data is in demand

Construction sites
Mining sites
Heavy industry
Hazardous duty sites
Precision workshops
Labor crews

License it on a long-term contract

Licensed, not sold
Long-term contract
A share in the upside

Guide the future of work

Your expertise
Shapes how AI is trained
Shapes how it is used
Rock Autonomy

Get in touch

What are you interested in?