Senior ML 3D Dataset Research Engineer

About UNISON

UNISON is a small team of passionate people from companies like Meta, Sony, and Apple, as well as research labs like the IARAI. Based in the SF Bay Area and backed by some of the world’s best investors, we're working hard to create products we would proudly recommend to our friends and family.

We are building a unified reality headset that allows users to plunge into and resurface from virtual worlds with newfound value. We see living between virtual and physical worlds as a tool for creating, storytelling, and sharing—not hindering your total lived experience. You can learn more about our product, team, careers, and worldviews at unison.co.

About The Role

We seek a highly skilled and motivated ML Dataset Research Engineer to join our team and help build high-quality datasets for Artificial Intelligence and Machine Learning at UNISON. In this role, you will push state-of-the-art 3D dataset creation and benchmarking, from owning the 3D live data capture process, auto-labeling methods, and manual labeling tools. You will also collaborate with other team members on synthetic data generation and designing computer vision algorithms to perceive the real world in 3D for VR.

Responsibilities

• Research, build, and maintain 3D data capture lab scripting.

• Implement state-of-the-art auto-labeling algorithms for 3D data.

• Extend and maintain data labeling software for manual annotations.

• Develop and update data labeling guides for manual annotation.

• Collaborate with the team conducting experiments to improve UNISON 3D perception, find adversarial examples, and push the limits of the models at edge cases.

• Collaborate with the simulation team to generate synthetic datasets.

• Develop machine learning models and algorithms.

Qualifications

• 5+ years of experience in machine learning/computer vision for 3D data structures like point clouds, meshes, etc.

• Experience creating datasets for 3D Machine Learning. A bonus working on capturing human subjects, particularly on hands or body poses.

• Experience creating auto-labeling algorithms for 3D data.

• Experience creating annotation tools for Machine Learning. A bonus is working on annotating human subjects, particularly on hands or body poses.

• Experience with computer vision libraries such as OpenCV and Pytorch.

• Understanding of linear algebra and 3D Math related to cameras and/or graphics.

• Strong skills in Python, and C++ is a plus.

• Comfort running your own ML stack (Can use docker, comfortable working in command line, etc.)

Preferred Qualifications

• Experience in a full machine learning project pipeline from data collection to model deployment in production.

• Experience running data capture process in person.

• Familiarity with data labeling and labeling software such as CVAT.

• Hand tracking and body pose experience.

Why UNISON?

UNISON offers competitive salaries and equity packages, giving all employees an ownership stake in what we're working hard to build. You will also receive flexible PTO, 401k with employer matching, excellent 100% employer-paid health benefits, and more.

We are growing quickly, so if you’re interested in joining us but don’t see a job that fits what you’re looking for or if your experience doesn’t quite meet the criteria, please feel free to reach out at [email protected]. We are happy to connect.

UNISON is committed to equity in our hiring practices. If you think you may require an accommodation for any part of the recruitment process, please send a request to: [email protected]. All requests for accommodations are treated discreetly and confidentially, as practical, and permitted by law.

At UNISON, we are committed to mitigating bias and providing an inclusive environment where equal employment opportunities are available to all qualified applicants and teammates based solely on business needs and individual qualifications, without regard to race, color, national, social or ethnic origin, religion, pregnancy (including childbirth, lactation, and related medical conditions), ancestry, age, physical and mental disability, sex, sexual orientation, gender identity and/or gender expression, marital/familial status, citizenship status, military/veteran status, and any other legally protected status under federal, state, or local anti-discrimination laws.