LLM Alignment Data, Product Manager

NVIDIA is seeking a Product Manager to own the data strategy for our Large Language Model alignment and customization applied research. The data at this stage of model development is used for instruction tuning for improved performance as well safety and customization. Dive into the heart of AI at NVIDIA, where our data strategy and product management roles for Large Language Models offer an exciting role within cutting-edge innovation. As a key player on our diverse team, you will orchestrate the data pipeline that fuels these algorithms, and opens up new and exciting customization opportunities for our customers.What You'll be Doing:First and foremost, you will be the key point person for all things LLM alignment data: requirements gathering, data collection, quality assurance, and data impact evaluation.Craft and implement robust data alignment frameworks to guide the ethical sourcing and application of diverse datasets, ensuring LLM outputs align with organizational values and user expectations.Provide strategic direction to cross-functional teams on data curation, annotation, and modeling, ensuring data strategies support the goals of the LLM alignment team.Collaborate with internal and external deep learning engineers and researchers to build short and long term data acquisition plansDevelop and execute model customization workflows for both internal and external applicationsForge strategic partnerships and collaborations to acquire high-quality, diverse data sources essential for the nuanced development and fine-tuning of LLMsOwn the development of internal data policies that address bias, fairness, and transparency in LLMs, setting the standard for responsible AI within the industryContribute to the creation and refinement of tools and technologies for efficient data annotation, collection, and augmentation to support advanced AI model development.What We Need to See:Bachelor’s degree in Computer Science, Computer Engineering, or similar technical field or equivalent experience8+ years of relevant work experience in data, software development, product management at a technology companyAbility to quickly experiment with data to test hypothesesTrack record of delivering data at scale for AI applicationsStrong communication skills and evidence of ability to influence othersPrior success juggling multiple projects at a timeWays to Stand Out from the Crowd:Experience with Large Language Model data, with a specific focus on Alignment data or instruction tuning (SFT, RLHF, RLAIF)Development of data collection or annotation workflows, process and guidelinesExposure to releasing microservices and APIs. A background in data science, ML research, cognitive science or psychologyOwning product portfolioWith highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world's most desirable employers. We have some of the most hard-working and dedicated people in the world working for us and, due to outstanding growth, our company is growing fast. If you're creative and have a genuine passion for technology, we want to hear from you.The base salary range is 156,000 USD - 247,250 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis. NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.