Senior Machine Learning Engineer

Job Requisition ID #25WD92913Position OverviewThe work we do at Autodesk touches nearly every person on the planet. By creating software tools for making buildings, machines, and even the latest movies, we influence and empower some of the most creative people in the world.As a Senior Machine Learning Engineer at Autodesk Research, you will work side-by-side with world-class researchers and engineers to build new ML-powered product features that help our customers imagine, design, and make a better world.You are a software engineer who is passionate about solving problems and building things. You are excited to collaborate with AI researchers to implement generative AI features in Autodesk products.You will report to a research manager in the Autodesk AI Lab team within Autodesk Research. We are a global team located in London, San Francisco, Toronto, and remote locations. For this role, we support in-person, hybrid, and remote work arrangements.ResponsibilitiesDesign, architect and implement comprehensive monitoring systems for foundation models in production, establishing best practices for tracking key metrics and monitoring performance drift across multiple models and environmentsBuild and own robust alerting systems to proactively detect model drift, performance anomalies, and data quality issues, defining thresholds and response strategies in collaboration with cross-functional teamsDesign, build and maintain scalable data pipelines for model training, fine-tuning, and evaluation, ensuring reliability, efficiency, and adherence to engineering best practicesImplement data quality checks for response and prediction log datasets and ensure data integrity at scaleLead the development of interactive dashboards and visualization tools for stakeholders to monitor model performance, usage patterns, and business metrics, translating technical metrics into actionable business insightsOwn and develop comprehensive reporting systems to track model performance trends, ensuring SLA compliance, and provide data-driven recommendations for continuous developmentMinimum QualificationsBSc or MSc in Computer Science, or equivalent industry experience3+ years of related industry experienceExperience with databases and SQL for data management and queryingProficiency with JupyterNotebooks, data visualization libraries (e.g., Plotly, Matplotlib), and data analysis libraries (e.g., scikit-learn)Hands-on experience with ML Ops tools and practices, including experiment tracking, model versioning, and production monitoring (e.g., MLflow, Weights & Biases, TensorBoard)Experience with version control, reproducibility, and writing reusable, testable codeExperience with data modelling, architecture, and processing using varied data representations, including 2D and 3D geometryExperience with cloud services and architectures (e.g., AWS, Azure)Excellent written documentation skills to document code, architectures, and experimentsPreferred QualificationsExperience scaling ML data pipelinesProficiency with advanced model monitoring platforms and observability tools (e.g., Evidently AI, Arize AI, Fiddler, Datadog ML Monitoring, Grafana)Proven experience implementing drift detection strategies (data drift, concept drift, prediction drift) and automated remediation workflowsExperience designing and conducting A/B testing and experimentation frameworks for ML models, including statistical analysis and causal inferenceKnowledge of GenAI-specific evaluation metrics and methodologiesKnowledge of the design, manufacturing, AEC, or media & entertainment industriesExperience with Autodesk or similar products (CAD, CAE, CAM, etc.)Learn MoreAbout AutodeskWelcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!Salary transparencySalary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.Diversity & BelongingWe take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belongingAre you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site).