Job Requisition ID #25WD88438Position OverviewAutodesk is seeking a skilled Sr. Data Engineer to join our Machine Learning Engineering team within the Access domain. This role is critical in enabling the development and deployment of scalable ML solutions by building and maintaining the robust data pipelines, data prep and contributing to infrastructure that powers them. You will work closely with ML engineers, data scientists, and platform teams to design pipelines, prepare training data, and ensure data quality, security, and availability across the lifecycle of our AI/ML products.ResponsibilitiesData Pipeline Development: Design, implement, and maintain scalable, resilient data pipelines to support ML model training, inference, and analyticsETL/ELT Engineering: Build and manage ETL/ELT workflows to extract data from various sources, transform it for feature engineering, and load it into cloud data warehouses and model storesData Preparation for ML: Collaborate with ML engineers to gather, clean, and curate datasets for training and evaluation. Implement processes for labeling, versioning, and partitioning datasetsData Infrastructure: Contribute to the development of data platforms and infrastructure on AWS (e.g., S3, Glue, Redshift, Athena, EMR) to support ML workflows and high-throughput data processingData Quality & Governance: Monitor data integrity, freshness, and availability; enforce data validation checks and lineage tracking to ensure reliable ML model behaviorAutomation & Orchestration: Automate data workflows using orchestration tools such as Apache Airflow, AWS Step Functions to enable reproducible and scheduled data operationsCollaboration & Integration: Work closely with ML engineers, product managers, and analytics teams to understand data needs, optimize schemas, and expose data via APIs or query interfaces. You will work closely with business stakeholders to understand and maintain focus on their analytical needs, including identifying critical metrics and KPIsPerformance Optimization: Optimize data queries, storage, and transfer to reduce cost and latency for ML model training and real-time featuresDocumentation & Best Practices: Document data sources, pipelines, and workflows, and promote engineering best practices across the ML platform teamMinimum QualificationsBachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field3+ years of experience as a Data Engineer working on large-scale data infrastructure, preferably in ML or AI environmentsProficiency in Python and SQL; experience with Spark, PySpark, or other distributed data frameworksHands-on experience with AWS, including S3, Glue, Redshift, Athena, Lambda, and Step FunctionsExperience building and maintaining data pipelines and orchestration using tools like Airflow, Luigi, or similarExperience in working and analyzing data on notebook solutions like Jupyter, EMR Notebooks, Apache ZeppelinFamiliarity with data warehousing, stream processing, and data modeling principlesStrong understanding of data lifecycle, governance, versioning, and reproducibility in ML contextsExperience with version control and CICD tools like Git and Jenkins CIProactive problem solver with excellent written and interpersonal skills; ability to make sound, complex decisions in a fast-paced, technical environmentPreferred QualificationsExperience working in cross-functional ML teams and working with ML Ops teamsFamiliarity with ML concepts (e.g., feature stores, model inputs/outputs, retraining triggers)Experience with tools like Feast, Delta Lake, or data lakehouse architectures.Exposure to containerization (Docker) and infrastructure-as-code tools (Terraform, CloudFormation)Learn MoreAbout AutodeskWelcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!Salary transparencySalary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, we also have a significant emphasis on discretionary annual cash bonuses, commissions for sales roles, stock or long-term incentive cash grants, and a comprehensive benefits package.Diversity & BelongingWe take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belongingAre you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site).
View Original Job Posting