Job Requisition ID #24WD76183Position OverviewWe are seeking an experienced and individual to join our team, Data Services, as a Data Engineer. You will be responsible for multiple data-related tasks, including developing SQL queries, Python pipeline development, maintaining a reporting dashboard, API management, data deduplication, being an embedded resource for multiple teams, monitoring Airflow DAGs, and infrastructure maintenance.You will report to a Manager - Data ServicesYou will work in Novi, MI.ResponsibilitiesDevelop SQL queries: Collaborate with the team to understand their data needs and translate them into SQL queries. This includes both ad-hoc and routine SQL queries to provide and accurate data to overseas teamsPython pipeline development: Utilize Python expertise to design data pipelines that ingest, transform, and deliver data. Assist team members in identifying and addressing data pipeline bottlenecks, implementing optimization techniques for smooth dataflowMaintain a reporting dashboard: Maintain a reporting dashboard on a Python Flask application and build new reports to automate recurring SQL jobs on Snowflake and SQL Server. Ensure the most up-to-date data is available for overseas teamsAPI management: Manage access, usage, and optimization of the Azure API to provide accurate and efficient translation services across diverse languages. Use the Google Maps API to cleanse and enrich client addresses, improving data accuracy and geo-spatial insightsData deduplication: Utilize data mining and analysis techniques to identify and analyze potential duplicate records across multiple databases. Apply defined criteria and rigorous evaluation to determine the "survivor" record among duplicates, ensuring data consistency and preserving valuable information. Manage "victim" records with care, minimizing data loss and maintaining traceabilityEmbedded resource: Act as an embedded resource for both the CED and EDEV teams. Be the L1 product monitor for both teams, identifying and addressing product issues and user feedbackAirflow DAG Monitor: Monitor the execution of Airflow DAGs, quickly identifying and diagnosing errors, failures, or performance issues. Investigate the cause of issues and implement appropriate solutions to ensure smooth DAG execution. Report issue patterns and DAG performance to stakeholders and suggest methods for future improvementsInfrastructure Maintenance: Manage maintenance and update schedules for infrastructures such as Airflow, EWS cluster, and Databand. Ensure stability and performance of these infrastructures. Be the bridge between the infrastructure team and engineering teams (CED and EDEV), understanding their needs and ensuring seamless supportMinimum QualificationsBachelor's degree in a relevant field or equivalent work experience3+ years of experience developing SQL queries and working with databasesProficiency in Python for data pipeline development1+ years of experience reporting dashboard development using tools like Python FlaskFamiliarity with API management and optimizationKnowledge of data deduplication techniques and toolsBe the embedded resource and handle multiple responsibilitiesExperience with Airflow DAG monitoring and infrastructure maintenanceLearn MoreAbout AutodeskWelcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made. We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers. When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!BenefitsFrom health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work. Learn more about our benefits in the U.S. by visiting https://benefits.autodesk.com/Salary transparencySalary is one part of Autodesk’s competitive compensation package. For U.S.-based roles, we expect a starting base salary between $75,500 and $122,100. Offers are based on the candidate’s experience and geographic location, and may exceed this range. In addition to base salaries, we also have a significant emphasis on annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.Equal Employment Opportunity At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.Diversity & BelongingWe take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belongingAre you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site).
View Original Job Posting