Senior Software Engineer (ETL/Snowflake)

Company: Autodesk
Company: Autodesk
Location: Bengaluru, IND
Commitment: Full time
Posted on: 2024-02-24 05:17
Job Requisition ID #24WD75688Position OverviewThe Senior Data Engineer plays a role of ETL/Snowflake Technical Lead. You will lead the team of data engineers in understanding and supporting the businesses through the design and development of extract, Transform, and Load (ELT/ETL), data integration, and data analytics processes across the enterprise. You will stay on top of tech trends, experiment with and learn new technologies, contribute to the growth of data organization, participate in internal and external technology communities, and mentor other members of the team. Provide technical leadership at every stage of the data engineering lifecycle, from designing data platforms, data pipelines, data stores, and gathering, importing data. Responsible for design, administration, support, and maintenance of the Snowflake Platform. Participate in the full systems life cycle and cloud data lake/data warehouse develop including recommendation of code development, integration with data marketplace or reuse and buy versus build solutions. You will report to a Software Development Senior Manager and work in a hybrid model.ResponsibilitiesTechnical Leadership –Lead data integration across the enterprise through develop and implementation of large-scale, high-volume, data pipelines for both on-prem and cloud data lake and data warehouses. Lead the development and documentation of technical best practices for ETL activities. Also, oversee a programme inception to build a new productSolution Design – Lead the design of technical solution including code, data pipelines, processes for integration of data lake and data warehouse solutions in an operative IT environmentCode Development – You ensure data engineering activities are aligned with scope, schedule, priority and business objectives. Oversee code development, unit and performance testing activities. Responsible to code and tech-lead the team to implement the solutionTesting – You will lead validation efforts by verifying the data at multiple middle stages that are being used between source and destination and assisting others in validating the solution performs as expected. Meet all operational readiness requirements (e.g., operations engineering, performance, and risk management)You will ensure compliance with applicable federal, state and local laws and regulations. Complete all required compliance training. Take responsibility to keep up to date with changing regulations and policiesMinimum RequirementsBachelor's in Computer Science, Mathematics or related field10 years of experience developing, testing, and implementing Extract, Transform and Load (ELT/ETL) solutions using enterprise ELT/ETL tools10 years of experience developing and implementing data integration, data lake and data warehouse solutions in an on-premise and cloud environment5 years of experience working with Business Intelligence tools7 years of experience working with API's, data as a service, data marketplace and data mesh10 years of experience with multiple Software Development Life Cycle methods such as Agile, SCRUM, Waterfall etcExperience building data pipelines and ETL jobs using IBM DataStage, Informatica, Matillion, FiveTran, Talend or DbtKnowledge of AWS cloud services such as S3, EMR, Lambda, Glue, Sage Maker, Redshift & Athena and SnowflakeExperienced in data modelling for self-service business intelligence, advanced analytics, and user applicationExperience with Data Science including AI/ML Engineering, ML framework/pipeline build and predictive/prescriptive analyticsExperience with migrating, architecting, designing, building cloud data lake, data warehouses (cloud/on-prem), data mesh, data as a service, and cloud data marketplaceExperience designing and building technical solutions using applicable technologies; ability to demonstrate data engineering skillsExperience with data model design, writing complex SQL queries and understand BI/DWH principlesExpertise in Relational Database Management System, Data Mart and Data Warehouse designExpert-level SQL development skills in a multi-tier environmentExpertise in flat file formats, XML within PL/SQL, and file format conversion#LI-AK1Learn MoreAbout AutodeskWelcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!Salary transparencySalary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, we also have a significant emphasis on discretionary annual cash bonuses, commissions for sales roles, stock or long-term incentive cash grants, and a comprehensive benefits package.Diversity & BelongingWe take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belongingAre you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site).
View Original Job Posting