Senior Software Developer, Big Data

Job Requisition ID #24WD77870Position OverviewAutodesk is looking for a Senior Software Developer, Big Data with experience building data pipelines to join our Enterprise Data Engineering & Visualisation (EDEV) team. The EDEV Team is chartered with building data pipelines and solutions that allow our users to obtain important business insights. These solutions serve as the building blocks for all data engineers, data scientists and data analysts throughout the organisation. Also, this team establishes and promotes data engineering best practices across Autodesk, leading efforts to make data an integral part of decision-making at Autodesk. You will build data solutions for complex data transformation pipelines, and lending technical expertise within the group.You will report to Senior Software Development Manager based in the US. This role is based out of Toronto, in a hybrid mode. Autodesk supports FLEX working model.ResponsibilitiesAutomate data transformations against data sourced from a variety of systems including desktop, web, and mobile product usage logs and business systems dataDevelop solutions applying CI/CD processes to orchestrate automated batch and NRT (Near Real Time) pipelines running PySpark and dbt data transformations using Apache AirflowUse programming languages used for data manipulation, including SQL, Python, Spark, PySpark, Spark SQL, Java, JinjaDesign, develop, execute, and document software solutions to address complex data collection, processing, transformation, and testingCollaborate with peer organisations, DevOps, support organisations on technical issues and help troubleshoot code level problems and performance issuesRecommend architectural standards, best practices and quality assurance processes for data related systems and applicationsBuild data quality and durability tracking mechanisms to provide visibility into and address changes in data ingestion, processing, and storageLead and/or help design data schemas to ensure common protocols and storage mechanisms are used across all data servicesPartner with data and software architects to design data models, APIs or other architectural elementsMinimum Qualifications5 years of experience in cloud ETL, ELT and near-real time data collection, transport, and processing technologies3+ years of experience with data modeling, including the design of schemas optimized for data retrieval5+ year of experience in programming with SQL, Python, Spark, PySpark, Spark SQL, Java, Jinja and related languages3+ years of experience working with a big data environment including Hadoop, Hive, Spark and PrestoExperience creating detailed technical documentation which addresses business requirementsExperience architecting and implementing data testing solutionsExperience working with a big data environment including Hadoop, Hive, Spark and PrestoProficiency in building data transformation and analysis using PySpark and dbtExperience working with workflow management tools, like Airflow and AzkabanExperience working with GitHub, Jira, and JenkinsFamiliarity with data governance frameworks, SDLC (Software Development Life Cycle), and Agile methodologyStrong technical and problem-solving skills and continuous interest in learning best of class technologies around data warehousing, data wrangling, data quality, data governance and data ethicsLearn MoreAbout AutodeskWelcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!Salary transparencySalary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, we also have a significant emphasis on discretionary annual cash bonuses, commissions for sales roles, stock or long-term incentive cash grants, and a comprehensive benefits package.Diversity & BelongingWe take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belongingAre you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site).