Our CompanyChanging the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours! The Opportunity We are seeking a skilled and experienced Databricks ETL Developer to join our dynamic data engineering team. As a Databricks ETL Developer, you will be responsible for designing, developing, and maintaining efficient ETL pipelines using Databricks to transform raw data into meaningful insights. Your work will directly contribute to our data-driven decision-making processes and help optimize our data infrastructure.What you'll Do ETL Development: Design, develop, and implement end-to-end ETL processes using Databricks to extract data from various sources, perform necessary transformations, and load it into target systemsData Transformation: Collaborate with data analysts and business stakeholders to understand data requirements and translate them into efficient transformation logic. Ensure data quality, accuracy, and consistency throughout the ETL process.Performance Optimization: Tune and optimize Databricks jobs and clusters to achieve optimal performance and minimize processing time. Identify and resolve bottlenecks in data processing.Data Integration: Work with cross-functional teams to integrate data from multiple sources, both structured and unstructured, to create a unified view for reporting and analytics.Data Quality Assurance: Implement data quality checks and validation mechanisms at various stages of the ETL pipeline to identify and rectify data anomalies and inconsistencies.Monitoring and Maintenance: Monitor ETL processes, troubleshoot and resolve issues in a timely manner. Implement error handling, logging, and alert mechanisms to ensure robust and reliable data pipelines.Documentation: Create and maintain comprehensive documentation for ETL processes, including data lineage, transformations, dependencies, and scheduling details.Collaboration: Collaborate with data scientists, analysts, and other stakeholders to understand their data requirements and provide support in data provisioning and integration.Best Practices: Stay up-to-date with industry best practices and emerging trends in data engineering, Databricks, and cloud technologies. Apply these insights to continuously improve ETL processes and overall data architecture.What you need to succeed Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree is a plus.6-8 years of relevant experience.Proven experience as an ETL Developer with a strong focus on Databricks, Apache Spark, and cloud-based data platforms (e.g., AWS, Azure, Google Cloud).Proficiency in SQL for data querying and transformation.Hands-on experience in building complex ETL pipelines using Databricks notebooks, Spark SQL, and other relevant tools.Strong understanding of data modelling concepts and data warehousing principles.Familiarity with version control systems (e.g., Git) and CI/CD practices for ETL code.Excellent problem-solving skills and attention to detail.Effective communication skills to collaborate with cross-functional teams and convey technical concepts to non-technical stakeholders.Experience with programming languages such as Python or Scala is a plus.Certifications in Databricks or relevant cloud platforms are advantageous.Benefits:Opportunities for professional growth and skill development.Work in a collaborative and innovative environment.Exposure to cutting-edge technologies in data engineering and analytics.If you are a passionate Databricks ETL Developer with a proven track record of designing and implementing robust ETL solutions, we encourage you to apply and join our team of skilled data professionals. Your contributions will play a crucial role in shaping our data-driven strategies and enhancing our data infrastructureOpportunity and affirmative action employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more.Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com or call (408) 536-3015.Adobe values a free and open marketplace for all employees and has policies in place to ensure that we do not enter into illegal agreements with other companies to not recruit or hire each other’s employees.Adobe is proud to be an Equal Employment Opportunity and affirmative action employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more. Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com or call (408) 536-3015.Adobe values a free and open marketplace for all employees and has policies in place to ensure that we do not enter into illegal agreements with other companies to not recruit or hire each other’s employees.
View Original Job Posting