Senior Big Data Engineer

Summary Posted: Sep 28, 2023 Weekly Hours: 40 Role Number: 200498608 Imagine what you could do here! At Apple, new ideas have a way of becoming extraordinary products, services, and customer experiences very quickly. Do you bring passion and dedication to your job? If so, we're looking for individuals like you! The Data Engineering team within Apple’s Audio and Media Technologies (AMT) Group plays a critical role in supporting the concept of data driven analytics by providing data collection, warehousing and analytics at big data scale. This team provides the infrastructure to power numerous trend and operational dashboards as well as other ad-hoc use cases in support of services like Apple TV+, Apple Music, Vision Pro, and FaceTime. We are looking for a talented and dedicated senior big data engineer to join our team to enhance, design and develop on our very high volume processing pipeline. This role offers the opportunity to work with other talented engineers within our team and external teams in an agile and dynamic environment that values engineering excellence, creativity and innovation. Key Qualifications Key Qualifications Experience in building large scale distributed systems in Java/Scala or other object-oriented languages with processing systems like Spark, Flink and Kafka Hands-on experience with managing and monitoring large scale data collection and analytics pipelines at the application level Experience in tuning and scaling Apache Kafka producer/consumer and Spark Structured Streaming applications Ability to conduct performance analysis and troubleshoot large scale distributed systems Should be able to understand complex architectures and be comfortable working with multiple teams Description Description As a Big Data Engineer, you are responsible for, contributing to the design and implementation of our streaming data pipeline and analytic components. Collaborate with data scientists on data transformation and modeling. Communicate effectively on features/functionalities of our processing pipeline to external teams. Work closely with first level support teams. Provide occasional after hours on-call support to handle urgent critical issues by working with first level support teams. You are expected to keep up with the latest data engineering trends and be able to apply the corresponding technologies to our processing pipeline as needed. This is an exciting opportunity to be able to work with other highly talented engineers on very large and rapidly growing data volume. Education & Experience Education & Experience BS/MS in CS/CE or equivalent with 3+ years of experience Additional Requirements Additional Requirements Nice to have but not required: - Proficient with SQL - Understanding of the concepts behind Data Warehouse - Experience with managing applications running under Kubernetes - Working knowledge of Trino and Iceberg - Experience with Log mining frameworks like Splunk, Prometheus, etc - Experience with deploying and managing CI pipeline with Jenkins or similar tools Pay & Benefits Pay & Benefits At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $138,900 and $256,500, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.