Lead Data Mesh Developer- MSI

Summary Posted: Oct 5, 2023 Weekly Hours: 40 Role Number: 200508074 Are you a passionate engineer with a product mindset? Do you want to help build a datamesh from the ground up? MSI is looking for a Lead Data Mesh engineer to help enable Apple to build ground breaking products! As our Lead Data Mesh Engineer, you are an integral part of a small data-centric team driving large-scale data infrastructure and processes development, implementation, and improvement. Our organization thrives on collaborative partnerships. Join and play a key role in developing and driving the adoption of Data Mesh and data-centric micro-services. Apple's Manufacturing Systems and Infrastructure (MSI) team is responsible for capturing, consolidating and tracking all manufacturing data for Apple’s products and modules worldwide. Our tools enable teams to confidently use data to shape the next generation of product manufacturing at Apple. We seek a practitioner with experience building large-scale data platforms, analytic tools, and solutions. If you are passionate about making data easily accessible, trusted, and available across the entire business at scale, we'd love to hear from you. Key Qualifications Key Qualifications 7+ years of work experience in Java, Scala, Kotlin Python, Elixir, Rust, or equivalent programming language Software engineering or data engineering experience through the full software development lifecycle Deep SQL expertise, data modeling, and data governance in relational databases Working with multiple data storage and analysis toolsets—including current distributed technologies: Druid, Snowflake, SparkSQL, Presto, Hive, Kafka, Redshift or analogous architectures a plus. Experience using ETL/ELT tools and technologies: Reltio, Stibo, Informatica, Apache Atlas, Linkedin DataHub, Lyft Amundsen, Netflix Metacat or Uber Databook or DBT a plus Solid grasp of using cloud native solutions and Data Security on Cloud based applications Building data streaming solutions using Apache Spark (both batch and streaming), Storm/Flink/Flume preferred as well Experience in handling architectural and design considerations such as performance, scalability, reusability and flexibility issues. Envision and expertly express the benefits and constraints of technology solutions to technology partners, business partners, and team members Active contributions to open source projects is a plus. Description Description We are evolving our core data platform including: - How data is collected, moved, stored, and processed - What data is collected and where it is stored - How to apply machine learning across large datasets As a part of our team, you’ll be responsible for: - Driving design and development of data models - Implementation and delivery of Enterprise Data Mesh solution for interoperability among various data sets - Innovation: you'll explore data-centric platform technologies and implement the technologies that you recommend - Spotting and implementing optimizations across data usage from multidisciplinary teams - Ensuring data health & quality through monitoring and alerting tools - Planning robust systems that gracefully recover from outages and system issues - Provide support for both Analytics and Operational Platforms Education & Experience Education & Experience BS, MS, or PhD in Computer Science, Computer Engineering, relevant technical field or equivalent experience. Additional Requirements Additional Requirements - Experience with data visualization frameworks such as D3 - Knowledge in Kubernetes Pay & Benefits Pay & Benefits At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $161,700 and $243,300, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.