Summary Posted: Oct 16, 2023 Weekly Hours: 40 Role Number: 200509880 Do you believe generative models can transform smart assistants and creative workflows used by billions? Do you believe it can fundamentally shift how people interact with devices and communicate? We truly believe it can!
We are looking for highly skilled senior software engineers experienced in architecting and deploying test and validation infrastructure for consumer-facing products using large-scale client/server ML systems. You will play a critical role in designing and building LLMs online and offline validation infrastructure, tools, frameworks, and methodologies that enable product teams across Apple to develop state-of-the-art generative AI solutions that power amazingly intelligent user experiences on iPhone, Mac, Watch, iPad, and more.
We are the Intelligence System Experience (ISE) team within Apple’s software organization. The team works at the intersection between multimodal machine learning and system experiences. System Experience (Springboard, Settings), Keyboards, Pencil & Paper, Shortcuts are some of the experiences that the team oversees. These experiences that our users enjoy are backed by production scale ML workflows. Visual Understanding of People, Text, Handwriting & Scenes, multilingual NLP for writing workflows & knowledge extraction, behavioral modeling for proactive suggestions, and privacy preserving learning are areas our multi disciplinary ML teams focus on. Key Qualifications Key Qualifications 6+ years of proven expertise in software development with Java, Python, Swift, or Objective-C Strong software engineering skills to create scalable and robust infrastructure for testing generative AI systems, training and inference pipelines for on-device and server-side ML models. Fundamental knowledge of ML concepts and understanding of ML-based product lifecycle, model deployment and ML operations Familiarity with ML toolkits such as PyTorch, TensorFlow, SkLearn, etc. Hands-on experience in building test automation infrastructure, tools, and frameworks for large-scale AI/ML systems in device or cloud-based applications. Demonstrated experience in evaluating and testing machine learning systems, models. Familiarity with synthetic data generation, simulation, performance metrics, validation techniques, and statistical analysis. A passion for staying up-to-date with the latest advancements in generative AI models and their applications. Ability to quickly learn new technologies, build cross-functional partnerships, adapt to rapidly evolving project requirements, think creatively to solve complex challenges. Excellent verbal and written communication skills to effectively, collaborate with multidisciplinary teams. Ability to articulate complex technical concepts to both technical and non-technical stakeholders. Description Description This role will be responsible for defining and developing ML tests, frameworks and validation infrastructure for generative AI powered applications. You will collaborate with diverse cross-functional partners, including model developers, machine learning systems engineers, data scientists, iOS application developers, QE engineers and product managers. Our test infrastructure includes adopting or building new client and server CI pipelines, developing tests, designing scalable automation tools and frameworks that work on all Apple platforms. It allows cross-functional teams to conduct rigorous testing to ensure the accuracy, performance, reliability, and stability of future generative AI models across various products and use cases.
This role will also work closely with product and program teams to ensure tests and test systems are developed in lockstep with the new features and products roadmap. You will drive tool adoption among product and ML engineers by understanding and improving their workflows. This is a fast-paced role with high visibility, impact, and influence in delivering one of the industry's most advanced generative AI systems. Education & Experience Education & Experience BS/MS/PhD in Computer Science, Machine Learning or related fields Additional Requirements Additional Requirements Pay & Benefits Pay & Benefits At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $170,700 and $300,200, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits. Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.
View Original Job Posting