Senior Data Engineer

New Senior Data Engineer India Apply About Us Udacity is now an Accenture company, and exciting things are happening! 🚀 We are on a mission of forging futures in tech through radical talent transformation in digital technologies. We offer a unique and immersive online learning platform, powering corporate technical training in fields such as Artificial Intelligence, Machine Learning, Data Science, Autonomous Systems, Cloud Computing and more. Our rapidly growing global organization is revolutionizing how the enterprise market bridges the talent shortage and skills gaps during their digital transformation journey. Data Driven is a Udacity core value. Udacity Data Engineering Team is looking for a Software Engineer to help us to design and develop Udacity’s company-wide data solutions in support of that value. The ideal candidate will be comfortable talking to data analysts, data scientists and business stakeholders, understand the data that powers their products, generalize it and implement common fact tables across the company.  This is a high-impact opportunity and you’ll be a part of a global Data Team of highly talented Software Engineers, Data Analysts and Data Scientists based primarily in India and North America. The system you will be working on consists of a cloud-based data lake and is built completely on a cloud-native environment on AWS, using technologies such as Apache Spark, Airflow, Postgres and Redshift.  About Udacity Data Engineering  We prioritize the quality and trustworthiness of the data  We embrace common and proven software engineering practices to achieve quality while maximizing the productivity  We promote collective and shared ownership of our technical assets We value the flexibility needed in working in a global while balance and minimize non-work hour involvement in all locations  How You Can Help  Design and develop infrastructure and tools for the systems powering all of Udacity’s data, analytics and reporting  Work with analysts to generalize the data points behind their work to form multi-dimensional data stores  Building out the lakehouse for analytics, machine learning and AI use cases with strong focus on accuracy and reliability using technologies such as Spark, Airflow, dbt and Iceberg on AWS  Working with stakeholders from other departments and successfully translating their requirements to engineering solutions  Being a champion and thought leader of effective agile software development practice and producing high quality readable code in such a setting  What We Need From You  BS or MS in Computer Science , MIS or related degrees  6+ years of experience working in the software industry, with at least 3 of which in data engineering Solid understanding and experience practicing Agile software development methodologies such as test driven development  Good understanding in the principles of building robust data processing pipeline and track record of putting them in practice  Proven ability to trace, identify and resolve issue in data, infrastructure and code Hands-on experience working with Apache Spark, cloud data storage and relational databases  Hands-on experience working on cloud platforms, preferably AWS Proficiency in Python, Scala and SQL  Experience working with generative AI is desired  Experience working with US or Europe based remote teams is a strong plus Benefits: Experience a rewarding work environment with Udacity's perks and benefits! At Udacity, we offer you the flexibility of working from home. We also have in-person collaboration spaces in Mountain View, Cairo, Dubai and Noida and continue to build opportunities for team members to connect in person Flexible working hours Paid time off Comprehensive medical insurance coverage for you and your dependents Employee wellness resources and initiatives (access to wellness platforms like Headspace) Quarterly wellness day off Personalized career development Unlimited access to Udacity Nanodegrees Compensation at Udacity, an Accenture company, varies depending on a wide array of factors, which may include but are not limited to location, role, skill set, and level of experience. As required by local law, Udacity, an Accenture company, will provide a reasonable range of compensation.  We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.  Accenture Equal Opportunity Statement Udacity, an Accenture company, is an EEO and Affirmative Action Employer of Veterans/Individuals with Disabilities, and is committed to providing veteran employment opportunities to our service men and women. Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States. Candidates who are currently employed by a client of Accenture or an affiliated Accenture business may not be eligible for consideration. Job candidates will not be obligated to disclose sealed or expunged records of conviction or arrest as part of the hiring process. Further, at Accenture a criminal conviction history is not an absolute bar to employment.    Udacity's Values   Obsess over Outcomes - Take the Lead - Embrace Curiosity - Celebrate the Assist    Udacity's Terms of Use and Privacy Policy   Create a Job Alert Interested in building your career at Udacity? Get future opportunities sent straight to your email. Create alert Apply for this job * indicates a required field Autofill with Greenhouse First Name * Last Name * Email * Phone Resume/CV Attach Attach Dropbox Google Drive Enter manually Enter manually Accepted file types: pdf, doc, docx, txt, rtf Cover Letter Attach Attach Dropbox Google Drive Enter manually Enter manually Accepted file types: pdf, doc, docx, txt, rtf LinkedIn Profile Website Are you a current or former Udacity employee? * Select... Full Legal Name * Voluntary Self-Identification For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file. As set forth in Udacity’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law. Gender Select... Are you Hispanic/Latino? Select... Race & Ethnicity Definitions If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows: A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability. A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service. An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense. An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985. Veteran Status Select... Voluntary Self-Identification of Disability Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 04/30/2026 Why are you being asked to complete this form? We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years. Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp . How do you know if you have a disability? A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to: Alcohol or other substance use disorder (not currently using drugs illegally) Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS Blind or low vision Cancer (past or present) Cardiovascular or heart disease Celiac disease Cerebral palsy Deaf or serious difficulty hearing Diabetes Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders Epilepsy or other seizure disorder Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome Intellectual or developmental disability Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD Missing limbs or partially missing limbs Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS) Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities Partial or complete paralysis (any cause) Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema Short stature (dwarfism) Traumatic brain injury Disability Status Select... PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete. Submit application