Big Data Engineer

Big Data EngineerDescription -Does unlocking value from data using leading edge technology get you excited? Then come join us in our transformative journey in HP Print to capitalize on the benefits of a common data platform.DataOS is both an organization in HP Print Software and a big data platform. We are strategically aligned with the HP data strategy to enable and accelerate efficient delivery of business value from big data. Our platform provides the technology enablers, building blocks, operations, and data-as-a-service that power analytic insights across the Print business. We are the System of Record for HP telemetry data, enable combining product and HP Business data, and are leading the evolution of big data technology.In this role, you will develop big data solutions and data products using industry leading technologies, solve complex problems where analysis of situations or data requires in-depth evaluation of multiple factors. Leads and/or provides expertise to project teams and participates in cross-functional initiatives. Acts as an expert providing direction and guidance to process improvements and establishing policies. Frequently represents the organization to external customers/clients. Exercises significant independent judgment within broadly defined policies and practices to determine best method for accomplishing work and achieving objectives. ResponsibilitiesDesign and develop large scale, high-volume, high-performance and secure data processing pipelines with large sets of data from different sources. Integrate big data tools and frameworks to provide capabilities required by business functions, while keeping in mind of cost optimizations.Leads one or more project teams through all stages of complex, secure and performant data solutions development, including analysis, design, coding, testing, integration and monitoring.Reviews and evaluates product designs for architecture soundness, security and privacy compliance, and following quality guidelines and standards; provides tangible feedback to improve product quality and mitigate risk.Writes quality code complete with testing, logging, and documentation for assigned portion of data system or component; identifies defects and fix.Builds and manages relationships throughout the organization. Provides domain-specific expertise and overall data systems leadership and perspective to cross-organization projects, programs, and activities. Represents the data engineering team for all phases of larger and more-complex development projects.Drives innovation and integration of new technologies into projects and activities in the big data space.Provides guidance and mentoring to less experienced staff members.Knowledge & SkillsMust HaveExtensive experience with data engineering tools, languages, frameworks to mine, cleanse and explore data.Strong experience in overall architecture of big data systems, cloud services/systems.Strong analytical and problem-solving skills with ability to represent complex algorithms in software6+ years of experience with software development and mastery of software development fundamentals 3+ years of hands-on experience developing high availability, scalable, medium to large scale ETL data processing pipelines with Java/Python or ScalaProficient understanding of big data distributed computing principles, AWS Architecture, and expert level SQL developerExperience with Github, Apache Spark, AWS building blocks (S3, RDS, SQS, EKS, Lambda etc.), Microservices/Rest API, Docker and Kubernetes, RedShift and Aurora MySQL, logging framework such as ELK or Splunk Passion for quality and attention to detailsAbility to effectively communicate across both technical and business audiencesAbility to work independently under a fast-paced environment and deliver results under pressureNice to HaveSpark, Databricks or Jupyter notebooks experienceAirflow experienceDBT experienceTerraform experience​Familiar with visualization tools like Looker, ThoughtSpot or PowerBIEducation & ExperienceBachelor's or Master's degree in Computer Science, or equivalent7 - 10 years relevant software development expertiseHP occasionally offers work authorization sponsorship for critical need roles. However, this opportunity currently does not offer work authorization sponsorship.HP offers a comprehensive benefits package, including:Dental insuranceDisability insuranceEmployee assistance programFlexible scheduleFlexible spending accountHealth insuranceLife insurance Our compensation reflects the cost of labor across several U.S. geographic markets, and we pay differently based on those defined markets. The typical base pay range for this role across the U.S. is $118,050 -- $171,200 annually with additional opportunities for pay in the form of bonus and/or equity. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process.Job -SoftwareSchedule -Full timeShift -No shift premium (United States of America)Travel -NoRelocation -YesEqual Opportunity Employer (EEO) - HP, Inc. provides equal employment opportunity to all employees and prospective employees, without regard to race, color, religion, sex, national origin, ancestry, citizenship, sexual orientation, age, disability, or status as a protected veteran, marital status, familial status, physical or mental disability, medical condition, pregnancy, genetic predisposition or carrier status, uniformed service status, political affiliation or any other characteristic protected by applicable national, federal, state, and local law(s).Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.If you’d like more information about HP’s EEO Policy or your EEO rights as an applicant under the law, please click here: Equal Employment Opportunity is the Law Equal Employment Opportunity is the Law – Supplement