Staff Data Engineer

Job Description:As a Staff Data Engineer you will design, implement, and maintain big data pipelines responsible for aggregating tens of billions of daily transactions. You will be part of a growing team to develop and mature  IAS’ capability in video ad verification, analytics and anti ad fraud software products. The ideal candidate is naturally curious, dedicated, detailed-oriented with a strong desire to work with awesome people in a highly collaborative environment. You should be able to not take yourself too seriously as well.What you’ll get to do:Architect, design, code and maintain components for aggregating tens of billions of daily transactionsWork on Big Data technologies such as Hadoop, MapReduce, Kafka, and/or Spark in columnar databases on AWSContribute to the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for streaming & batch ETL and RESTful APIsProvide leadership, work collaboratively, and be a mentor in an awesome teamYou should apply if you have most of this:Bachelors or Masters in Computer Engineering, Computer Science, Electrical Engineering or related field8+ years of recent hands-on in object oriented language (Java, Scala, Python)5+ years of experience designing and building data pipelines and data-intensive applicationsExperience using Big Data frameworks (e.g., Hadoop, Spark) , databases (e.g., RedShift, Snowflake) for complex data assembly and transformationStrong knowledge of collections, multi-threading, JVM memory model, etc.In-depth understanding of algorithms, performance, scalability, and reliability in a Big Data settingSolid understanding of OLTP and OLAP systems, database fundamentalsSolid knowledge of SQLExperience in full software development, Agile, and CI/CDExperience building production level systems in a cloud environment (AWS, Azure or GCP)What puts you over the top:Familiarity with Databricks platformKnowledge of Machine Learning development processesFamiliarity with Graph databases/platformsExperience with Spark streaming or FlinkAbout Integral Ad Science Integral Ad Science (IAS) is a leading global media measurement and optimization platform that delivers the industry’s most actionable data to drive superior results for the world’s largest advertisers, publishers, and media platforms. IAS’s software provides comprehensive and enriched data that ensures ads are seen by real people in safe and suitable environments, while improving return on ad spend for advertisers and yield for publishers. Our mission is to be the global benchmark for trust and transparency in digital media quality. For more information, visit integralads.com.Equal Opportunity Employer:IAS is an equal opportunity employer, committed to our diversity and inclusiveness. We will consider all qualified applicants without regard to race, color, nationality, gender, gender identity or expression, sexual orientation, religion, disability or age. We strongly encourage women, people of color, members of the LGBTQIA community, people with disabilities and veterans to apply.California Applicant Pre-Collection Notice:We collect personal information (PI) from you in connection with your application for employment or engagement with IAS, including the following categories of PI: identifiers, personal records, commercial information, professional or employment or engagement information, non-public education records, and inferences drawn from your PI. We collect your PI for our purposes, including performing services and operations related to your potential employment or engagement. For additional details or if you have questions, contact us at compliance@integralads.com.To learn more about us, please visit http://integralads.com/ and https://muse.cm/2t8eGlNAttention agency/3rd party recruiters: IAS does not accept any unsolicited resumes or candidate profiles. If you are interested in becoming an IAS recruiting partner, please send an email introducing your company to recruitingagencies@integralads.com. We will get back to you if there's interest in a partnership.#LI-Hybrid