Staff Data Engineer

Job Description:Integral Ad Science (IAS) is a global leader in digital media quality. IAS makes every impression count, ensuring that ads are viewable by real people, in safe and suitable environments, activating contextual targeting, and driving supply path optimization.Our mission is to be the global benchmark for trust and transparency in digital media quality for the world’s leading brands, publishers, and platforms. We do this through data-driven technologies with actionable real-time signals and insight. Founded in 2009 and headquartered in New York, IAS works with thousands of top advertisers and premium publishers worldwide. For more information, visit integralads.com or email us at careers@integralads.com.As a Staff Data Engineer you will design, implement, and maintain big data pipelines responsible for aggregating tens of billions of daily transactions. You will be part of a growing team to develop and mature  IAS’ capability in video ad verification, analytics and anti ad fraud software products. What you’ll get to do:Architect, design, code and maintain components for aggregating tens of billions of daily transactionsWork on Big Data technologies such as Hadoop, MapReduce, Kafka, and/or Spark in columnar databases on AWSContribute to the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for streaming & batch ETL and RESTful APIsProvide leadership, work collaboratively, and be a mentor in an awesome teamYou should apply if you have most of this:Bachelors or Masters in Computer Engineering, Computer Science, Electrical Engineering or related field8+ years of recent hands-on experience with an object oriented language (Java, Scala, Python)8+ years of experience designing and building data pipelines and data-intensive applicationsExperience using Big Data frameworks (e.g., Hadoop, Spark) , databases (e.g., RedShift, Snowflake) for complex data assembly and transformationStrong knowledge of collections, multi-threading, JVM memory model, etc.In-depth understanding of algorithms, performance, scalability, and reliability in a Big Data settingSolid understanding of OLTP and OLAP systems, database fundamentalsSolid knowledge of SQLExperience in full software development, Agile, and CI/CDExperience building production level systems in a cloud environment (AWS, Azure or GCP)What puts you over the top:Orchestrating data pipelines using tools such as AirflowFamiliarity with messaging frameworks like Kafka or RabbitMQExperience with Spark streaming or FlinkNew York Applicants: The salary range for this position is $154,000 - $231,000, actual pay may vary based on experience or geographic location.About Integral Ad Science Integral Ad Science (IAS) is a global leader in digital media quality. IAS makes every impression count, ensuring that ads are viewable by real people, in safe and suitable environments, activating contextual targeting, and driving supply path optimization.Our mission is to be the global benchmark for trust and transparency in digital media quality for the world’s leading brands, publishers, and platforms. We do this through data-driven technologies with actionable real-time signals and insight. Founded in 2009 and headquartered in New York, IAS works with thousands of top advertisers and premium publishers worldwide. For more information, visit integralads.com or email us at careers@integralads.com.Equal Opportunity Employer:IAS is an equal opportunity employer, committed to our diversity and inclusiveness. We will consider all qualified applicants without regard to race, color, nationality, gender, gender identity or expression, sexual orientation, religion, disability or age. We strongly encourage women, people of color, members of the LGBTQIA community, people with disabilities and veterans to apply.California Applicant Pre-Collection Notice:We collect personal information (PI) from you in connection with your application for employment or engagement with IAS, including the following categories of PI: identifiers, personal records, commercial information, professional or employment or engagement information, non-public education records, and inferences drawn from your PI. We collect your PI for our purposes, including performing services and operations related to your potential employment or engagement. For additional details or if you have questions, contact us at compliance@integralads.com.To learn more about us, please visit http://integralads.com/ and https://muse.cm/2t8eGlNAttention agency/3rd party recruiters: IAS does not accept any unsolicited resumes or candidate profiles. If you are interested in becoming an IAS recruiting partner, please send an email introducing your company to recruitingagencies@integralads.com. We will get back to you if there's interest in a partnership.#LI-Hybrid