Senior Data Engineer

Job Description:Integral Ad Science (IAS) is a global technology and data company that builds verification, optimization, and analytics solutions for the advertising industry and we’re looking for A Senior Data Engineer to join our team. If you are excited by technology that has the power to handle hundreds of thousands of transactions per second; collect tens of billions of events each day; and evaluate thousands of data-points in real-time all while responding in just a few milliseconds, then IAS is the place for you!What you’ll get to do:Architect, design, code and maintain components for aggregating tens of billions of daily transactionsWork on Big Data technologies such as Spark, Spark streaming, Kafka, NoSql, EMR & other AWS tech stackContribute to the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for streaming & batch ETL and RESTful APIsProvide leadership, work collaboratively, and be a mentor in an awesome teamYou should apply if you have most of this:Bachelors or Masters in Computer Engineering, Computer Science, Electrical Engineering or related field5+ years of recent hands-on in Java5+ years of experience designing and building data pipelines and data-intensive applicationsExperience using Big Data frameworks (e.g.,Spark, Flink) , databases (e.g., NoSql, Delta Tables, Mysql / Postgres) for complex data assembly and transformationStrong knowledge of collections, multi-threading, JVM memory model, etc.In-depth understanding of algorithms, performance, scalability, and reliability in a Big Data settingSolid understanding of OLTP and OLAP systems, database fundamentalsSolid knowledge of SQLExperience in full software development, Agile, and CI/CDExperience building production level systems in AWS cloud environmentWhat puts you over the top:Experience with Spark streaming or FlinkFamiliarity with messaging frameworks like Kafka and / or NoSql databases (Aerospike, Cassandra)Orchestrating data pipelines using tools such as AirflowAbout Integral Ad Science Integral Ad Science (IAS) is a leading global media measurement and optimization platform that delivers the industry’s most actionable data to drive superior results for the world’s largest advertisers, publishers, and media platforms. IAS’s software provides comprehensive and enriched data that ensures ads are seen by real people in safe and suitable environments, while improving return on ad spend for advertisers and yield for publishers. Our mission is to be the global benchmark for trust and transparency in digital media quality. For more information, visit integralads.com.Equal Opportunity Employer:IAS is an equal opportunity employer, committed to our diversity and inclusiveness. We will consider all qualified applicants without regard to race, color, nationality, gender, gender identity or expression, sexual orientation, religion, disability or age. We strongly encourage women, people of color, members of the LGBTQIA community, people with disabilities and veterans to apply.California Applicant Pre-Collection Notice:We collect personal information (PI) from you in connection with your application for employment or engagement with IAS, including the following categories of PI: identifiers, personal records, commercial information, professional or employment or engagement information, non-public education records, and inferences drawn from your PI. We collect your PI for our purposes, including performing services and operations related to your potential employment or engagement. For additional details or if you have questions, contact us at compliance@integralads.com.To learn more about us, please visit http://integralads.com/ and https://muse.cm/2t8eGlNAttention agency/3rd party recruiters: IAS does not accept any unsolicited resumes or candidate profiles. If you are interested in becoming an IAS recruiting partner, please send an email introducing your company to recruitingagencies@integralads.com. We will get back to you if there's interest in a partnership.#LI-Hybrid