Senior Big Data Engineer

Back to jobs Senior Big Data Engineer Tel Aviv, Israel Apply Who are we DoubleVerify is an Israeli-founded big data analytics company (Stock: NYSE: DV). We track and analyze tens of billions of ads every day for the biggest brands in the world. We operate at a massive scale, handling over 100B events per day and over 1M RPS at peak, we process events in real-time at low latencies (ms) and analyze over 2.5M video years every day. We verify that all ads are fraud free, appear next to appropriate content, appear to people in the right geography and measure the viewability and user’s engagement throughout the ad’s lifecycle.  We are global, with HQ in NYC and R&D centers in Tel Aviv, New York, Finland, Berlin, Belgium and San Diego. We work in a fast-paced environment and have a lot of challenges to solve. If you like to work in a huge scale environment and want to help us build products that have a huge impact on the industry, and the web - then your place is with us.   What you will do You will work in a team of data and backend engineers producing user attentiveness insights and recommendations that help big brands optimize their digital advertising strategy.  You will process 10’s of billions of records a day using mainly Python and Scala, utilizing advanced technologies like Spark, Kafka, Docker, Kubernetes, DataBricks and GCP managed solutions.  You will build data pipelines that integrate with internal and external data sources from various platforms to enhance business insights while keeping standards high with testing, automated deployment and high degree of observability.  You will be responsible for defining solutions and delivering them while collaborating with engineering & product teams on productionizing & monitoring your solutions. You will explore, implement and support multiple data initiatives and projects at the same time.   What you need to have At least 4 years in Software Development At least 3 years experience coding in Python\Java\C#\Scala and a like At least 3 years of experience working with relational databases  At least 2 years of experience building ETLs or ELTs Good analytical skills and well-versed with SQL Good interpersonal and communication skills Passion for development with high quality and a sharp mind Experience maintaining business-critical production systems   Nice to have Experience with Python  Experience with CI/CD pipeline, Docker & Kubernetes, public cloud providers Experience with Spark  Experience with non-relational DB Experience with streaming processing Experience with online advertising technologies #Hybrid  Create a Job Alert Interested in building your career at DoubleVerify? Get future opportunities sent straight to your email. Create alert Apply for this job * indicates a required field Autofill with Greenhouse First Name * Last Name * Email * Phone * Resume/CV * Attach Attach Dropbox Google Drive Enter manually Enter manually Accepted file types: pdf, doc, docx, txt, rtf Cover Letter Attach Attach Dropbox Google Drive Enter manually Enter manually Accepted file types: pdf, doc, docx, txt, rtf Education School Select... Degree Select... Discipline Select... Start date year End date year Add another LinkedIn Profile Website Now or in the future, will you require sponsorship? * Where did you first learn about this opportunity? (If you were referred, please note individual's name) * Did you meet with anyone from DoubleVerify at a conference or event recently? * Let us know where you saw DV Did you know that there is a DoubleVerify Engineering blog? * Select... Check out the DV Engineering Blog What are your compensation expectations for this role? * Submit application