We are looking for Senior ETL Developer to join Data Engineering Team based in Bangalore. The candidate will be tasked with the development and maintenance of end-to-end data pipeline using modern, cutting-edge big data technologies and thereby enable rich content available to Cortellis products.About You – experience, education, skills, and accomplishments Bachelor's degree in engineering or master’s degree (BE, ME, B Tech, M Tech, MCA, MSAt least 5+ years of experience in building ETL pipelines and proficiency in PySpark.Must have a bachelor’s degree in Engineering or master’s degree (BE, ME, B Tech, M Tech, MCA, MS)Strong SQL and non-SQL database skills.Proficient in Python3 and experience with Apache Spark and/or Databricks.Passionate about code and software architecture.It would be great if you also have experience in . . . DockerAWS services: EC2, ECS, RDS, EMR, S3ElasticSearch, Presto, SnowflakeOracle, PostgreSQLTrifactaWhat will you be doing in this role?Providing technical leadership and guidance, evaluating various technologies to balance business needs and cost-effectiveness.Collaborating with business and IT teams to design and implement a data lake platform.Maintaining the overall solution architecture for the data lake platform.Establishing technical best practices for big data management and solutions, from technology selection to architecture and implementation.Ensuring all components of the data lake platform meet SLAs.Leading technical investigations, POCs, and hands-on coding to make technical recommendations.Mentoring and coaching team members to enhance their technical and professional skills.Product you will be developingCortellisAbout the Team The Data Engineering Team, a newly setup team in Life Sciences & Healthcare, aim to build a new end-to-end data pipeline to process data from Content hub to Cortellis products. We are currently a team of 8 and leverage modern, cutting-edge big data technologies to implement the new data pipeline. Our team has expertise in Rational Database Management System (Oracle, PostGres etc.), Python, Spark (PySpark, SparkSQL), Databricks, EMR, Airflow, AWSHours of Work Fulltime40 h/week( IST Hours)Hybrid working modelAt Clarivate, we are committed to providing equal employment opportunities for all persons with respect to hiring, compensation, promotion, training, and other terms, conditions, and privileges of employment. We comply with applicable laws and regulations governing non-discrimination in all locations.
View Original Job Posting