We are looking for a Associate Lead Data Engineer to join our HDS teams in Bangalore. This is an amazing opportunity to work on HDS product line. The team consists of 40+ colleagues and is reporting to Anil Kumar, Sr Manager. We have a great skill set in Apache, AWS Glue, Spark and we would love to speak with you if you have skills in Big Data, Hadoop and above-mentioned technologies. About You – experience, education, skills, and accomplishments 5+ years’ experience in working in software development3+ years’ experience in building massively scalable distributed data processing solutions3+ years’ experience of database design & development.Building Data Pipelines & ETL jobs using cloud-native technologies & design patternsExperience in designing resilient systems & creating disaster recovery plansWorking in Master Data Management & designing CMSes, or evaluating 3rd party CMS productsWorking in Agile Scrum or Kanban teams & deploying solutions using Continuous Delivery best practicesUsing automated database migration tools & have strong opinions on version control best practices for SQL scriptIt would be great if you also had Apache Spark, ElasticSearchSpark, ElasticSearch, Cassandra, Hadoop, Apache Hive, Snowflake, Jupiter notebook, databricks stackPostgreSQL or Oracle DB experience, Oracle 11g+, PostgresSQL 9+, AWS RDSProficient in one or more of: Python, Scala, Java, Proficient in SQL, PL/SQL, XML, JSONWorking knowledge in one or more of: Java 6+, Python 2+, JavaScriptExperience in designing cloud-based data pipelines & solutionsAWS: EMR, AWS Glue, S3, EC2, RDS, Aurora PostgreSQL, Lambda.Also Kubernetes, schedulers, message queuesWhat will you be doing in this role? Provide technical thought leadership, compare different technologies to meet business requirements and cost control drivers.Work with Business and IT groups to design and deliver a data lake platform.Produce & maintain the overall solution design for the entire Data Lake Platform.Execution of data strategy, help in the design and architecture of solutions on the platformEnforce technical best practices for Big Data management and solutions, from software selection to technical architectures and implementation processes. Document and publish best practices, guidelines, and training information. Ensures all functional solutions and components of the Data Lake platform service are designed and implemented in a way to always meet SLAs. Contributes to the continuous improvement of the support & delivery functions by maintaining awareness of technology developments and making appropriate recommendations to enhance application services.Focus on data quality throughout the ETL & data pipelines, driving improvements to data management processes, data storage, and data security to meet the needs of the business and customersLead on technical investigations & proof of concepts, both individually and as part of a team, including being hands-on with code, to make technical recommendationsTake a lead role in setting up new project infrastructure, in collaboration with team lead & DevOps teamProduct you will be developing Within HDS we have few applications and solutions which address the healthcare market problems through advanced tools, valuable information, and data. The solutions help to get insights by understanding the market, Optimize the access and then Engage with the Customers. Market Landscape and Forecast, Patient Populations, which centers on Epidemiology, Treatment Analysis and Market Access answer key questions for Product Planning and Strategists, Market Researchers & Analyst, and Business Development to help them evaluate opportunities and understand their market landscape.About the Team Within HDS (HealthCare Data Solutions) we have a team size of 40+ colleagues who are working on applications catering to Bio-pharma and MedTech business units. HDS is part of Life Sciences Domain. The Technology team supporting these product lines is primarily based out of Bengaluru and few colleagues working from Pune, Noida and Gurgaon locations. Our Tech Stack includes Drupal, Angular, NodeJS, Java, SpringBoot, Sql Server, Postgres, .net framework, etc. We use microservices architecture and cloud-native tools/technologies that include EC2, S3, SQS etc. Hours of Work Full Time Employee, will work in ISTAt Clarivate, we are committed to providing equal employment opportunities for all persons with respect to hiring, compensation, promotion, training, and other terms, conditions, and privileges of employment. We comply with applicable laws and regulations governing non-discrimination in all locations.
View Original Job Posting