This is a remote position that could be based anywhere in the United States or Canada.Calix is looking for a Devops Engineer with expertise in building large data platforms. This engineer will report to the Senior Manager, Devops on the Calix Cloud Infrastructure team.Responsibilities and Duties:Building and optimizing data pipelines to facilitate the extraction of data from multiple sources and load it into the data lake. Work with Developers, DevOps, Data Scientists, and Quality Engineers to build reliable services from design to production.Identify the bottlenecks and scale issues at early stages in HA big-data systems.Using automation to streamline data processing. To reduce development time and increase data reliability, Automate the data ETL jobs. Help the team to understand the bottlenecks in the ETL jobs etc. Manage and optimize analytical Query Engines, such as PrestoDB, Hive, Spark SQL, and others.Qualifications:Calix requires all employees based in North America who will work onsite at a Calix office, attend in-person meetings, and/or travel on behalf of Calix to be fully vaccinated. Calix will consider requests for reasonable accommodations as required under applicable law.Experience with data warehouse tools such as Redshift , Greenplum Experience with building data lake infrastructure.Experience with managing and designing large scale ETL tools such as sparkExperience with the data lake platforms such as Hudi.Experience building the orchestration platforms such as Airflow , Argo Workflow Experience with Kubernetes , AWS infrastructure Expertise including the Spark , Athena , Presto , Alluxio, Hive and frameworks such as Apache Hudi, EMR, etc. Location:Remote-based position located in the United States or Canada.#LI-Remote
View Original Job Posting