Data Engineer

Our CompanyChanging the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours! The Opportunity A Data Engineer specializing in reporting and dashboarding, you would be responsible for designing and developing the front-end and back-end components of reporting and dashboarding systems.As a Data Engineer with 6-8 years of experience you will need to handle end-to-end aspects of data engineering like critical data analysis, data model/architecture designing, complex querying, developing ETLs using Spark, testing, support of data warehouse on Databricks, dashboarding using PowerBI. Also experience in working with different data warehousing technologies such as, Azure Blob, Hive, Snowflake, and Databricks would be preferrable.What you'll Do Understand Requirements:Collaborate with stakeholders, such as business analysts and product managers, to understand the requirements of the reporting and dashboarding system.Identify the key metrics, data sources, visualizations, and user interface elements that need to be incorporated.Design the Architecture:Determine the most suitable architecture for the reporting and dashboarding system based on the requirements.Decide on the front-end and back-end technologies, frameworks, and libraries to be used.Define the data storage and retrieval mechanisms for efficient reporting and dashboarding.Develop the Back-End:Implement the server-side components responsible for data processing, data retrieval, and business logic.Integrate with relevant data sources, such as databases, APIs, or data warehouses.Implement data aggregation, transformation, and modelling as per the reporting requirements.Ensure data security, privacy, and compliance measures are implemented.Develop the Front-End:Design and implement the user interface for the reporting and dashboarding system.Create visually appealing and intuitive dashboards using appropriate front-end technologies (such as Power BI)Incorporate interactive data visualizations and charts for effective data representation.Implement user authentication, access control, and customization options for personalized dashboards.Implement Data Visualization:Develop interactive charts, graphs, and other visualizations to present data insights.Ensure responsiveness and compatibility across different devices and browsers.Optimize Performance:Optimize data retrieval, processing, and rendering for improved performance.Implement caching mechanisms, data indexing, or other performance-enhancing techniques.Conduct performance testing and optimization to ensure smooth user experience.Test and Debug:Conduct thorough testing of the reporting and dashboarding system, including unit testing, integration testing, and user acceptance testing.Identify and resolve any bugs, issues, or performance bottlenecks.Perform cross-browser and cross-device compatibility testing.Deploy and Maintain:Deploy the reporting and dashboarding system to the appropriate production environment.Monitor system performance, data integrity, and security.Provide ongoing maintenance, bug fixes, and enhancements as needed.Stay updated with emerging technologies and trends in reporting and dashboarding for continuous improvementRemember to collaborate closely with the stakeholders throughout the development process to ensure the final product meets their requirements and provides valuable insights through robust reporting and intuitive dashboards.Good to haveExperience with developing API services, using Python, Docker, KubernetesKnowledge of Machine Learning concepts and practical implementation.Experience with Cloud architectures especially on Azure.Opportunity and affirmative action employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more.Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com or call (408) 536-3015.Adobe values a free and open marketplace for all employees and has policies in place to ensure that we do not enter into illegal agreements with other companies to not recruit or hire each other’s employees.Adobe is proud to be an Equal Employment Opportunity and affirmative action employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more. Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email accommodations@adobe.com or call (408) 536-3015.Adobe values a free and open marketplace for all employees and has policies in place to ensure that we do not enter into illegal agreements with other companies to not recruit or hire each other’s employees.