Under general direction, provides direct ongoing supervision to other IS Business Analysts (Data Engineers), serves as the top technical authority for data integration projects, provides technical leadership and direction and assumes technical responsibility for the completion of data projects; performs or oversees all or most of the phases of the data projects and ongoing administration functions, including data analysis, cost-benefit analysis, project planning and management, data project implementation and data validation, code migration to production, technical and procedural documentation, user training, and post-implementation assessment and administration.
Under general direction, the Senior Data Engineer will help meet ongoing needs for the development, maintenance and enhancement of the Human Services Agency’s data warehousing and data analytics requirements.
ESSENTIAL DUTIES AND FUNCTIONS
• Coordinating and conducting user analysis sessions to understand the business process, determine user demands & document requirements for the data team.
• Analyze and review requirements for new and existing data integration projects
• Design and evolve the data warehouse design using dimensional modeling for the data engineering team to meet the organizations data demands.
• Generate detailed low level design for data integration user stories.
• Build complex ETL/ELT packages and solutions to facilitate the data integration needs of the organization using Microsoft SSIS or Oracle Data Integrator (ODI).
• Perform unit testing and regression testing of data integration solutions developed in Microsoft SSIS & ODI.
• Collaborate with the Business Intelligence (BI) Engineer to evolve the BI metadata design and assist in maintaining the enterprise metadata model.
• Analyze and review current ETL/ELT jobs for performance, data latency and database resources in order to tune and redesign jobs as needed.
• Provide technical assistance in prioritizing and resolving operationalized ETL/ELT processes.
• Analyzing and developing complex ad hoc data extracts, reports to support decision makers.
• Ensuring data results are verified and data issues are debugged.
• Preparing user and technical manuals and instructions.
Location: San Francisco, CA
Posted: Aug. 28, 2024, 10:51 p.m.
Apply Now Company Website