We are a Firm where people truly believe in what they do and strive to achieve the highest standards of performance and success.
General Description:
The Data Solutions Senior Engineer supports the development and management of the Firm’s data warehouse / lakehouse, data analytics platforms, and related processes. This role contributes to the implementation and on-going support of the firm’s cloud data systems and analytics tools and processes.
The Engineer works with technology, knowledge, business services, and practice teams to discover the firm’s key operational data, assess intelligence and analytics needs, develop and communicate plans for data lake and analytics platform implementation, execute technical implementation of data platforms, and provide ongoing service, support, and planning for continued enhancements and user engagement. This role within our Data Strategy function partners closely with the Information Technology department and data and intelligence solutions teams in the development and delivery of the firm’s data platforms. This role contributes to digital transformation programs, provides technical and business process support, and serves as a contact for internal resources, such as the Information Technology department, as well as external resources including vendors and consultants.
Key Responsibilities and Essential Job Functions:
• Support the design, development, and maintenance of data platforms. This role will be responsible for configuring and maintaining data warehouse / lakehouse and related code base and schemas for the firm, including integrations with Finance, HR, Marketing, and other firm-related database applications.
• Develop, document, and maintain key data integration processes in support of projects and ongoing services. Provide data integration services in support of local and hosted environments for enterprise applications including the use of APIs and other connection methods.
• Design, implement and maintain scalable and reliable data pipelines, data quality and transformation processes, and databases to support a variety of data and analytics needs.
• Designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure services.
• Managing and optimizing data storage using Azure Data Lake Storage and Azure SQL Data Warehouse.
• Developing data models and maintaining data architecture to support data analytics and business intelligence reporting.
• Ensuring data quality and consistency through data cleaning, transformation, and integration processes.
• Proactive monitoring and troubleshooting data-related issues within the Azure environment to maintain high availability and performance.
• Collaborating with data scientists, business analysts, and other stakeholders to understand data requirements and implement appropriate data solutions.
• Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information.
• Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks.
• Support the appropriate sourcing, evaluation, selection, and utilization of data engineering tools, particularly emerging artificial intelligence-enabled products.
• Support the custom development and implementation of proprietary Machine Learning, LLM and AI enabled products, including the selection and engagement of solutions partners, development of grounding, RAG, vectorizing, and related technical protocols and procedures. Support to use-case evaluation and product design and implementation.
• Optimize data processing systems to enhance performance, improve reliability and optimize cost.
• Participate in cross-functional relationships with software engineers, solutions engineers, and other business stakeholders to collaboratively create solutions, development standards, and support business processes.
• Partner with the broader Data Strategy team in the development and maintenance of a comprehensive and up-to-date data catalog by overseeing the capture of end-to-end data flows and the creation of source-to-target documentation, ensuring a detailed and accessible repository that enhances data understanding and transparency across the organization.
• Support a culture of excellence in data transformations and clear schema design, ensuring alignment with operational and analytical business requirements.
• Ensure our data architecture is secure and compliant per company policies and industry standards. Support information and data governance roles in applying appropriate firm policies.
• Collaborate among a team of data engineers and liaise closely with data solutions analysts and database administrators with a strong focus on high-quality solution delivery and team culture.
• Partner with IT staff, vendors, and other third parties to address system-level technical issues, manage internal and external integrations, and implement
Location: Austin, TX
Posted: Aug. 21, 2024, 10:46 p.m.
Apply Now Company Website