Description:
Our Client is currently seeking an experienced Data Engineer to join our development team. The right person will have proven Specialization in Data Engineering following Medallion Data Architecture Principles and experience in building/supporting large data structures.
• Design and build data processing pipelines using tools and frameworks in the Databricks/Azure ecosystem using ADLS.
• Design, develop, optimize, and maintain data pipelines, storage, and compute components using Azure Services.
• Understand the Data Platforms & Services strategy, and information architecture, and help build modern data lakes and maintain high standards of data quality and integrity.
• Design and build ETL pipelines to automate structured and unstructured data ingestion.
• Analyzes requirements and architecture specifications to create a detailed design document. - Responsible for data engineering functions including, but not limited to data extraction, transformation, loading, and integration in support of modern cloud computing platforms like Azure and Databricks.
• Work with DevOps engineers on CI/CD processes; perform code reviews and develop processes for improving code quality.
• Strong in scalability, performance, and availability of our systems.
• Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
• Assist in the evaluation, implementation, and deployment of emerging tools to modernize the data platform.
• Partner with analysts and architects to support technical architectures for data engineering projects.
• In-depth experience using SQL Server DB for ETL processes
Skills:
Python, Sql, Azure, Data
Top Skills Details:
Python, Sql, Azure
Additional Skills & Qualifications:
• Bachelor’s degree in computer science or a similar field with 5 years experience as a data engineer or SQL developer.
• 5 years experience developing SQL and Python.
• In-depth knowledge of Azure Data Factory, Azure Databricks, and Azure Service Bus.
• Excellent understanding of T-SQL programming, ETL Processes, and Microsoft SQL Server.
• Experience working with data using structured (SQL) and/or unstructured (NoSQL) approaches, Redshift experience a plus
• Experience with or exposure to data visualization principles and practices, especially with Power BI or Tableau.
• BS/MS degree in Computer Science, Engineering, or a related subject
• Sense of ownership and pride in your performance and its impact on the company’s success
Experience Level:
Expert Level
Location: United States
Posted: Aug. 19, 2024, 7:10 p.m.
Apply Now Company Website