Sr Azure Big Data Engineer – This is an 100% hands role
We are looking for below experience We are looking for 14+ years of Data Engineer
Working Hours : Mandatory PST hours
• Data Engineer : 14+ years
• Azure : 8 years - Expert
• ADF : 6 years - Expert
• DataBricks : 6 years - Expert
• Spark (PySpark, SparkSQL): 6 years – Expert
• Azure DevOps CI/CD : 4 years
Job descriptions for the Sr data engineering for DSnA support:
We operate in an Azure + Databricks Lakehouse. We’ll need a person with:
• Azure experience – ADF for orchestration, ADLS for storage, AzureDevOps for CI/CD
• Databricks experience – all compute/ETL leverages Databricks and is programmed leveraging Spark (PySpark, SparkSQL)
• PowerShell experience – this is our scripting language of choice
• SQL proficiency – it’s used everywhere (TSQL, PostgreSQL)
• Proficiency with parquet and delta formats
Additionally – they will need experience in:
• SDLC + CI/CD – we follow a standard deployment process (dev, test, prod) that includes peer reviewed code. They need to be comfortable with standard DevOps practices.
• Should have a deep understanding of indexes and partitioning.
• Should be proficient optimizing code for performance (able to read a DAG, determine where CBO is using most resources)
• Should be proficient in writing code in a matter that it can run repeatedly and produce the same state (we have a custom SQL Deployment framework)
Location: Bellevue, WA
Posted: Aug. 23, 2024, 7:49 a.m.
Apply Now Company Website