Our client is looking to hire a Senior Data Engineer with extensive experience in Databricks and distributed data/computing tools. The ideal candidate will design, develop and optimize their data architecture, ensuring robust data pipelines and seamless data integration.
Responsibilities:
• Design and implement scalable data pipelines using Databricks.
• Optimize and manage distributed data systems and computing frameworks.
• Collaborate with data scientists and analysts to meet data requirements.
• Ensure data quality and integrity across all systems.
• Monitor and troubleshoot data workflows for performance issues.
Requirments:
• Proven experience with Databricks
• Strong expertise in distributed data/computing tools (e.g. MapReduce, Spark, Hadoop, Hive, Kafka, EMR, etc.)
• Proficiency in Python, SQL and ETL processes
• Solid understanding of Data Warehousing concepts
• Experience with cloud platforms (AWS, Azure, GCP)
• Familiarity with data governance and security best practices
• Excellent problem-solving and communication skills
• B.S. in Computer Science, Engineering or related field
Location: United States
Posted: Aug. 16, 2024, 8:02 a.m.
Apply Now Company Website