Are you looking for an exciting job where you can put your skills and talents to work at a company you can feel proud to be a part of? Do you want a workplace that will challenge you and offer you opportunities to learn and grow? A position at Xcel Energy could be just what you’re looking for.
Position Summary
The Senior Databricks Platform Engineer is responsible for leading technical aspects of IT solution delivery, strategic planning, and operational excellence. They are responsible for managing the overall health of the technology ecosystem and will manage and oversee design of solutions to meet business needs and support the overall IT Strategy. They provide technical guidance in partnership with Architecture and with cross-organizational input and in accordance with business unit objectives. They are a consultant to business managers, architecture, security and operations teams to drive cross-awareness of business needs and opportunities. They bring innovative solutions to the business line by leveraging their technical expertise. They identify and implement continuous improvement over cost, security, operation, and functionality of the solutions in their domain.
• As a Sr Databricks Platform Engineer, your role involves performing Databricks Platform administration and deploying applications on the AWS Databricks platform. You’ll handle administration, configuration, and optimization to support data analytics, machine learning, and data engineering activities. You will lead and mentor a team of Databricks Platform Engineers to ensure the effective use and administration of the Databricks platform. Collaborating with data engineers, data scientists, and stakeholders, you’ll ensure the platform aligns with requirements while maintaining security and performance standards.
Essential Responsibilities
• Solution Delivery: Lead and support solution lifecycle technical activities. Ensure solutions are designed for great user experience and operational performance. Lead design, ensuring Enterprise Architecture, Security, Operations and Compliance aspects are continuously integrated into solutions. Provide input to cost and schedule estimation. Responsible for overall integrity of system design and operation. Oversee vendor activities.
• Relationship Management: Conduct peer reviews and approve system changes and technical solution design. Coach and mentor less experience team members. Partner cross-organizationally to drive minimal costs on optimal solutions. Provide in-depth technical information to stakeholders as needed.
• Strategy & Planning: Innovate through usage of industry emerging capabilities and evolving customer needs. Provide input to strategic roadmap and technical dependencies.
• Subject Matter Expertise: Continuously stay current on, and apply, technical industry knowledge pertaining to the respective domain
• Operations: Review solution performance, and continually assess health of systems. Track and drive awareness to operational and technical debt risks. Provide escalated support to incident and problem management. Utilize analytics to improve availability, reliability, efficiency and capacity. Oversee vendor activities.
• Configure, deploy and maintain Databricks clusters and workspaces.
• Utilize IAC via Terraform to provision and deploy Databricks clusters, workspaces, and associated AWS resources.
• Optimize cluster configurations, monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
• Implement and manage access controls and security policies to protect sensitive data.
• Manage platform feature and software releases and updates.
• Provide technical support to Databricks users, including troubleshooting and issue resolution.
• Conduct training sessions to educate users on platform best practices and capabilities.
• Monitor and manage auto-scaling to ensure resources are allocated efficiently.
• Stay up-to-date with security best practices and compliance requirements.
• Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
• Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
• Monitor and manage platform costs, including optimizing resource utilization to control expenses.
• Maintain detailed documentation of configurations, procedures, and best practices.
• Collaborate with cross-functional teams, including data scientists, data engineers, and business analysts to understand their requirements and provide technical solutions
Minimum Requirements
• Ten years of related functional experience
• Bachelor's degree in technology, Science, Business or related field, or 4 years of experience equivalent to the position.
• Excellent communication skills, effective with varying organizational levels and skill set, and able to translate between technical and non-technical concepts.
• Excellent Relationship Management and collabora
Location: Golden, CO
Posted: Oct. 31, 2024, 3:38 a.m.
Apply Now Company Website