Job Title: Scala and Spark Developer
Job ID: 2023-12155
Job Location: Austin, TX; Morris Plains, NJ
Job Travel Location(s):
# Positions: 1
Employment Type: W2
Candidate Constraints:
Duration: Long Term
# of Layers: 0
Work Eligibility: All Work Authorizations are Permitted – No Visa Transfers
Key Technology: Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop
Job Responsibilities:
• Work with business and technical leadership to understand requirements
• Participate in sprint planning sessions and help TPOs
• Troubleshooting the issues, provide effective solutions and application monitoring in productions environment.
Skills and Experience Required:
• 7+ years of strong development experience in Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop
• In depth knowledge on Hadoop architecture and its components
• Strong working knowledge on Single Store (MEMSQL) database
• Should have good hands-on experience working with Indexes, Shard keys, column store, and reference tables using Single Store database.
• Must understand basic AWS services and hands on experience
• Basic to moderate Terraform development experience needed
• Should be able to demonstrate work experience in Hadoop, Spark, hive
• Strong hands-on experience on Scala and Spark is must
• Must have work experience on Hadoop as data warehouse/Data Lake implementations
• Strong experience on DevOps pipeline implementation
• Health care domain knowledge is a plus
• Troubleshooting the Hadoop Yarn jobs is must
• Strong experience in writing complex and effective SQLs, and Stored Procedures
• Strong development experience on Single Store database operations
• Strong profiling skills using Single Store database
• Strong query optimizations skills to improve performance of ETL process
• Implement Hadoop job orchestration using Shell scripting, and Airflow
• Experience in Agile and working knowledge on DevOps tools (Get, Maven, Jenkins, Sonar Cube, and Checkmarks)
• Unix Shell scripting and basic administration of Unix servers
• AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and Cloud Watch)
• Experience in Jira and Confluence
• Must participate in production support model.
Location: Morris Plains, NJ
Posted: Oct. 9, 2024, 7:51 p.m.
Apply Now Company Website