Job Title: Spark & Scala Developer
Location: Sunnyvale, CA / Austin, TX
No. of Positions: 3
Experience Level: 5-7 years of overall experience
Job Description:
We are seeking a highly skilled and motivated Spark & Scala Developer to join our team in Sunnyvale, CA or Austin, TX. The ideal candidate will have a strong background in building and supporting scalable Big Data applications, with a focus on leveraging Hadoop technologies and modern data processing frameworks. This role is critical in helping us develop and maintain robust data pipelines and delivering data promptly in a collaborative team environment.
Key Responsibilities:
• Design, develop, and support scalable Big Data applications using Spark and Scala.
• Collaborate with cross-functional teams to build modern data pipelines that handle large volumes of data efficiently.
• Implement ETL processes, feature engineering, and data processing workflows using Hadoop technologies (e.g., Spark, YARN, HDFS, Oozie, Hive, Airflow).
• Perform data analysis, troubleshooting, and performance tuning to ensure optimal performance of Big Data applications.
• Write and maintain Shell scripts to automate data processing tasks and workflows.
• Utilize expertise in Data Analytics, PL/SQL, and NoSQL databases to manage and process data.
• Work closely with business and technical teams to gather requirements and deliver data solutions that meet business needs.
• Continuously learn and apply new technologies to improve existing processes and workflows.
• Communicate effectively with team members and stakeholders to ensure alignment and successful project delivery.
Required Skills and Qualifications:
• Experience: 5-7 years of overall experience, with 4+ years specifically in building and supporting scalable Big Data applications.
• Proficiency in Hadoop Technologies: Strong knowledge of Hadoop ecosystem components including Spark, YARN, HDFS, Oozie, Hive, and Airflow.
• Spark & Scala Expertise: In-depth understanding and hands-on experience with Spark Engine, Spark, and Scala.
• Data Processing Technologies: Strong experience with data processing, ETL processes, and feature engineering.
• Database Expertise: Proficiency in Data Analytics, PL/SQL, and NoSQL databases.
• Technical Skills: Strong analytical and troubleshooting skills.
• Soft Skills: Excellent interpersonal skills, with the ability to work effectively across multiple business and technical teams. Strong oral and written communication skills.
• Learning Ability: Demonstrated ability to independently learn new technologies.
• Team Player: Passionate about technology, a fast learner, and a collaborative team player.
Additional Nice to Have:
• Cloud Experience: Familiarity with commonly used cloud services (e.g., AWS, GCP, Azure).
• Columnar Storage Expertise: Experience with columnar storage formats such as Parquet or Iceberg.
• Deep Learning: Knowledge of deep learning models and frameworks.
Job Type: Temporary
Contract length: 12 months
Pay: $45.00 - $60.00 per hour
Experience:
• Spark, Scala: 5 years (Required)
• Java: 5 years (Required)
• Big data: 5 years (Preferred)
• PL,SQL NoSQL: 5 years (Required)
Ability to Relocate:
• Sunnyvale, CA: Relocate before starting work (Required)
Work Location: On the road
Location: Sunnyvale, CA
Posted: Aug. 15, 2024, 9:12 p.m.
Apply Now Company Website