Title : Data Engineer (onsite )
Location : Plano, TX
Contract : W2 only
Job Description:
Responsibilities:
• Design and develop scalable data pipelines using Apache Spark with Scala/Python.
• Optimize and manage large-scale data processing applications.
• Implement data ingestion and transformation solutions.
• Ensure data quality and integrity across various data platforms.
• Implement data governance policies and best practices.
• Collaborate with data scientists, analysts, and business stakeholders.
• Provide technical leadership and mentoring to junior data engineers.
• Monitor and optimize the performance of data processing jobs.
• Troubleshoot and resolve data-related issues.
• Stay updated with the latest industry trends and technologies.
Qualifications:
• 8+ years of experience in strong Python data engineering.
• Strong experience with Apache Spark.
• Proficiency in Scala and/or Python.
• Previous experience in the banking domain (advantageous).
• Former employee of bank (required).
• Expertise in big data technologies and tools (e.g., Hadoop, Hive).
• Strong understanding of data warehousing concepts and ETL processes.
• Experience with cloud platforms (e.g., AWS).
• Proficient in SQL and database technologies (e.g., PostgreSQL, MySQL).
• Excellent problem-solving and analytical skills.
• Strong communication and interpersonal skills.
• Ability to work effectively in a team-oriented, collaborative environment.
Location: South Plainfield, NJ
Posted: Aug. 11, 2024, 11:18 p.m.
Apply Now Company Website