Job Listings

Python PySpark Developer

Compunnel Inc.

Role: Python PySpark Developer

Location: Plano, TX / Wilmingtom, DE

Type: [Full-time/Contract]

Experience Level: 10+ Years

Overview:

We are seeking a skilled Python PySpark Developer to join our data engineering team. The ideal candidate will be responsible for building and maintaining scalable data processing pipelines using PySpark and Python. This role requires a strong background in big data technologies, data transformation, and cloud platforms.

Key Responsibilities:
• Python Programming: Strong proficiency in Python, with experience in writing and optimizing code for data processing.
• PySpark: Hands-on experience with PySpark for distributed data processing and ETL tasks.
• Big Data Technologies: Familiarity with big data technologies such as Apache Spark, Hadoop, Hive, and Kafka.
• Cloud Platforms: Experience with cloud platforms like AWS, Azure, or Google Cloud, especially with services like EMR, Databricks, or HDInsight.
• Data Storage: Knowledge of data storage solutions, including relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
• Version Control: Proficiency with version control systems like Git.
• Problem-Solving: Strong analytical skills to troubleshoot and resolve technical issues in data processing.

Location: Plano, TX

Posted: Sept. 2, 2024, 8:12 a.m.

Apply Now Company Website