we are hiring for Data Engineer for our client based out of Texas, US.
Location: Houston, TX - Hybrid (2 Days a week or 8 -10 Days a month)
Required Skills:
• Proven experience as a Data Engineer, with a focus on designing and implementing scalable data solutions.
• Strong programming skills in Python.
• Experience with big data technologies such as Hadoop and Spark.
• Proficiency in PySpark for distributed data processing.
• Experience with cloud platforms, particularly AWS.
• Proficiency in both relational and NoSQL databases.
• Extensive experience with distributed data processing using Spark for large-scale data transformations.
• Familiarity with tools like HDFS, MapReduce, and Hive for processing and storing big data.
• Expertise in designing, implementing, and optimizing cloud-based data warehouses.
• Experience with cloud-based ETL services like AWS Glue, Azure Data Factory, or Google Cloud Dataflow for orchestrating data workflows.
• Proficiency in interacting with services like AWS Lake Formation or Azure Data Lake Storage.
• Experience setting up monitoring and logging solutions (e.g., AWS CloudWatch, Azure Monitor) for tracking the performance and health of data pipelines.
• Excellent problem-solving and analytical skills.
• Proficiency in collaboration tools for version control (e.g., Git) and coordination within a team.
Location: United States
Posted: Aug. 9, 2024, 9:18 a.m.
Apply Now Company Website