Senior Data Engineer with (7+ years of experience)
Location : Houston, Tx (Hybrid)
Job Type : C2C / W2
Visa : Only H1b
Interview : F2F
Job Description: Looking for Data Engineer with expertise in both Amazon Web Services (AWS) and Google Cloud Platform (GCP) to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines and architectures that enable efficient data processing and analytics.
Responsibilities
• Design and implement scalable data pipelines and ETL processes using AWS and GCP services.
• Develop and maintain data architectures, ensuring optimal performance and data quality.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
• Optimize and manage data storage solutions, including data warehouses and data lakes.
• Monitor and troubleshoot data pipelines to ensure reliable and timely data processing.
• Implement data security and governance practices to protect sensitive information.
• Stay updated with the latest advancements in AWS and GCP technologies and best practices.
Required Qualifications:
• Proven experience as a Data Engineer or in a similar role.
• Strong expertise in AWS (e.g., Redshift, S3, Glue, Lambda) and GCP (e.g., BigQuery, Dataflow, Cloud Storage, Pub/Sub).
• Proficiency in SQL and experience with database management.
• Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Luigi).
• Solid understanding of data warehousing concepts and data modeling.
• Familiarity with programming languages such as Python, Java, or Scala.
• Strong problem-solving skills and the ability to work in a fast-paced environment.
• Excellent communication and collaboration skills.
Preferred Qualifications:
• Experience with machine learning and data science workflows.
• Knowledge of containerization technologies (e.g., Docker, Kubernetes).
• Familiarity with CI/CD practices and tools.
• Certification in AWS and/or GCP is a plus.
Location: Austin, TX
Posted: Aug. 9, 2024, 6:21 a.m.
Apply Now Company Website