Job Description For Senior Data Engineer
Position: Senior Data Engineer
Location: Washington DC.
Experience: 8+ Years
Work type: C2C only ( REMOTE )
PETADATA is currently hiring for the position of Senior Data Engineer for one of our clients.
Roles & Responsibilities
• Required Hands-on coding skills, with the ability to outline solution design using coding best practices and perform code reviews.
• Work closely with our data science and product teams to drive insights and innovations.
• Oversee activities of the junior data engineering teams, ensuring proper execution of their duties and alignment with business vision and objectives.
• Responsible for the design, deployment, and maintenance of the business’s data platforms.
• Capable of extending the business’s data pipeline through the collection, storage, processing, and transformation of large data sets, and also developing reliable data pipelines that translate raw data into powerful features and signals.
• Monitor the existing metrics, analyze data, and lead partnerships with other Data and Analytics teams to identify and implement system and process improvements.
• Should develop queries for ad hoc business projects, as well as ongoing reporting.
• Build a metadata system where all available data is maintained and cataloged.
• Retrieve analyzing data through SQL, Excel, and other data management systems.
• Work with data analysts, data warehousing engineers, and data scientists in finding and applying best practices.
• Define the business’s data requirements to ensure that the collected data is of a high quality and optimal for use across the department and the business at large.
• Responsible for contributing to the continual improvement of the business’s data platforms through his observations and well-researched knowledge.
Primary Skills: Snaplogic, Amazon RDS-Aurora PostgreSQL.
Required Skills
• The ideal candidate will have a strong computer science background.
• Must Have 8+ years of IT experience with 5+ years of experience in Data Engineering.
• Minimum 3 years hands on experience on Snaplogic pipeline development and architecture.
• Should have hands-on experience in using various snaps available in Snaplogic like REST Snaps, Transform Snaps, Database Snaps, Script Snaps, etc.
• In-depth knowledge and min 2+ yrs. of experience in Amazon RDS-Aurora PostgreSQL and advanced Python knowledge.
• Should have experience in working Agile, and experience with cloud services, SQL/NoSQL databases, and Docker/Kubernetes.
• Should know about Integration development using AWS/any other cloud technologies.
• Should design, architect, implement, and support 'key datasets' that avail structured and timely access to actionable business insights and also develop ETL processes that convert data into formats through a team of data analysts and dashboard charts.
• Extensive knowledge in task creation like scheduled tasks, triggered tasks, etc.
• Should have Pipeline monitoring and troubleshooting experience.
• Must have good communication skills written and verbal.
Educational Qualification
Bachelor's/ Master’s degree in Computer Science, Engineering, or a related field.
We offer a professional work environment and are given every opportunity to grow in the Information technology world.
Note
Candidates are required to attend Phone/Video Call / In-person interviews and after Selection, the candidate (He/She) should go through all background checks on Education and Experience.
Please email your resume to: jhansib@petadata.co
After carefully reviewing your experience and skills one of our HR team members will contact you on the next steps.
Location: Washington, DC
Posted: Aug. 16, 2024, 8:03 a.m.
Apply Now Company Website