Job Listings

Senior Data Engineer

Lowes

JOB DESCRIPTION: Position is based in Charlotte, NC, some teleworking may be permitted. Travel to Lowe’s offices may be required.

Translates complex cross-functional business requirements and functional specifications into logical program designs, modules, stable application systems, and data solutions; partners with Product Team to understand business needs and functional specifications. Collaborates with cross-functional teams to ensure specifications are converted into flexible, scalable, and maintainable solution designs; evaluates project deliverables to ensure they meet specifications and architectural standards. Guides development teams in the design and build of complex Data or Platform solutions and ensures that teams are in alignment with the architecture blueprint, standards, target state architecture, and strategies. Coordinates, executes, and participates in Component Integration (CIT) scenarios, Systems Integration Testing (SIT), and User Acceptance Testing (UAT) to identify application errors and to ensure quality software deployment. Participates and coaches others in all software development end-to-end product lifecycle phases by applying and sharing an in-depth understanding of complex company and industry methodologies, policies, standards, and controls. Has solid grasp of software design patterns and approaches; understands application-level software architecture; makes technical trade-off decisions at application level. Automates and simplifies team development, test, and operations processes; develops detailed architecture plans for large scale enterprise architecture projects and drives the plans to fruition. Solves complex architecture/design and business problems; solutions are extensible; works to simplify, optimize, remove bottlenecks. Provides mentoring and guidance to more junior level engineers; may provide feedback and direction on specific engineering tasks. Executes the development, maintenance, and enhancements of BI solutions of varying complexity levels across different data sources like DBMS, File systems (structured and unstructured) on-prem and cloud infrastructure; creates level metrics and other complex metrics; use custom groups, consolidations, drilling, and complex filters.

JOB REQUIREMENTS: Job requires a Bachelor’s degree* in Computer Science, CIS, Engineering or a related field and 5 years of experience in any job title/occupation involving Data, BI or Platform Engineering, Data Warehousing/ETL, or Software Engineering or a related field. *Employer will accept single degree or combination of degrees, diplomas and/or professional experience equivalent to a Bachelor’s degree.

Must have prior experience in:

• 5 years of experience in:
• Data warehousing solutions, such as designing and managing data warehouses, data marts, and data lakes;
• Ability to design, implement, and optimize complex ETL processes to extract data from different sources, transform it into the desired format, and load it into target systems;
• Ability to design and implement automated workflows using orchestration tools like Apache Airflow and oozie;
• Designing and creating data models that support business requirements, ensuring data accuracy, efficiency, and scalability;
• Using version control systems (e.g., Git and Bitbucket) to manage codebase changes and collaboration with other team members;
• Various data serialization formats like Avro, Parquet, and Protocol Buffers, optimizing data storage and inter-process communication;
• Data versioning techniques to manage data lineage, schema evolution, and data compatibility across pipelines;
• Implement CI/CD pipelines for data engineering processes, including automated testing and deployment;
• Profiling and optimizing data workflows, database queries, and infrastructure for maximum efficiency;
• Advanced data warehousing concepts like columnar storage, data distribution strategies, and materialized views; and
• Monitoring and logging tools to ensure the health and performance of data pipelines and applications.

• 3 years of experience in:
• Big data technologies like Hadoop, Spark, and Hive; and
• Distributed computing frameworks like Apache Spark and can design and implement data processing solutions that scale across a cluster of nodes.

REQ# 4168828

Lowe’s is an equal opportunity employer and administers all personnel practices without regard to race, color, religious creed, sex, gender, age, ancestry, national origin, mental or physical disability or medical condition, sexual orientation, gender identity or expression, marital status, military or veteran status, genetic information, or any other category protected under federal, state, or local law.

Location: Charlotte, NC

Posted: Aug. 28, 2024, 10:23 p.m.

Apply Now Company Website