Skip to main content

Manager, Data Engineering - DB&T

ID de la oferta REF34444G Fecha de publicación 12/12/2024 Location Nueva Jersey Category Información, sistemas y tecnología / Generalista

Manager, Data Engineering - DB&T

About Veolia North America

A subsidiary of Veolia Group, Veolia North America (VNA) offers a full spectrum of water, waste and energy management services, including water, and wastewater treatment, commercial and hazardous waste collection and disposal, energy consulting and resource recovery. VNA helps commercial, industrial, healthcare, higher education, and municipality customers throughout North America. Headquartered in Boston, Mass., Veolia North America has approximately 10,000 employees working at more than 350 locations across the continent. Please visit our website www.veolianorthamerica.com.

Pay Rate: $120000 to $140000 Per Year

BENEFITS

Veolia's comprehensive benefits package includes paid time off policies, as well as health, dental and vision insurance. In addition, employees are also entitled to participate in an employer sponsored 401(k) plan, to save for retirement.  Pay and benefits for employees represented by a union are outlined in their collective bargaining agreement. 

Position Purpose: 

As Manager of Data Engineering, you will lead a team of data engineers in developing and managing data systems. This role requires strategic oversight of data integration, system development, and team management to ensure efficient and effective data solutions.

Primary Duties/Responsibilities:

  • Develop and operate data management tools, monitoring data flows, data quality, data cleansing and data processing.
  • Lead strategic planning for key service development of our data lake core stack such as data ingestion, pipeline optimization, data transformation, orchestration etc.
  • Manage a team of data engineers, providing mentorship and career development.
  • Collaborate with various stakeholders to align data engineering goals with organizational objectives.
  • Create and document logical data integration strategies for data flows between disparate systems and the enterprise data warehouse/data lakes.
  • Ensure data security and compliance with relevant data protection regulations.
  • Drive innovation in data management and analytics solutions.
  • Work in an Agile environment that focuses on collaboration and teamwork.
  • Oversee the development and maintenance of data infrastructure.
  • Monitor production job schedule and correct job failures in a timely manner.

Education/Experience/Background:

  • MS degree in Computer Science or computer related field from an accredited institution.
  • 7+ years hands proven experience as a Data Engineer or similar role.
  • 7+ years of strong experience building, running and maintaining datalake(s) and warehouse(s) in a cloud environment.

Knowledge/Skills/Abilities:

  • Strong leadership skills with a track record of team development.
  • More than 4 years of experience developing with Python.
  • 4+ years performing with production environments in a DevOps culture managing code composed of multi-developer teams, following industry best practices.
  • 4+ years SQL development experience.
  • Experience with data modeling.
  • 4+ years bash scripting experience.
  • Strong experience with Git, CI/CD (preferably GitLab), Docker and Terraform.
  • Experience deploying and running services in Cloud Big Data platforms such as BigQuery and Snowflake.
  • Strong experience with GCP services.
  • Experience designing and building data pipelines using tools like Apache Beam, CDAP (Data Fusion) or other ETLs.
  • Knowledge with CDC design patterns and their challenges.
  • Experience with DAG workflows orchestration such as Apache Airflow.
  • Experience with NoSQL databases is a plus (i.e Firestore, MongoDB).
  • Experience designing and developing APIs is a plus (i.e using FastAPI, Flask).

Abilities:

  • Being able to work in a large company with different stakeholders.
  • Being a mentor through design sessions, code reviews, and community building.
  • Take ownership and support solutions you develop.
  • Value collaboration with other members of the team.
  • Have a product mindset.
  • Good communication.

Required Certification/Licenses/Training:

  • (Nice to have) Google Cloud Data Engineer.
  • Terraform Associate Certification.

Physical Requirements:

  • Hybrid mode (2 days a week in the office).

We are an Equal Opportunity Employer! All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status.

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. The Company reserves the right to modify this information at any time, subject to applicable law.