Lead Data Engineer Job at Sysmind LLC, Newark, NJ

ZDFmZmk3RHNIdVJ4RW1XdkcweVVEenIwNkE9PQ==
  • Sysmind LLC
  • Newark, NJ

Job Description

Lead Data Engineer(Microsoft Fabric)

Location Newark,NJ

This role requires core experience and expertise on - Microsoft Fabric, PySpark, SQL, Data modeling (dimensional & transactional),ETL/ELT pipeline design ,Data validation & data quality frameworks, Azure Integration

Job purpose

This position is part of the Enterprise Data & Analytics Capability team under the Global Technology Organization. In this role, you will lead the design, development, and optimization of large-scale data solutions on the Databricks platform

Key responsibilities

Design, build, and maintain scalable data pipelines on Databricks (using Spark, Delta Lake, etc.)

Write clean, efficient, and maintainable PySpark or SQL code for data transformation

Design robust data models for analytics and reporting

Ensure data quality, consistency, and governance

Handle batch and streaming data workflows

Provide architectural guidance and support in platform usage

Drive best practices in data engineering across the team

Monitor and optimize performance of Spark jobs and cluster usage

Ensure compliance with security and data privacy standards

Key competencies

Essential skills

Bachelor's degree in Computer Science, Engineering, or a related field

Minimum of 5 years' programming experience which includes at least one year working with a big data platform; experience in data engineering domain, Python, SQL, and cloud platforms such as Azure

Familiarity with relevant systems, tools, languages, and business domain which includes Data Lakehouse principles, relational and Kimball data models (required)

Experience with CI/CD pipelines and version control tools (required)

Knowledge of data visualization tools and BI platforms (preferred)

Certification in Databricks or relevant cloud platforms (preferred)

Good communication (verbal and written)

Experience in managing client stakeholders

Job Tags

Similar Jobs

Mattel

American Girl Restaurant Host (Part-Time) Job at Mattel

 ...all who are a part of this division. Our in-store experiences range depending on location from Girl and Doll Salons, Full-Service Restaurants, Personal Shopping, Ear Piercing (Girl and Doll), hosting Parties/Celebrations to name a few. Expect a dynamic and fast-paced... 

Guardian Proservices

Baggage Handlers - Morrisville, NC Job at Guardian Proservices

 ...job security training and the ability to receive all applicable airport security badges. Job Specifics & Requirements:...  ...grammar, tone, and pronunciation to effectively communicate with internal and external customers Complete all required training including... 

Marriott Phoenix Resort Tempe at the Buttes

AM Restaurant Host/Barista Job at Marriott Phoenix Resort Tempe at the Buttes

 ...Hostess at the Marriott Buttes Resort. Job Description: Basic Purpose: Greet and seat all guests, answer phone calls, taking reservations...  ...dining outlets include the award-winning Top of The Rock restaurant, celebrated for its excellence with multiple diners choice... 

American Montessori Academy

Preschool Aide Job at American Montessori Academy

 ...moderate noise level Be able to perform first aid/CPR if necessary Assist/lift students, as necessary Qualifications : High school diploma or equivalent; additional coursework in early childhood education or child development is preferred. Previous experience... 

Confidential

A&p Mechanic Job at Confidential

 ...Job Title: A&P Mechanic If interested/qualified, text Caroline O'Brien at 843/972/1883 Job Description Seeking a skilled Blackhawk Mechanic with an A&P license to perform field maintenance on helicopters for firefighting contracts. The role involves rotating between...