Lead Data Engineer(Microsoft Fabric)
Location Newark,NJ
This role requires core experience and expertise on - Microsoft Fabric, PySpark, SQL, Data modeling (dimensional & transactional),ETL/ELT pipeline design ,Data validation & data quality frameworks, Azure Integration
Job purpose
This position is part of the Enterprise Data & Analytics Capability team under the Global Technology Organization. In this role, you will lead the design, development, and optimization of large-scale data solutions on the Databricks platform
Key responsibilities
Design, build, and maintain scalable data pipelines on Databricks (using Spark, Delta Lake, etc.)
Write clean, efficient, and maintainable PySpark or SQL code for data transformation
Design robust data models for analytics and reporting
Ensure data quality, consistency, and governance
Handle batch and streaming data workflows
Provide architectural guidance and support in platform usage
Drive best practices in data engineering across the team
Monitor and optimize performance of Spark jobs and cluster usage
Ensure compliance with security and data privacy standards
Key competencies
Essential skills
Bachelor's degree in Computer Science, Engineering, or a related field
Minimum of 5 years' programming experience which includes at least one year working with a big data platform; experience in data engineering domain, Python, SQL, and cloud platforms such as Azure
Familiarity with relevant systems, tools, languages, and business domain which includes Data Lakehouse principles, relational and Kimball data models (required)
Experience with CI/CD pipelines and version control tools (required)
Knowledge of data visualization tools and BI platforms (preferred)
Certification in Databricks or relevant cloud platforms (preferred)
Good communication (verbal and written)
Experience in managing client stakeholders
...Flatbed Lease-purchase Truck Driving Jobs In Atmore, AL By HMD Trucking HMD Trucking is excited to announce a fantastic... ...economical route to truck ownership without the hassle of credit checks and offers flexible down payment options, including possibilities for $0 down....
...Job Description Love to drive your car and enjoy a fun yet fast paced experience in store? Then we may be looking for you! Helping customers and making them smile at the end of the day is what we want, so if that's something you feel like you can do then we are...
...Engineering & Maintenance Manager Greater Wilkes-Barre, PA Food Manufacturing A food manufacturer in the Greater Wilkes-Barre area is seeking an Engineering & Maintenance Manager to lead plant maintenance and engineering efforts in a hands-on, onsite leadership...
...part of a culture where individuality is noticed and valued every day. IT Testing Engineer III The IT Testing Engineer III is a hands-on testing lead responsible for functional and ETL validation of Pharmacy Rebate and Claims platforms. This role serves as the primary...
...program that specializes in at-school after school Golf, Tennis,... ...Pre-K and elementary school students in the Gwinnett County and North... ...part-time workers, retirees, high school & college students,... ...week Job Types: Part-time, Internship Pay: $15.00 - $25.00 per hour...