Lead Data Engineer Job at Akaasa Technologies, Remote

ZFZUYWlibnFHK0J3R1dlckdreVVERHIxNXc9PQ==
  • Akaasa Technologies
  • Remote

Job Description

Top Skill Sets:

GCP
Data Eng
Tech Lead
Database migration
MongoDB

Job Description:

Required - minimum 8 years of proven hands-on experience with GCP data services.

Preferred - GCP Google Cloud Professional Data Engineer Certification.

Required Strong understanding of distributed systems and data engineering best practices.

Required Excellent communication and documentation skills.

Required Ability to work independently and collaboratively in a fast-paced environment.

Required experience in Agile methodology with preferred experience in SAFe methodology

Required good communication and collaborative skills

Required experience Leading onshore/offshore support model collaborating work with offshore teams.

Preferred experience working with GitHub, RTC, automation tools.

Required - minimum 8 years of proven hands-on experience in the following:

Design and implement robust data pipelines using Google Cloud Platform (GCP) services such as BigQuery, Cloud Storage, and Pub/Sub.

Develop and manage workflows using Cloud Composer (Apache Airflow) for efficient scheduling and orchestration.

Write clean, efficient, and scalable code in Python, leveraging advanced programming techniques.

Craft complex SQL queries in BigQuery, including window functions, CTEs, and performance tuning strategies.

Build and maintain real-time data processing systems using Apache Kafka.

Model and manage NoSQL databases, particularly MongoDB, with a focus on scalable schema design.

Utilize Shell scripting and perform Linux system administration tasks to support data infrastructure.

Conduct data profiling and implement validation techniques to ensure data quality and integrity.

Develop and maintain API integration scripts for seamless service automation and data exchange.

Troubleshoot and resolve data-related issues with strong analytical and problem-solving skills.

Create and maintain data flow diagrams to clearly communicate architecture and pipeline logic to stakeholders.

Job Tags

Similar Jobs

NSNA

Electronics Engineer Commodity Buyer Job at NSNA

 ...tier one supplier of instrument clusters and head-up display units for FCA US, General Motors, BMW, Honda, Harley Davidson, Suzuki, Polaris, Arctic Cat and other OEM's. Purpose of Job The primary role of the NSNA Advanced Purchasing Buyer II(Electronics Engineer)... 

MAU Workforce Solutions

Advanced Trucker Job at MAU Workforce Solutions

 ...Start your new career as an Advanced Trucker with MAU at Kimberly-Clark, a state-of-the-art manufacturing facility in Beech Island, SC...  ...station and follow all safety and company policies~Keep track of parts and materials and refill bins needed to perform duties~... 

ReVisionz

Business Analyst - Content Migration - USA Job at ReVisionz

 ...governance. This role can work remote from within Canada or the USA only. Core Responsibilities Client Engagement & Leadership:...  ...permanent resident/Green Card holder, or otherwise hold a valid open work permit. . ReVisionzis not sponsoring new work visas.... 

Oswego County

Assistant County Attorney Job at Oswego County

 ...The Oswego County Attorney's Office has an immediate opening for a full-time Assistant County Attorney. This position will be primarily responsible for general government matters, contract review, administrative hearings and covering Family Court and other cases as may... 

Lexington Plastic Surgeons

Plastic Surgeon Job at Lexington Plastic Surgeons

LocationDetails To Include With Cover LetterJob DescriptionBusy multi-state ETHNIC plastic surgery practice seeks part-time Plastic Surgeon to join our Brentwood, CA Office. Our company is well established and currently operates in 7 states. We are seeking a business...