Lead Data Engineer Job at Akaasa Technologies, Remote

ZFZUYWlibnFHK0J3R1dlckdreVVERHIxNXc9PQ==
  • Akaasa Technologies
  • Remote

Job Description

Top Skill Sets:

GCP
Data Eng
Tech Lead
Database migration
MongoDB

Job Description:

Required - minimum 8 years of proven hands-on experience with GCP data services.

Preferred - GCP Google Cloud Professional Data Engineer Certification.

Required Strong understanding of distributed systems and data engineering best practices.

Required Excellent communication and documentation skills.

Required Ability to work independently and collaboratively in a fast-paced environment.

Required experience in Agile methodology with preferred experience in SAFe methodology

Required good communication and collaborative skills

Required experience Leading onshore/offshore support model collaborating work with offshore teams.

Preferred experience working with GitHub, RTC, automation tools.

Required - minimum 8 years of proven hands-on experience in the following:

Design and implement robust data pipelines using Google Cloud Platform (GCP) services such as BigQuery, Cloud Storage, and Pub/Sub.

Develop and manage workflows using Cloud Composer (Apache Airflow) for efficient scheduling and orchestration.

Write clean, efficient, and scalable code in Python, leveraging advanced programming techniques.

Craft complex SQL queries in BigQuery, including window functions, CTEs, and performance tuning strategies.

Build and maintain real-time data processing systems using Apache Kafka.

Model and manage NoSQL databases, particularly MongoDB, with a focus on scalable schema design.

Utilize Shell scripting and perform Linux system administration tasks to support data infrastructure.

Conduct data profiling and implement validation techniques to ensure data quality and integrity.

Develop and maintain API integration scripts for seamless service automation and data exchange.

Troubleshoot and resolve data-related issues with strong analytical and problem-solving skills.

Create and maintain data flow diagrams to clearly communicate architecture and pipeline logic to stakeholders.

Job Tags

Similar Jobs

Ballpark Village

Line Cook Job at Ballpark Village

 ...in the heart of the central business district and adjacent to Busch Stadium, surrounded by parking and have unprecedented highway access...  ...Hall of Fame Museum, Cardinals Nation Restaurant, and Anheuser-Busch Brew House. Cook Responsibilities include, but are not... 

MASC Medical

Cosmetic Plastic Surgeon - $450K to $600K annually - Ownership options Job at MASC Medical

 ...Cosmetic Plastic Surgeon - $450K to $600K annually - Ownership options Houston, Texas We are seeking a Plastic Surgeon to join...  ...consultation process - 4 to 9 consults a week; amount of weekly surgeries depends on surgeon's efficiency and experience Compensation... 

Jovie of NC + TN

Babysitter/Nanny PRN Job at Jovie of NC + TN

Start Date: ASAP Schedule: Set your own availability - full days in high demand! Location: Asheville, NC (in home, hotels, vacation homes, and event venues) Job Type: PRN | Flexible | In-person Love working with kids but want flexible, occasional shifts instead...

McCormick & Company

ENGINEERING & MAINTENANCE MANAGER I Job at McCormick & Company

 ...seasonings industry. Zatarain's, a leader in New Orleans cuisine - owned by McCormick -. is seeking a full-time Engineering and Maintenance Manager, reporting to the Plant Manager. This role will work in Zatarain's Plant , located at 82 1st Street, Gretna, Louisiana.... 

Girl Scouts of Colorado

2024 Summer Camp Assistant Photographer - Tomahawk Ranch - Girl Scouts of Colorado Job at Girl Scouts of Colorado

 ...arts and crafts, backpacking, boating, horseback riding, zip lining, farm with ranch animals, dance & drama, archery and sports, photography, international cultures, nature and science, astronomy, homesteading, gardening, and outdoor skills. Camp themes include Wizarding...