Big Data Engineer

☞ Spectrum Talent Management Pvt. Ltd

Vue: 106

Jour de mise à jour: 06-05-2024

Localisation: Gurgaon Haryana Bengaluru / Bangalore Karnataka Delhi Union Territories

Catégorie: IT - Logiciel

Industrie: IT Services & Consulting

Niveau: Technical Support Engineer

Type d’emploi: Full Time, Permanent

Expérience: 3 - 6 years

Loading ...

le contenu du travail

Technical:
o Building and Operationalizing Data Pipelines for both real time and batch loads on GCP according to architectural design (LDM) using DataFusion, DataFlow, Stored Procedures, or similar ELT tools
o Hands-on knowledge of having implemented best practices in data ingestion, processing, storage, querying, and life cycle management in Big Query, BigTable, Firestore, GCS or similar data storage platforms
o Expert in writing reusable, testable, efficient Data Engineering code in SQL / Python. Expertise on both will be a plus.
o Write Unit Test & perform Linting and code optimization
o Ability to perform quick Data discovery & source mapping and develop POCs with business in data engineering tasks
o Maintain and improve data integration pipelines for performance and cost optimizations
o Ability to pick up Domain knowledge through discussions with client, business counterparts, internal literature, and apply the same for creating
o Understanding of Data orchestration processes in GCP and ability to implement Airflow Composer Dags with guidance
o Data Discovery, cataloging, and staging techniques and integration with different source systems

Loading ...
Loading ...

Date limite: 20-06-2024

Cliquez pour postuler pour un candidat gratuit

Postuler

Signaler des emplois
Loading ...
Loading ...

MÊMES EMPLOIS

Loading ...
Loading ...