AWS (Big Data) developer

☞ Cuelogic

看过: 102

更新日: 06-05-2024

位置: Pune Maharashtra

类别: 建筑/室内设计 保健/医疗

行业:

Loading ...

工作内容

Job Title: Senior Software Engineer -AWS (Big Data) developer
Experience: 2 years
Location: Pune


Responsibilities:

  • Candidate should have hands-on experience in handling of Big Data and implementing big data pipelines using AWS EMR and other associated AWS components like S3, EC2, Lambda, CloudWatch, SQS, SNS, RDS
  • Candidate should have hands-on experience in creating IAM roles and policies and experience in securing AWS resources like EMR cluster, EC2 instances, S3 buckets
  • Candidate should have strong experience in Python and should be able orchestrate AWS pipelines using AWS Python SDK (boto3)
  • Candidate should be familiar with disaster recovery and migration services like AWS DMS
  • Candidate should have fair understanding of Spark architecture and should have coding experience in creating Spark jobs (preferably using PySpark)
  • Candidate should be able to write basic to intermediate level SQL queries

Job Description:

  • Migrate on-premise Hadoop cluster to AWS EMR
  • Migrate historical data from HDFS based storage to S3 based storage and update metadata
  • Configure EMR cluster, add steps to EMR, spin up and terminate using AWS Python SDK (boto3)
  • Orchestrate end to end flow of data involving S3 data retrieval, CloudWatch rules , Lambda functions and set up IAM roles and policies using Boto3
  • Set up governance and auditing using AWS CloudTrail
  • Write SQL queries for data analysis and data quality checks
  • Create Spark jobs to run on EMR cluster and automate the flow

Benefits:
  • Competitive Compensation
  • Transparent, Performance Driven Culture.
  • Work on Projects for Global Brands.
  • Fun, Collaborative Team Environment
  • Medical Benefits & Flexible work hours
  • A Well-Defined Learning Path – ensuring your skills always match the industry.

  • Stability, Growth, and chance to make a difference


About Cuelogic


We are inspiring people to build the building blocks of the modern world – intelligent and
inspiring software. Our people are outstanding individuals, handpicked to fit culture first. With freedom to think and act, we encourage our people to bring fresh ideas to the table, inspire the next and help their peers grow. Cuelogic is a melting pot of cultures with people from more than 3 continents working with us. We are constantly trying to build a place where
People love to come to work. We are all about infinite opportunities for everyone. No matter what department or projects you work with. There is always an opportunity to shine, learn, lead and grow. We’re often quoted as a company with Technology at its core. However, we always strike that out and say – Our people are at the core. We’d love for you to experience the Spirit of Cuelogic and have a career beyond the ordinary

ID: 216 | 2 - 4 yrs | Pune | careers
Loading ...
Loading ...

最后期限: 20-06-2024

点击免费申请候选人

申请

报告工作
Loading ...
Loading ...

相同的工作

Loading ...
Loading ...