Interesting Job Opportunity: Hadoop Developer - Data Processing Pipeline
Visualizza: 101
Giorno di aggiornamento: 27-05-2024
Località: Guntur Andhra Pradesh
Categoria: IT - Software
Industria: Data Infrastructure Analytics Technology Information Internet Software Development
Posizione: Entry level
Tipo di lavoro: Full-time
Contenuto del lavoro
Job Designation : Hadoop DeveloperLocations Open : Multiple
Position and Category : Permanent and Company Payroll
Job Description
Roles and Responsibilities (Along with Skills Required) :
- Designing and developing scalable, efficient, and reliable data processing pipelines using Hadoop and related technologies such as MapReduce and Hive.
- Writing and executing MapReduce jobs to process large datasets stored in Hadoop Distributed File System (HDFS).
- Collaborating with stakeholders to understand their data processing requirements and develop solutions that meet their needs.
- Integrating Hadoop with other data storage and processing technologies, such as NoSQL databases and data warehouses.
- Developing and maintaining data processing workflows using Apache Oozie or similar workflow management tools.
- Debugging and optimizing Hadoop applications to improve performance and scalability.
- Ensuring data quality and security through proper data validation, cleansing, and encryption.
- Writing and maintaining technical documentation for Hadoop solutions.
- Staying up-to-date with the latest developments in big data processing and related technologies.
- Performing other tasks as assigned by management.
- Strong programming skills in Java and/or Python.
- Experience with MapReduce programming, Hive and Pig scripting, and Hadoop Distributed File System (HDFS).
- Knowledge of NoSQL databases, such as HBase, Cassandra, and MongoDB.
- Experience with data warehousing, ETL, and data integration technologies.
- Strong analytical and problem-solving skills, with the ability to debug and optimize complex data processing pipelines.
- Good communication and collaboration skills, with the ability to work effectively with cross-functional teams.
- Familiarity with Agile software development methodologies.
- Experience with cloud computing platforms, such as Amazon Web Services (AWS) and Microsoft Azure, is an advantage.
Scadenza: 11-07-2024
Clicca per candidarti per un candidato gratuito
Segnala lavoro
LAVORI SIMILI
-
⏰ 26-06-2024🌏 Nellore, Andhra Pradesh
-
⏰ 28-06-2024🌏 Visakhapatnam / Vizag, Andhra Pradesh
-
⏰ 12-06-2024🌏 Vijayawada, Andhra Pradesh
-
⏰ 12-06-2024🌏 Guntakal, Andhra Pradesh
-
⏰ 17-06-2024🌏 Kakinada, Andhra Pradesh
-
⏰ 12-06-2024🌏 Guntur, Andhra Pradesh
-
⏰ 14-06-2024🌏 Visakhapatnam / Vizag, Andhra Pradesh
-
⏰ 12-06-2024🌏 Guntur, Andhra Pradesh
-
⏰ 10-06-2024🌏 Rajahmundry, Andhra Pradesh
-
⏰ 29-06-2024🌏 Nellore, Andhra Pradesh