Chief Big Data Architect

工作内容

Big Data Solution Architect

Location- India and US (Remote)

Job Responsibilities

· Understand the business requirements and translate the requirements into project specific solution design specifications

• Own the solution / design of a particular solution offering specific to the project

• Spearhead product/application/solution design and development

• Provide expertise to identify and translate system requirements into software design documentation

• Work with product managers to translate requirements into solutions for engineering managers

• Coordinate with engineering managers and engineering leads to ensure solutions are implemented with cohesiveness and integrity, arbitrate key technical decisions across scrum teams

• Function as the technical authority for product managers/owners, scrum masters, and engineering managers

• Work with a chief architect and senior leadership on technical visions and roadmap

• Act as Subject Matter Expert and strategist for solution product area

• Work with technical writers to ensure quality internal and external client-oriented documentation

• Build and maintain repository for deliverables, methodologies, and business development documents

• Interface and coordinate tasks with internal and external technical resources.

• Collaborates with Project Managers and technical directors to provision estimates, develop overall implementation solution plan, and serve as a lead as required, to implement the installation, customization, and integration efforts

• Oversee aspects of project life cycle, from initial kickoff through requirements analysis, design and implementation phases for projects within the solution area

• Provide quality assurance for services within the solution area

Desired Profile

• BE / B.Tech / ME / M.Tech in CS or other branches of engineering

• Experience in enterprise software solutions in the capacity of software architect, solution architect, or engineering leader

• Experienced in building Big Data Pipelines (Batch and NRT) on Hadoop using Spark and Scala/Python combination. Well versed with performance tuning of compute heavy workloads.

• Exposure to build Big Data Lake on-premise or on AWS/Azure/GCP Cloud. Solid understanding of Data Security, Data Quality and Data Governance.

• Good experience in database and hands-on experience in big data technologies. Big Data technologies such as Hadoop/Hive/Spark with experience with specific distributions such as Cloudera, HortonWorks, MapR will be a big plus. Proven track record of consistently architecting, designing, developing and/or implementing an end—to-end Big Data Lake / Business Intelligence / Data Science project.

• Proficient in Python, Java, Scala, or C++

• Strong software engineering fundamental; Strong problem-solving & debugging skills with critical thinking ability.

• Knowledge of Healthcare experience

• Strong collaboration and communication skills within and across teams

• Strong analytical skills – ability to develop an idea into solution, define features, qualitative and quantitative analysis.

Preferred Qualifications

• Big Data and Machine learning experience

• Experience with Microservices

• Development experience in cloud (Public and Private)

• Experience with data streaming technologies would be nice to have

Big Data Technical Architect

Location- India and US (Remote)

Job Responsibilities

· Collaborate with the Client Solutions Architect to produce a technical specification for development and systems integration requirements

· Produce a detailed technical design document to match the solution design specifications

· Complete/oversee the custom development and quality assurance efforts for custom work

· Participate and lead, when needed, the project meetings with the customer, Provide Customer Training as required

· Manage e2e development following agile methodologies across multiple projects to meet project and customer requirements.

· Participate in requirement discussion with client and project team and understand the business requirements.

· Work with Technical Managers and technical directors for capacity planning, provision HW, effort estimates, develop overall implementation solution plan, and serve as a lead as required for a business RFP (request for proposal)

· Understand the business requirements and develop design strategies for various patterns that can be reused across projects at enterprise level

· Set enterprise standards guidelines, best practices and processes

· Responsible for implementing development best practices and enterprise grade software with reusable, extensible and configurable components.

· Build and maintain repository for deliverables, methodologies, and business development documents which includes CI/CD & Knowledge management

· Interface and coordinate tasks with internal and external technical resources.

· Participate in code reviews, work with team to debug issues and guide team to mitigate risks/issues and any road blockers

· Proactively propose solutions and options to manage and mitigate issues related to the application

· Create the required project artifacts like data flow diagrams / work flow diagrams and documents during development

· Work closely with Platform admin and application support team during deployment and to make sure solution is maintainable and have features (e.g. monitoring, alerting, central logging etc) which helps Operations to support the application.

· Evaluate and explore new technologies, standards and methodologies that will facilitate the organization to leverage the upcoming technologies for business growth

· Guide and Mentor team members on regular basis and help them deliver the enterprise grade software. Promote and build a knowledge based culture.

· Proactively learn and explore new tools, scripting languages etc and share knowledge within team

Participate in internal projects as requiredDesired Profile

• BE / B.Tech / ME / M.Tech in CS or other branches of engineering

• Should have proven track record in handling Big Data Technology and comfortable in the dynamic atmosphere of a technical organization with a rapidly expanding customer base.

• Should be hands on with Spark and Scala and well versed with setting up Data Pipelines in Hadoop eco system. Should be able to tune the big data applications.

• Should have basic knowledge of setting up the Big data pipeline in a Cloud environment like AWS or MS Azure or Google Cloud.

• Basics understanding of search engines like elastic search or solr would be nice.

• Good problems solving and debugging skills are must

• It would be nice if candidate understands the basics of micro services

• Candidate must be organized and analytical, able to design and implement Big Data architecture

• Good understanding of RDBMS & NoSQL databases

• Strong written communications and documentation experience

• Excellent interpersonal, written, and verbal communication skills

Job Type: Full-time

Salary: Up to ₹800,000.00 per month

Benefits:

• Flexible schedule
• Paid time off
• Work from home

Schedule:

• Flexible shift

Supplemental Pay:

• Performance bonus

Experience:

• total work: 1 year (Preferred)

Work Remotely:

• Yes