Senior Big Data Engineer

Discover the Unexpected

Experian is the world’s leading global information services company. We are listed on the London Stock Exchange (EXPN) and are a constituent of the FTSE 100 Index. We’re passionate about unlocking the power of data in order to transform lives and create opportunities for consumers, businesses and society. For more than 125 years, we’ve helped businesses grow, consumers and small businesses gain access to financial services, and economies and communities flourish – and we’re not done.

Our 18k amazing employees in 40+ countries believe the possibilities for you, and the world, are growing. We’re investing in the future, through new technologies, talented people and innovation so we can help create a better tomorrow.

To do this we employ the greatest and brightest minds that share our purpose and want to make a difference. Experian Asia Pacific’s culture, people and environments are key differentiators. We focus on what truly matters; diversity and inclusion, work/life balance, flexible working, development, equity, engagement, collaboration, wellness, reward & recognition, volunteering... the list goes on. We’re committed to fostering a strong sense of belonging and a place where you can bring your true self to work.

Our uniqueness is that we truly value yours. We’re an award winning organisation due to our strong people first focus. This includes Top Employer™ and Great Place To Work™ accreditations.

Learn more at www.experianplc.com

The Responsibilities:

• Define technical scope and objectives through research and participation in requirementsgathering and definition of processes
• Ingest and Process data from various sources in raw, structured, semistructured, and unstructured format into Big Data ecosystem
• Realtime data feed processing using Big Data ecosystem
• Design, review, implement and optimize data transformation processes in Big Data ecosystem
• Test and prototype new data integration tools, techniques and methodologies
• Participate in overall test planning for the application integrations, functional areas and projects.
• Work with cross functional teams in an Agile/Scrum environment to ensure a quality product is delivered

Technical Skills:

• 10+ years of handson experience with enterprise scale applications and systems
• 5+ Year of expertise in Big Data technologies in Hadoop ecosystem
  • Spark, Yarn, Kafka, Oozie, HBase, Hive, Spark, HDFS, MapReduce etc.
  • Hadoop distributions like Cloudera (preferred)
• Extensive development experience in Java specifically in Spring Framework and related technologies (Springboot, SpringData, SpringCloud, SpringSecurity etc...)
• Experience with Scala is highly desirable
• Strong understanding of data analytics and data visualization
• Experience with Python and Ruby is a plus

• Excellent analytical and problem solving skills
• Excellent one-on-one communication and presentation skills, specifically able to convey technical information in a clear and unambiguous manner
• Working knowledge of Linux operating system

Qualification

• Technically focused Bachelor’s degree in Computer Science, Engineering, Math, etc.
• Master Degree is a plus