Software engineer Web Scraping/ Crawling

☞ Best InfoSystems Ltd.

Vue: 101

Jour de mise à jour: 06-05-2024

Localisation: Pune Maharashtra

Catégorie: IT - Logiciel

Industrie: FinTech Payments

Niveau: Software Developer

Type d’emploi: Full Time, Permanent

Expérience: 2 - 5 years

Loading ...

le contenu du travail

As a Web Crawler, your role is to apply your knowledge set to fetch data from multiple online sources

- Developing highly reliable web crawlers and parsers across various websites

- Extract structured/unstructured data and store them into SQL/No SQL data store

- Work closely with Project/Business/Research teams to provide scrapped data for analysis

- Maintain the scrape projects delivered to production

- Develop frameworks for automating and maintaining constant flow of data from multiple sources

- Work independently with minimum supervision

- Develop a deep understanding of the data sources on the web and know exactly how, when, and which data to scrap, parse and store this data

Required Skills:

- Proficient knowledge in Python language and excellent knowledge on Web Crawling/Web scraping in Python Scrapy, Beautifulsoup or URLlib and Selenium

- Experience with data parsing - Strong knowledge of Regular expression, HTML, CSS, DOM, XPATH. Knowledge of Javascript would be a plus

- Must be able to access, manipulate, and transform data from a variety of database and flat file sources. SQL skills are essential. Experience with MongoDB would be a plus.

- Must be able to develop reusable code-based scraper products which can be used by others.

- Proficient understanding of Git

- Familiarity with AWS or Azure cloud-based technologies is a plus

- A basic understanding of business operations is needed so you can ask the right questions and deliver the right results in a way that is understandable and usable to your clients.

- A track record of digging in to the tough problems, attacking them from different angles, and bringing innovative approaches to bear is highly desirable. Must be capable of self-teaching new techniques.

Behavioral:

- Be excited by and have positive outlook to navigate ambiguity

- Passion for results and excellence

- Team player

- Must be able to get the job done by working collaboratively with others

- Be inquisitive and an analytical mind; out-of-the-box thinking

- Prioritize among competing opportunities, balance consumer needs with business and product priorities, and clearly articulate the rationale behind product decisions

- Straightforward and professional

- Good communicator

- Maintain high energy and motivate

- A do-it-yourself orientation, consistent with the company’s - roll-up the-sleeves- culture

- Proactive

Loading ...
Loading ...

Date limite: 20-06-2024

Cliquez pour postuler pour un candidat gratuit

Postuler

Signaler des emplois
Loading ...
Loading ...

MÊMES EMPLOIS

Loading ...
Loading ...