Full-Stack Web Scraping Engineer (Python & JavaScript – 3 to 8 Years)

Full-Stack Web Scraping Engineer (Python & JavaScript – 3 to 8 Years)
Experience: 3+ Years
Location: Remote
Mode of Engagement: Full-time
No of Positions: 3
Educational Qualifications: Bachelor’s degree in computer science, Information Technology
Industry: IT / Software Development
Notice Period: Immediate Joiners Preferred

What We Are Looking For:

• Strong expertise in web scraping with hands-on experience in large-scale data collection systems.
• Proficient in Python, including Scrapy, Requests, Playwright, and Selenium.
• Skilled in JavaScript for web scraping and automation tasks.
• Capable of designing, building, and maintaining robust and scalable scrapers for a variety of websites.
• Experience with AI-driven techniques to improve scraping efficiency, data extraction accuracy, and automation workflows.
• Passionate about leveraging advanced technologies to solve complex data challenges

Key Responsibilities

• Design, develop, and maintain large-scale web scrapers to collect structured and unstructured data from multiple sources.
• Optimize scraping pipelines for scalability, reliability, and performance.
• Work with Scrapy and related Python frameworks/libraries for crawler development.
• Write JavaScript-based scrapers or automation scripts for complex websites with dynamic content.
• Monitor, debug, and maintain scrapers, ensuring high availability and fault tolerance.
• Implement AI/ML-based solutions in scraping workflows, such as:
• Using LLMs for content parsing/cleaning.
• Automating CAPTCHA solving and anti-bot evasion.
• Improving data matching, deduplication, and entity recognition.
• Collaborate with data engineers and product teams to ensure scraped data quality and usability.
• Maintain proper documentation, testing, and CI/CD practices for scraper code.

Qualifications

• Bachelor’s degree in computer science, IT, or related field.
• Strong programming skills in Python (Scrapy, Requests, Playwright/Selenium).
• Proficiency in JavaScript for handling browser automation and dynamic sites.
• Experience with large-scale scraping systems (distributed crawling, proxy rotation, request throttling).
• Solid understanding of web technologies (HTTP, HTML, CSS, JSON, AJAX).
• Experience working with databases (SQL/NoSQL) for storing and processing scraped data.
• Hands-on experience in AI/ML tools (e.g., OpenAI, Hugging Face, spaCy, Transformers, or LangChain) applied to data extraction/processing.
• Familiarity with containerization and orchestration (Docker, Kubernetes) for scraper deployments.
• Strong problem-solving skills for dealing with anti-bot measures and rate limits.
• Excellent communication and collaboration skills.

AIMLEAP is an ISO 9001:2015 and ISO/IEC 27001:2013 certified global technology consulting and service provider offering Digital IT, AI-augmented Data Solutions, Automation, and Research & Analytics Services.

AIMLEAP has been recognized as ‘The Great Place to Work®’. With focus on AI and automation-first approach, our services include end-to-end IT application management, Mobile App Development, Data Management, Data Mining Services, Web Data Scraping, Self-serving BI reporting solutions, Digital Marketing, and Analytics solutions.

We started in 2012 and successfully delivered projects in IT & digital transformation, automation driven data solutions, and digital marketing for more than 750 fast-growing companies in the USA, Europe, New Zealand, Australia, Canada; and more.

– An ISO 9001:2015 and ISO/IEC 27001:2013 certified
– Served 750+ customers
– 11+ Years of industry experience
– 98% Client Retention
– Great Place to Work® Certified
– Global Delivery Centers in the USA, Canada, India & Australia.