Python Developer
Role Overview The organization is seeking Python Web Scraping Engineers to design, build, and operate reliable web data collection systems. This role focuses on production-ready Python scrapers and browser automation, particularly across dynamic and JavaScript-heavy websites. The successful candidate will contribute to the reliability, scalability, and quality of Deep Future’s data pipelines. Important Requirement: Previous AWS experience is essential for this role. Key Responsibilities · Design, develop, and maintain Python-based web scrapers. · Build and maintain browser automation workflows using Playwright and Selenium. · Extract data from dynamic, JavaScript-heavy websites. · Maintain and improve scraping systems to handle routine target-site changes. · Containerise scraping services using Docker. · Deploy and operate scraping workloads on AWS. · Monitor scraper performance, reliability, and data quality. · Troubleshoot common failures, performance issues, and data collection inconsistencies. Required Skills & Experience · Working knowledge of AWS services such as EC2, ECS, Lambda, S3, and SQS. · Commercial experience using Python in production environments. · Experience building, maintaining, and improving web scrapers. · Practical experience with Playwright and/or Selenium. · Experience containerising applications with Docker. · Ability to write clear documentation and communicate effectively within a team. · Experience collaborating using tools such as Slack, Google Workspace, Jira, and Confluence. Desirable / Nice to Have · Exposure to sites protected by Cloudflare or similar web application firewalls. · Familiarity with CAPTCHA and bot-detection challenges. · Basic understanding of browser fingerprinting concepts. · Experience with higher-volume or distributed scraping systems. · Familiarity with monitoring and logging using AWS CloudWatch. Organization Offers · Ownership of meaningful parts of core data acquisition systems. · Opportunity to work on real-world data intelligence problems. · Support and mentorship from experienced engineers. · Flexible working arrangements. · Competitive remuneration aligned with experience. Ideal Candidate Profile The ideal candidate is a hands-on Python engineer with strong experience in production scraping, browser automation, AWS-based deployment, and reliable data pipeline operations. They should be comfortable working with changing web targets, debugging failures, documenting technical decisions, and collaborating closely with engineering teams to maintain high-quality data acquisition systems