AI Python Sraper Swastika Web Technology

About Swastika Web Technology

Job Description

We're seeking a highly skilled Python Developer with deep experience in web scraping and integrating AI-powered chatbots (e.g., GPT-4, Claude, open-source LLMs). Key Responsibilities: Develop robust, scalable web scraping scripts using Python (e.g., Scrapy, Selenium, Playwright) Use AI/ML tools and techniques to intelligently parse unstructured or semi-structured data Handle anti-bot challenges (captchas, user agents, rotating proxies, rate limiting, etc.) Design scraping solutions for dynamic, JavaScript-heavy websites Integrate scraped data with internal tools, dashboards, or databases (e.g., MongoDB, PostgreSQL) Maintain and monitor scraping pipelines; implement logging and error-handling mechanisms Collaborate with product, data, and business teams to define scraping goals and strategies Keep systems updated with changes in target websites (DOM changes, login flows, etc.) Requirements: 35 years of professional experience in Python scripting, with a strong portfolio of scraping projects Solid experience with libraries like Scrapy, BeautifulSoup, Selenium, Playwright Experience in AI/ML-powered scraping (e.g., NLP to extract data from unstructured pages) Strong understanding of web technologies: HTML, CSS, JavaScript, HTTP/HTTPS, REST APIs Familiar with headless browsers, rotating proxies, and captcha-solving tools Experience with database management (SQL/NoSQL) Git version control, Docker containers, and basic Linux server management Strong problem-solving, documentation, and communication skills Looking for an immediate joiner. Job Type: Full-time Location Type: Remote Schedule: Day shift Work Location: Remote,