Clash
of Jobs
YipitData is seeking a Web Crawling Specialist to join its Data Solutions team. The ideal candidate will play a pivotal role in designing, refactoring, and maintaining resilient, efficient, and scalable web scrapers that power critical reports across the organization. This role involves collaborating with cross-functional teams, implementing advanced scraping techniques, and driving continuous improvement in web data extraction processes.
Responsibilities:
- Refactor and Maintain Web Scrapers
- Implement Advanced Scraping Techniques
- Collaborate with Cross-Functional Teams
- Monitor and Troubleshoot
- Drive Continuous Improvement
Requirements:
- Effective communication in English with both technical and non-technical stakeholders.
- 4+ years of experience with web scraping frameworks (e.g., Selenium, Playwright, or Puppeteer).
- Strong understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics.
- Expertise in advanced fingerprinting and evasion strategies (e.g., browser fingerprint spoofing, request signature manipulation).
- Deep experience managing cookies, headers, session states, and proxy rotations, including the deployment of both residential and data center proxies.
- Experience with logging, metrics, and alerting to ensure high availability.
- Troubleshooting skills to optimize scraper performance for efficiency, reliability, and scalability.
What YipitData offers:
- Vacation time
- Parental leave
- Team events
- Learning reimbursement
YipitData (Alternative)
YipitData is a market-leading data and analytics firm, analyzing billions of data points daily to deliver detailed insights across diverse industries like consumer brands, technology, and healthcare. Utilizing proprietary technology, they identify, license, clean, and analyze crucial data for global investment funds and corporations. A fast-growing company with a people-first culture, YipitData is backed by The Carlyle Group and Norwest Venture Partners. With a global presence spanning multiple offices in North America and Asia, they continue to expand their reach and impact in global markets.