Clash
of Jobs
YipitData is seeking a Data Engineer (Web Scraping) to join its Data Solutions team. The role involves designing, refactoring, and maintaining web scrapers that power critical reports across the organization. The Data Engineer will report to the Data Solutions Engineering Manager and ensure data ingestion processes are resilient, efficient, and scalable.
Responsibilities:
- Refactor and Maintain Web Scrapers
- Implement Advanced Scraping Techniques
- Collaborate with Cross-Functional Teams
- Monitor and Troubleshoot
- Drive Continuous Improvement
Requirements:
- Effective communication in English with both technical and non-technical stakeholders.
- 4+ years of experience with web scraping frameworks (e.g., Selenium, Playwright, or Puppeteer).
- Strong understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics.
- Expertise in advanced fingerprinting and evasion strategies (e.g., browser fingerprint spoofing, request signature manipulation).
- Deep experience managing cookies, headers, session states, and proxy rotations, including the deployment of both residential and data center proxies.
- Experience with logging, metrics, and alerting to ensure high availability.
- Troubleshooting skills to optimize scraper performance for efficiency, reliability, and scalability.
What YipitData Offers:
- Comprehensive benefits and perks.
- Competitive salary.
- Vacation time, parental leave, team events, learning reimbursement.
YipitData (Alternative)
YipitData is a market-leading data and analytics firm, analyzing billions of data points daily to deliver detailed insights across diverse industries like consumer brands, technology, and healthcare. Utilizing proprietary technology, they identify, license, clean, and analyze crucial data for global investment funds and corporations. A fast-growing company with a people-first culture, YipitData is backed by The Carlyle Group and Norwest Venture Partners. With a global presence spanning multiple offices in North America and Asia, they continue to expand their reach and impact in global markets.