Responsibilities
- Manage and maintain proxy pools (residential, ISP, and datacenter) for large-scale scraping operations.
- Set up and configure proxy rotation systems to avoid blocking and detection.
- Monitor proxy performance, uptime, latency, and success rates using tracking tools or dashboards.
- Troubleshoot proxy-related issues such as IP bans, slow response times, or authentication errors.
- Integrate proxy APIs and providers (e.g., Bright Data, Oxylabs, NetNut, Smartproxy, etc.) into scraping systems.
- Automate proxy assignment and rotation logic using scripts or scheduling tools.
- Design and develop a cross-platform proxy SDK that can be easily integrated into third-party applications.
- Implement core proxy server functionality including traffic routing, connection handling, and protocol support (HTTP/HTTPS, SOCKS5, etc.).
- Research and onboard new proxy vendors to improve reliability and geographic diversity.
- Maintain proxy usage documentation, IP lists, and system configurations.
- Collaborate with engineering teams to align proxy strategy with scraping needs and data volume goals.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, or related fields, or equivalent practical experience.
- Hands-on experience managing proxy servers, residential proxy APIs, or rotating proxy systems.
- Understanding of HTTP/S, SOCKS, DNS, IP rotation, user agents, and network protocols.
- Familiar with Python, C, TypeScript, Bash, or similar scripting languages for automation.
- Experience using Linux servers and basic networking commands.
- Strong problem-solving and analytical mindset.
- Detail-oriented, organized, and able to handle large-scale data environments.
Nice to Have
- Experience with proxy management platforms (Bright Data, Oxylabs, Smartproxy, etc.).
- Familiarity with cloud-based infrastructure (AWS, GCP, or DigitalOcean).
- Basic knowledge of web scraping tools (Selenium, Playwright, BeautifulSoup).
- Experience with monitoring dashboards (Grafana, Prometheus, or custom-built tools).
- Understanding of ethical and compliant proxy usage.
Interested in this role?
We'd love to hear from you. Send us your resume and let's start a conversation.
Apply Now