At Zyte, we're pioneering the next revolution in web data extraction, empowering businesses to focus on innovation. Companies often struggle with challenges like navigating dynamic web structures, countering anti-scraping measures, and ensuring data accuracy. We tackle these obstacles by providing best-in-class tools for seamless, reliable web data extraction. With over a decade of expertise, we’ve become the trusted solution for over 3,000 companies and a million developers, helping them achieve a competitive edge and drive sustainable growth.
We are a diverse and enthusiastic team of data nerds, tech aficionados, and hackers. At Zyte, you'll join an inclusive community where everyone belongs. We thrive on collaborating with our smart, passionate teammates and customers to solve complex problems in data science and engineering.
Join us and be part of the data revolution!
About The Job
As a Principal Reverse Engineer, you will be integral to the development of Zyte’s flagship product, Zyte API. You will collaborate closely with the product and engineering teams engineers to build and optimize a high-performance scraping service capable of downloading data at over 10k RPS. This role offers the opportunity to innovate with anti-detect browsers, advanced automation tooling, constantly pushing the limits of web scraping technology.
Requirements
Roles & Responsibilities:
Lead the research of new methods and technologies to enhance web scraping techniques, identify patterns in web data, and design data-driven approaches that utilize these patterns to optimize scraping efficiency and accuracy.
Devise new scraping strategies and algorithms to handle various website structures and anti-scraping measures
Detect and analyze changes in website structures, content delivery methods, and anti-scraping technologies to adapt and refine scraping tools.
Provide strategic insights of modern web scraping challenges to our products, rapidly developing prototypes for overcoming anti-scraping techniques and ensuring data retrieval consistency.
Collaborate with cross-functional software engineering teams in developing robust and scalable web scraping solutions. Contribute to Zyte’s anti-detect browser and browser automation tooling.
Identify and assess emerging risks in web scraping, ensuring compliance with legal and ethical standards.
Mentor engineers to plan and conduct advanced web scraping research, fostering a culture of innovation and continuous improvement.
Requirements:
Embrace the inherent uncertainty of this role and enjoy the freedom to carve your own path.
Possess a hacker mindset, able to rapidly develop proof of concepts to achieve results.
Approach project prioritization logically and with a measurement-backed strategy, thriving in collaborative environments with like-minded colleagues.
Have a solid understanding of techniques and tools for crawling, extracting, and processing data
Demonstrate strong proficiency in JavaScript/Node.js, Python, and Java, coupled with a broad programming background and exceptional problem-solving abilities.
Possess strong research, debugging, fuzzing, and reverse engineering skills, including static, dynamic, and concolic analysis.
Have a deep understanding of operating systems and computer networking concepts.
Adept with tools such as Wireshark, Burp Suite etc to intercept and debug network traffic.
Understand browser engines, browser fingerprinting, and ad-blocker mechanisms.
Bonus points for:
Experience with Decompilers, IDA Pro, Ghidra or Frida, Jadx, and Babel
Experience with C/C++
Core contributions to Mozilla or Chromium projects
Benefits
By joining the Zyte team, you will:
As a new Zytan, you will:
Become part of a self-motivated, progressive, multi-cultural team.
Have the freedom and flexibility to work from where you do your best work.
Attend conferences and meet with team members from across the globe.
Work with cutting-edge open source technologies and tools.
Principal Reverse Engineer - Remote