Golang Software Engineer – Infrastructure & Scraping Systems Team

About the role

This role involves maintaining and scaling the core infrastructure that supports Corsearch's high-volume scraping operations. The goal is to ensure the system can handle the data demands from a large client base. This includes optimizing existing systems and reducing operational overhead by decommissioning inefficient legacy infrastructure.

A key part of the work will be migrating machine learning models, specifically for tasks like logo detection, from CPU-based setups to more cost-effective GPU deployments. This requires working with Kubernetes and validating the accuracy of GPU outputs against current CPU performance to ensure efficient scaling.

The team operates within an AWS environment, so familiarity with cloud infrastructure is important. Success in this position means contributing to a streamlined, efficient, and scalable data pipeline that supports brand protection efforts by safeguarding client assets in a complex digital landscape.

The salary for this full-time remote position is between $80,500 and $138,000 USD.

Skills that matter here

• Golang: This role requires strong practical experience writing backend services in Golang, or a willingness to transition to it if coming from C/C++.
• C/C++: Proficiency in C/C++ for backend services is acceptable, provided the candidate is motivated to primarily develop in Golang moving forward.
• Kubernetes: Proven experience deploying, scaling, and managing heavy workloads using Kubernetes is essential for this infrastructure role.
• AWS: Solid foundational experience with Amazon Web Services is required, as the company's operations are hosted in AWS environments.

Who this role suits

• A person who enjoys optimizing and scaling high-load systems.
• Someone with a background in backend development who is adaptable to new languages like Golang.
• An individual who values efficiency and is proactive in identifying and decommissioning legacy systems.
• A candidate who is comfortable working with cloud-based infrastructure and container orchestration.

From the employer

Responsibilities and Duties

• High-Load Infrastructure Management: Maintain, scale, and optimize the underlying core infrastructure that powers our high-volume scraping operations to effortlessly sustain the data demands of thousands of clients.
• GPU Migration & Optimization: Cooperate on transitioning machine learning models (such as logo detection) from expensive CPU setups to cost-effective GPU deployments using Kubernetes. Validate GPU outputs rigorously against CPU baselines to ensure scaling efficiency.
• System Decommissioning: Help identify, deprecate, and decommission legacy, inefficient scraping infrastructure to continually reduce operational overhead and streamline our high-load data pipelines.

Essential

• Golang or C/C++ Proficiency: Strong, practical experience writing backend services in either Go or C/C++ is a strict requirement for this role. If your primary expertise is in C++, you must be fully willing and motivated to learn, adapt, and develop primarily in Go moving forward.
• Containerization & Orchestration: Proven experience deploying, scaling, and managing heavy workloads using Kubernetes.
• Cloud Infrastructure: Solid foundational experience working within AWS (Amazon Web Services) environments where our operations live.