Software Engineer, Frontier AI Infrastructure

Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic Public Sector Engineering team. In this role, you will own the model inference layer, enabling state-of-the-art models and managing networking, while leading technical discussions with cloud vendors and customers to deliver on critical contracts.

Responsibilities

• Design and implement secure scalable backend systems for Public Sector customers, leveraging Scale's modern and cloud-native AI infrastructure
• Own services or systems and define their long-term health goals, while also improving the health of surrounding components
• Re-architect the stack to run in compliant or restrictive environments. This requires designing swappable components (auth, storage, logging) to meet government/security mandates without breaking the product
• You will work with Product to build integration tests that catch issues early, shifting the focus from "infra-only debugging" to preventing failures upstream
• Participate actively in customer engagements, working closely with stakeholders to understand requirements and deliver innovative solutions
• Contribute to the platform roadmap and product strategy for Scale AI's Public Sector business, playing a key role in shaping the future direction of our offerings

Preferred

• Full Stack Development: Proficiency in both front-end and back-end development, including experience with modern web development frameworks, programming languages, and databases. Experience with developing & delivering software to air-gapped & isolated environments is a plus
• Cloud-Native Technologies: Understanding of containerization (e.g., Docker) and container orchestration (e.g., Kubernetes) is desired. Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and experience in developing and deploying applications in a cloud-native environment
• Security Focused: Experience with Federal Compliance frameworks, and requirements(e.g, Cloud SRG, FedRAMP, STIG Benchmarks, etc). Experience developing software & technical solutions that meet strict security & regulatory compliance requirements
• Problem Solving: Strong analytical and problem-solving skills to understand complex challenges and devise effective solutions. Ability to think critically, identify root causes, and propose innovative approaches to overcome technical obstacles
• Collaboration and Communication: Excellent interpersonal and communication skills to effectively collaborate with cross-functional teams, stakeholders, and customers. Ability to clearly articulate technical concepts to non-technical audiences and foster a collaborative work environment
• Adaptability and Learning Agility: Willingness to embrace new technologies, learn new skills, and adapt to evolving project requirements. Ability to quickly grasp and apply new concepts and stay up-to-date with emerging trends in software engineering
• Full Stack Development
• Cloud-Native Technologies
• Containerization
• Container Orchestration
• AWS
• Azure
• GCP
• Federal Compliance
• Cloud SRG
• FedRAMP
• STIG Benchmarks
• Problem Solving
• Collaboration
• Communication
• Adaptability
• Learning Agility

Benefits

• Equity based compensation, subject to Board of Director approval
• Comprehensive health, dental and vision coverage
• Retirement benefits
• A learning and development stipend
• Generous PTO
• Commuter stipend

Company

• AI data and evaluation platform for enterprises and governments
• San Francisco, California, USA
• https://scale.com/
• Founded in 2016
• 501-1000 employees

Qualifications

• At least an active secret clearance and the ability & willingness to up level to TS/SCI with CI Poly. This is a requirement and candidates will not be considered who do not hold at least a secret clearance
• Full Stack Development: Proficiency in both front-end and back-end development, including experience with modern web development frameworks, programming languages, and databases. Experience with developing & delivering software to air-gapped & isolated environments is a plus
• Cloud-Native Technologies: Understanding of containerization (e.g., Docker) and container orchestration (e.g., Kubernetes) is desired. Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and experience in developing and deploying applications in a cloud-native environment
• Security Focused: Experience with Federal Compliance frameworks, and requirements(e.g, Cloud SRG, FedRAMP, STIG Benchmarks, etc). Experience developing software & technical solutions that meet strict security & regulatory compliance requirements
• Problem Solving: Strong analytical and problem-solving skills to understand complex challenges and devise effective solutions. Ability to think critically, identify root causes, and propose innovative approaches to overcome technical obstacles
• Collaboration and Communication: Excellent interpersonal and communication skills to effectively collaborate with cross-functional teams, stakeholders, and customers. Ability to clearly articulate technical concepts to non-technical audiences and foster a collaborative work environment
• Adaptability and Learning Agility: Willingness to embrace new technologies, learn new skills, and adapt to evolving project requirements. Ability to quickly grasp and apply new concepts and stay up-to-date with emerging trends in software engineering

Required skills

• AWS, Air-Gapped and Isolated Environments, Azure, Backend Systems Design, Cloud SRG, Cloud-Native AI Infrastructure, Databases, Docker, FedRAMP, Federal Compliance Frameworks, Full Stack Development, GCP, Integration Testing, Kubernetes, Modern Web Development Frameworks, Programming Languages, STIG Benchmarks, TS/SCI Clearance with CI Poly