Pearl Health
Democratizing access to value in healthcare
Staff Software Engineer, Applied AI
Location
New York + 2 moreAll locations: New York, Massachusetts, Washington
Posted
21 days ago
Salary
$180K - $240K / year
8 yrs expEnglishAWSCloudDistributed SystemsMicroservices
Job Description
• Architect and build the foundational LLM architecture (RAG, Agents, Vector DBs) that powers high-impact product features across the organization.
• Design and deliver high-performance, distributed systems (data pipelines, APIs, microservices) that process healthcare data at scale and securely integrate LLM outputs into the user experience.
• Drive Proof-of-Concepts (POCs) and technical evaluation of new AI technologies to validate their product viability and scalability.
• Design and build responsive web applications using modern frontend frameworks to deliver intuitive, user-facing intelligence and analytic features.
• Ensure observability, monitoring, and operational excellence, championing security and regulatory compliance (HIPAA, SOC2).
• Drive system design and technical planning for all critical projects, including large, complex, and cross-functional initiatives across the organization.
• Partner strategically with Product, Operations, and Design leadership, translating complex business requirements into technical strategies and influencing roadmap prioritization.
• Mentor engineers at Software Engineer I, II, and III levels, accelerating their technical growth and leadership development.
• Educate the organization on the capabilities, best practices, and limitations of using LLMs and applied AI within the healthcare domain.
• Define and implement engineering standards, patterns, and best practices that significantly improve scalability, reliability, and developer productivity across the product.
Job Requirements
- 8-12 years of experience in large-scale software engineering, with a proven track record in service-oriented architectures and large data systems.
- Demonstrated architectural experience designing and implementing highly observable, scalable distributed systems, including complex microservices and event-driven architectures.
- Hands-on experience in the full-stack productization of Applied AI/LLM features, specifically working with RAG architectures (chunking strategies, semantic search, vector databases) and Agentic workflows.
- Cloud platform proficiency (preferably AWS), including hands-on experience with infrastructure design, deployment pipelines, and cost optimization.
- Expertise in designing and optimizing data-intensive applications, including deep database expertise (schema design, query optimization) and data consistency patterns.
- A strong leadership track record in driving technical direction for significant, cross-functional projects.
Benefits
- Additional Compensation: This role is eligible for a discretionary performance bonus and equity options.
- Benefits: We offer a competitive benefits package. More on our careers page.