Pearl Health

Democratizing access to value in healthcare

Staff Software Engineer, Applied AI

Full TimeRemoteTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

New York + 2 moreAll locations: New York, Massachusetts, Washington

Posted

21 days ago

Salary

$180K - $240K / year

8 yrs expEnglishAWSCloudDistributed SystemsMicroservices

Job Description

• Architect and build the foundational LLM architecture (RAG, Agents, Vector DBs) that powers high-impact product features across the organization. • Design and deliver high-performance, distributed systems (data pipelines, APIs, microservices) that process healthcare data at scale and securely integrate LLM outputs into the user experience. • Drive Proof-of-Concepts (POCs) and technical evaluation of new AI technologies to validate their product viability and scalability. • Design and build responsive web applications using modern frontend frameworks to deliver intuitive, user-facing intelligence and analytic features. • Ensure observability, monitoring, and operational excellence, championing security and regulatory compliance (HIPAA, SOC2). • Drive system design and technical planning for all critical projects, including large, complex, and cross-functional initiatives across the organization. • Partner strategically with Product, Operations, and Design leadership, translating complex business requirements into technical strategies and influencing roadmap prioritization. • Mentor engineers at Software Engineer I, II, and III levels, accelerating their technical growth and leadership development. • Educate the organization on the capabilities, best practices, and limitations of using LLMs and applied AI within the healthcare domain. • Define and implement engineering standards, patterns, and best practices that significantly improve scalability, reliability, and developer productivity across the product.

Job Requirements

  • 8-12 years of experience in large-scale software engineering, with a proven track record in service-oriented architectures and large data systems.
  • Demonstrated architectural experience designing and implementing highly observable, scalable distributed systems, including complex microservices and event-driven architectures.
  • Hands-on experience in the full-stack productization of Applied AI/LLM features, specifically working with RAG architectures (chunking strategies, semantic search, vector databases) and Agentic workflows.
  • Cloud platform proficiency (preferably AWS), including hands-on experience with infrastructure design, deployment pipelines, and cost optimization.
  • Expertise in designing and optimizing data-intensive applications, including deep database expertise (schema design, query optimization) and data consistency patterns.
  • A strong leadership track record in driving technical direction for significant, cross-functional projects.

Benefits

  • Additional Compensation: This role is eligible for a discretionary performance bonus and equity options.
  • Benefits: We offer a competitive benefits package. More on our careers page.

Related Job Pages