Das ist der Job
This is a hands‑on technical leadership role.
Darum lohnt es sich
The Tech Lead sets the technical direction for AI evaluation across a large and growing portfolio, provides technical leadership to a team of data analysts who execute evaluation work, and partners directly with AI program teams to raise the quality of how AI is validated, monitored, and improved over time.
We need a technical leader who can guide program teams toward better‑designed evaluations up front, instrument meaningful production monitoring, and continually advance the methods we use, from LLM‑as‑Judge frameworks to simulation‑based testing to pragmatic experiment design that actually scales in healthcare.
Job Duties What You Will Own The technical evaluation methodology applied to AI programs across the enterprise, pre‑production validation, production monitoring, and ongoing optimization Hands‑on guidance to program teams as they d Location
Work from home (Pennsylvania)
Shift
Days (United States of America)
Scheduled Weekly Hours
40
Worker Type
Regular
Exemption Status
Yes
Job Summary
The Tech Lead Data Scientist, AI Evaluation & Monitoring is the principal technical expert for how Geisinger evaluates, monitors, and optimizes AI systems in production.
The role exists because AI at Geisinger has scaled past the point where oversight can be a document‑review exercise.
