Sarah O.
Senior AI Evaluation Specialist
Open to offersNew to PlatformAbout
Sarah O. is an experienced AI Evaluation Specialist with a career spanning over 25 years, dedicated to the evaluation and improvement of artificial intelligence technologies. Her comprehensive expertise in legal analysis, project management, and quality assurance has been applied across various fields including software implementation, insurance, and business operations. With over 2,100 hours invested in evaluating large language models (LLMs), Sarah's work encompasses legal reasoning, safety, creative writing, multimodal assessment, prompt engineering, and response evaluation projects. She serves as a trusted Outlier reviewer, recognized for her analytical reasoning and attention to detail. As the owner of Mindset Rush, she oversees AI evaluation, digital consulting, and manages projects globally from her remote location in the Netherlands. Her technical proficiency includes software such as ChatGPT, Gemini, Jira, and Azure DevOps, ensuring high-quality deliverables and strategic project implementations.
Experience
Owner
Mindset Rush · 2025 — PresentOperated an independent business offering services in AI evaluation, analytical review, legal analysis, and digital consulting. Conducted AI prompt engineering and response evaluation while managing WordPress website administration, SEO, Google Ads, and customer support.AI Evaluation Specialist
Outlier · 2024 — PresentExecuted over 2,100 hours assessing and enhancing large language models through various AI training projects. Evaluated AI-generated outcomes for legal reasoning, accuracy, safety, creativity, and adherence to instructions. Crafted evaluation rubrics to measure reasoning quality and consistency in AI outputs, providing structured justifications and actionable feedback.Implementation Project Manager
Corpay Solutions · 2023 — 2024Oversaw end-to-end implementation projects for business clients adopting payment processing software. Coordinated project timelines and milestones while liaising with customers and internal teams to ensure effective deployments. Developed documentation, training resources, and managed quality assurance processes throughout.Project Manager
Clarity Ventures · 2021 — 2022Managed custom web development and e-commerce projects for clients, ensuring scope, timelines, and communication were effectively maintained. Facilitated Agile workflows and conducted quality assurance reviews while coordinating across teams throughout the software development lifecycle.Technical Support Specialist II / Project Manager
FurstPerson · 2016 — 2021Delivered advanced technical support for enterprise clients using custom assessment platforms. Managed implementation projects and coordinated cross-functional teams. Developed user guides and training materials while conducting software testing and troubleshooting.Licensed Property & Casualty Insurance Agent
McDole Edge Corporation | Allstate | C&S Insurance · 2008 — 2016Interpreted insurance contracts and regulatory requirements while performing risk analysis for personal and commercial clients. Ensured compliance and clarity in policy documentation, applying analytical reasoning to address complex coverage inquiries.
Skills & Expertise
Education
- Associate of Applied Science, Paralegal StudiesKaplan University · — — 2012