Maria I.
Mid-Level AI Evaluation Specialist
Open to offersNew to PlatformAbout
Maria Isabelle M. is an experienced AI Evaluation Specialist based in Lipa City, Batangas, Philippines, with a specialization in production-level LLM and multimodal evaluation. She excels in areas such as hallucination detection, reasoning analysis, and pre-acceptance dataset quality control, where she consistently processes 20–25 QA tasks daily under strict audit thresholds. Previously serving as an Analyst in the AI/LLM Evaluation Practice at Innodata Knowledge Services Inc., Maria ensured dataset integrity by reviewing conversational AI outputs and complex visual datasets, highlighting her proficiency in Conversational AI Evaluation and Multimodal Annotation QA. Her contributions include reducing spatial inconsistency risks and escalating critical evaluation failures to prevent downstream error propagation. With a strong foundation in QA governance from her tenure at Vanguard Screening Solutions and Accenture, Maria has significantly impacted workflow consistency and error prevention, showcasing her expertise in QA Operations & Risk Control.
Experience
Analyst – AI/LLM Evaluation Practice
INNODATA KNOWLEDGE SERVICES INC. · 2026 — 2026Managed multimodal QA review workflows to ensure defective outputs did not enter validated datasets. Evaluated bounding boxes, segmentation outputs, and object localization annotations ahead of dataset integration to mitigate spatial inconsistency risks. Identified patterns of systemic hallucination and annotation inconsistencies during iterative review cycles, which enhanced evaluation stability and minimized rework. Escalated critical evaluation failures and ambiguous annotation cases before dataset finalization to avert error propagation. Contributed to calibration alignment to reduce evaluator variance and enforced a structured rubric across QA processes while maintaining daily task completion under audit thresholds without compromising quality.Service Level Manager
VANGUARD SCREENING SOLUTIONS · 2015 — 2017Developed QA governance frameworks for multi-stage verification workflows to enhance client onboarding operations. Performed structured audits of identity, employment, and academic verification data, reinforcing data integrity in verification processes. Established a risk-based QA classification system to standardize decision-making and improve screening consistency. Monitored service-level and accuracy metrics to identify inefficiencies affecting QA reliability and operational stability. Managed cases of escalated verification delays and vendor inconsistencies, ensuring prompt resolution and corrective measures. Initiated process optimization projects that decreased operational delays while upholding QA compliance standards, providing structured coaching to enhance consistency and accuracy in verification protocols.Senior HR Assistant
ACCENTURE INC. · 2011 — 2015Conducted audits of background screening and pre-employment verification data to ensure accuracy, completeness, and compliance with SOPs before approval workflows. Worked to identify discrepancies in employment, education, and criminal record checks, enhancing the integrity of screening data. Implemented a structured QA classification framework to standardize screening decisions, thereby improving consistency. Managed high-volume QA audits while adhering to strict compliance and quality control standards. Mitigated verification discrepancies via structured cross-checking and revalidation processes while coordinating with recruitment teams to resolve any screening issues.Background Investigation Assistant (Contract)
ACCENTURE INC. · 2010 — 2011Reviewed background investigation reports for accuracy, completeness, and SOP compliance before final processing. Handled high-volume verification data, ensuring adherence to stringent QA and quality control standards. Identified and escalated significant discrepancies and critical validation issues for corrective action, while maintaining secure documentation in line with governance and confidentiality requirements.
Skills & Expertise
Education
- Bachelor of Science in NursingGlobal City Innovative College