192 viewsTalent
Joseph G. — Senior AI & LLM Quality Assurance Engineer from Kenya

Joseph G.

Senior AI & LLM Quality Assurance Engineer

Kenya 3-6 years
Open to offersNew to Platform
Languages
EnglishSpanishFrenchDutch
Video Introduction
No video introduction yet
The candidate has not added a video.
Contact information and social networks are private. Connect to unlock.
Hidden

About

Joseph G. is an experienced AI Agent Quality Assurance Engineer and Software Engineer specializing in large language model (LLM) evaluation, automated testing, and prompt engineering. With over five years of hands-on work, Joseph has spearheaded AI benchmarking and QA initiatives across domains such as finance, economics, statistics, linguistics, and scientific research. He has built and managed Python-based testing frameworks, implemented Docker containerized environments, and established robust CI/CD pipelines for model validation at organizations including Amazon, Ford Motor Company, Tesla, and in fintech and financial AI systems. Joseph’s work includes designing evaluation rubrics, detecting model hallucinations, evaluating autonomous agent workflows, and constructing structured feedback mechanisms for factual accuracy and logical consistency. His analytical proficiency extends to statistical modeling, financial data analysis, web scraping, and technical writing in both corporate and freelance environments.

Experience

  • Freelance Writer

    Upwork · 2025 — 2025
    Generated technical documentation and structured content for software teams.
  • AI Evaluation & Software Engineer

    Company not specified · 2020 — 2024
    Oversaw AI evaluation projects concentrating on LLM testing and comprehensive QA processes. Developed benchmarks for multi-step reasoning and evaluation criteria. Created automated testing frameworks to assess AI-generated outputs. Performed analysis for hallucination detection and logical validation, in addition to implementing Docker-based sandbox setups and CI/CD pipelines.
  • AI Agent Quality Assurance Engineer (Freelance)

    Company not specified · 2022 — 2024
    Assessed autonomous AI agents focusing on tool usage and reasoning workflows. Validated API orchestration and function-calling outputs, while also designing metrics for reliability and regression QA pipelines. Provided structured feedback aimed at enhancing model performance.
  • Prompt Engineering & Model Behavior Analysis

    Company not specified · 2021 — 2024
    Formulated controlled prompt variations to gauge behavioral sensitivity of models. Conducted red-team stress tests to evaluate reasoning limits, identifying bias, hallucinations, and unsafe outputs.
  • Prompt Engineering & Testing (Financial AI Systems)

    Company not specified · 2023 — 2024
    Crafted prompts for assembling financial reports, earnings summaries, and conducting investment analysis. Reviewed outputs related to portfolio management, risk assessment, and market trends, enhancing AI-generated budgeting and forecasting tools.
  • Quality Assurance / AI Evaluation (Fintech Systems)

    Company not specified · 2024 — 2024
    Analyzed AI responses in areas such as lending, credit scoring, and personal finance to detect hallucinations and factual inaccuracies. Evaluated AI chatbots designed for banking and fintech applications.
  • Automotive Engineer

    Ford Motor Company · 2023 — 2024
    Created simulation models to evaluate vehicle performance and executed integration testing for both mechanical and electrical systems.
  • Web Scraping & Data Extraction Specialist

    Upwork · 2024 — 2024
    Engineered Python scraping pipelines utilizing BeautifulSoup, Selenium, and Scrapy. Provided structured datasets aimed at AI training and market research, improving scraping systems for enhanced performance and reliability.
  • LLM Testing, Prompt Evaluation & Quality Assurance

    Company not specified · 2021 — 2023
    Performed structured prompt testing along with adversarial evaluations, assessing factual accuracy and reasoning depth. Established grading frameworks tailored for model benchmarking and comparative analysis.
  • Software Engineer in Test

    AMAZON · 2020 — 2022
    Constructed Python-based automated testing frameworks while integrating regression testing pipelines. Validated distributed systems as well as APIs to ensure both scalability and reliability.
  • Technical Writer

    Microsoft · 2021 — 2022
    Produced technical documentation, API guides, and resources for developers.
  • Automotive Data Analyst

    Tesla · 2021 — 2021
    Utilized Python for analyzing vehicle telemetry data, focusing on optimizing performance metrics and predictive maintenance models.

Skills & Expertise

Education

  • Diploma in Civil Engineering
    Virginia Tech · — — 2026
  • Diploma in Economics
    Middlebury College · — — 2025
  • Diploma in Business Analytics
    Middlebury College · — — 2024
  • Diploma in Compliance & Risk Management
    California Baptist University · — — 2023
  • Diploma in Finance
    Mendoza College of Business · — — 2022
  • Diploma in Machine Learning
    University of Ottawa · — — 2021
  • Diploma in Medicine
    Stanford University School of Medicine · — — 2021
  • Diploma in Artificial Intelligence
    SANS Technology Institute · — — 2020
  • Diploma in Statistics
    Middlebury College · — — 2020
  • BSc Computer Science
    California Baptist University · — — 2019

Interested in this professional?

Sign in as an employer to save this profile or invite Joseph G. to a job.

Sign in as an employer