↑↓ MoveEnter OpenEsc Close
All experiments
L-015 / Decision-support researchActive

Choosing an AI provider for school software

The Skoolbod team is experimenting with AI models. To support that work, I compared four providers across six criteria. This is decision-support research. It hasn’t reached a prototype, and it doesn’t select a provider.

  • Provider evaluation
  • Data protection
  • Cost comparison
The question

What I wanted to find out

How capability, cost, reliability, guardrails, ease of integration, and data handling compare across providers that could realistically serve Skoolbod.

How to explain those trade-offs to people who aren’t engineers, without hiding the numbers engineers need.

Progress

What exists so far

  • A side-by-side comparison of DeepSeek, OpenAI GPT-5 mini, Anthropic Claude Haiku, and Google Gemini Flash.
  • A plain-language explanation of each criterion, with the supporting figures kept in a separate technical section.
  • A summary of independent red-team findings and each provider’s data-handling terms.
Evidence

The comparison

The comparison at the time of the research. Prices, uptime, and models change, so treat the figures as approximate.
CriterionDeepSeekOpenAI (GPT-5 mini)Anthropic (Claude Haiku)Google (Gemini Flash)
Relative costLowest (the baseline)About 2 to 7 timesAbout 7 to 10 timesAbout 10 to 18 times
CapabilityHighGoodGoodGood
GuardrailsWeaker in published testsStrongStrongStrong
Uptime over the past yearAbout 97.8%99.9% or better99.9% or better99.9% or better
Ease of integrationEasy, with less mature toolingEasiestEasyEasy
Where data is storedChinaUSAUSAUSA
Choices

Choices that shaped it

Data handling carries real weight for children’s data

Skoolbod handles children’s data, and Nigeria’s Data Protection Act limits sending that kind of data abroad without proper legal safeguards. I couldn’t find evidence that DeepSeek offers the formal data protection agreement this would need, and its terms reportedly allow API data to be used for training. OpenAI, Anthropic, and Google offer such agreements and exclude API data from training.

Read guardrail tests carefully

The independent red-team tests that found weaker guardrails in DeepSeek were run on an earlier version more than a year before the research, and I couldn’t find equally rigorous tests of the current one. A separate study found that fine-tuning could remove guardrails from every model it tested, so no provider’s safety controls are absolute.

Keep switching possible

DeepSeek’s API is compatible with OpenAI’s, so moving between the two, or using both, is technically feasible.

Limits

What this doesn’t show yet

  • No provider has been selected. This research supports the decision; it doesn’t make it.
  • There is no prototype and no released Skoolbod AI feature. The team is still experimenting with models.
  • Prices, uptime, and model versions change quickly, so the figures describe the time of the research.
  • The guardrail findings come from third-party tests of earlier model versions.
So far

What I learned

The cheapest option, and one of the most capable on paper, was also the hardest to justify for children’s data. Data handling has to be weighed alongside price and benchmark scores.

Status

Next step

Keep the comparison current while the team experiments with models ahead of a prototype.

Active