How Much Do Materials Databases Disagree? Materials Project vs JARVIS vs AFLOW vs OQMD
Key findings
- Typical agreement is tight. Half the compounds shared by Materials Project and JARVIS-DFT have the same band gap to within 0.01 eV (many are metals that both call metallic). Where both report a gap, the mean difference is 0.31 eV. The median hull-energy difference between Materials Project and OQMD is 3 meV/atom.
- The tail is long. One in ten shared compounds differs by more than 0.40 eV in band gap (MP vs JARVIS). One in ten differs by more than 232 meV/atom in hull energy (MP vs OQMD).
- Stability verdicts are fragile. 17–18% of shared compounds are on the hull in one database and above it in another. In 64–76% of those conflicts, both values are within 50 meV/atom of the hull.
- One modelling choice explains most large band-gap disagreements. 75% of Materials Project vs JARVIS gaps that differ by more than 1 eV are oxides or fluorides of Co, Cr, Fe, Mn, Mo, Ni, V or W. Materials Project applies a Hubbard U to exactly these compounds; JARVIS applies none. They make up only 11% of shared compositions. LiFePO4 is 3.92 eV in Materials Project (GGA+U) but 0.38 eV in JARVIS (no U). NiO is 2.30 eV versus 0.00 eV.
Band gaps: three databases, compared pairwise
Each dot is one composition both databases have computed, placed at the band gap each reports for its lowest-energy structure. Points on the dashed diagonal agree exactly; the shaded band marks ±0.5 eV. Dots along an axis are compounds one database calls metallic (gap ≤ 0.05 eV) and the other does not.
| Pair | Shared | Median |Δ| | Mean |Δ| | 90th pct |Δ| | |Δ| > 0.5 eV | Metal conflict | Mean |Δ|, both gapped |
|---|---|---|---|---|---|---|---|
| Materials Project vs JARVIS-DFT | 34,422 | 0.000 | 0.167 | 0.398 | 8.5% | 7.3% | 0.31 |
| Materials Project vs AFLOW | 18,414 | 0.011 | 0.259 | 0.798 | 13.9% | 8.7% | 0.29 |
| JARVIS-DFT vs AFLOW | 14,184 | 0.013 | 0.290 | 0.943 | 15.8% | 7.9% | 0.44 |
Why open DFT databases disagree
All four databases run density functional theory, but they don’t make the same choices. Materials Project uses PBE and PBE+U, with r2SCAN for many entries in recent releases. JARVIS-DFT uses the OptB88vdW functional without a Hubbard U. AFLOW and OQMD use PBE, with U values for selected transition-metal compounds. A Hubbard U opens gaps in correlated d-electron systems. That is why NiO and LiFePO4 look so different from one database to the next: 75% of the gap disagreements larger than 1 eV between Materials Project and JARVIS are oxides or fluorides of the eight elements Materials Project treats with a U.
Hull energies add a second layer. A compound’s energy above the hull is measured against every competing phase the database has computed in that chemical system. If one database has computed a more stable competitor, or never computed the experimentally observed structure, the verdict changes even when the underlying total energies are close. Each database also applies its own energy corrections to anions and elemental references.
None of this makes one database wrong. It means any single DFT number carries an uncertainty that the number itself doesn’t show. Our companion study, how accurate are DFT band gaps, measures that gap against experiment.
Stability: energy above the convex hull
Same comparison for energy above the hull. Values are capped at 1 eV/atom for display, and the shaded band marks ±50 meV/atom. A compound is counted as on the hull at ≤ 1 meV/atom.
| Pair | Shared | Median |Δ| | Mean |Δ| | 90th pct |Δ| | |Δ| > 50 meV | On-hull conflict | On hull in both |
|---|---|---|---|---|---|---|---|
| Materials Project vs OQMD | 43,064 | 0.003 | 0.147 | 0.232 | 20.6% | 17.3% | 18,388 |
| Materials Project vs JARVIS-DFT | 34,419 | 0.005 | 0.057 | 0.078 | 15.2% | 17.8% | 14,313 |
| OQMD vs JARVIS-DFT | 36,379 | 0.006 | 0.076 | 0.204 | 24.8% | 18.3% | 14,776 |
Familiar compounds across all four databases
Ground-state band gaps (eV) and energies above hull (eV/atom). A dash means that database has no entry, or (for AFLOW) no band gap on its lowest-energy structure.
| Compound | MP gap | JARVIS gap | AFLOW gap | Gap spread | MP E_hull | OQMD E_hull | JARVIS E_hull |
|---|---|---|---|---|---|---|---|
| Si | 0.61 | 0.74 | — | 0.13 | 0.000 | 0.000 | 0.000 |
| Ge | 0.00 | 0.00 | — | 0.00 | 0.000 | 0.000 | 0.000 |
| GaAs | 0.19 | 0.09 | — | 0.10 | 0.000 | 0.000 | 0.000 |
| GaN | 1.73 | 1.94 | — | 0.22 | 0.000 | 0.000 | 0.000 |
| ZnO | 0.72 | 0.96 | — | 0.24 | 0.000 | 0.000 | 0.000 |
| TiO2 | 2.06 | 2.05 | — | 0.01 | 0.000 | 0.000 | 0.000 |
| SiC | 1.84 | 1.62 | 1.97 | 0.35 | 0.000 | 0.000 | 0.000 |
| AlN | 4.05 | 4.47 | 4.06 | 0.43 | 0.000 | 0.000 | 0.000 |
| MgO | 4.43 | 4.85 | 4.47 | 0.42 | 0.000 | 0.000 | 0.000 |
| ZnS | 2.02 | 2.09 | 2.69 | 0.67 | 0.000 | 0.000 | 0.000 |
| CdTe | 0.58 | 0.50 | — | 0.09 | 0.000 | 0.000 | 0.000 |
| InP | 0.46 | 0.33 | — | 0.12 | 0.000 | 0.000 | 0.000 |
| LiFePO4 | 3.92 | 0.38 | 3.63 | 3.54 | 0.000 | 0.000 | 0.014 |
| Cu2O | 0.51 | 0.64 | — | 0.13 | 0.000 | 0.000 | 0.000 |
| NiO | 2.30 | 0.00 | — | 2.30 | 0.000 | 0.000 | 0.127 |
| SrTiO3 | 1.85 | 1.91 | — | 0.06 | 0.000 | 0.000 | 0.000 |
| BaTiO3 | 2.29 | 2.33 | — | 0.03 | 0.000 | 0.000 | 0.000 |
| Fe2O3 | 0.00 | 0.41 | — | 0.41 | 0.000 | 0.000 | 0.000 |
| LiCoO2 | 0.66 | 0.97 | 2.74 | 2.08 | 0.000 | 0.000 | 0.000 |
| Al2O3 | 5.85 | 6.43 | 5.86 | 0.58 | 0.000 | 0.000 | 0.000 |
Measured compounds with the largest band-gap disagreement
Compounds present in all three band-gap databases and in a measured band-gap compilation, ranked by the spread between databases. Most contain a transition metal or a rare earth, where the treatment of localised d and f electrons varies most between databases.
| Compound | MP gap | JARVIS gap | AFLOW gap | Spread (eV) |
|---|---|---|---|---|
| EuF3 | 0.00 | 8.10 | 0.80 | 8.10 |
| KYb2F7 | 7.45 | 0.00 | 0.44 | 7.45 |
| CeF3 | 0.00 | 0.00 | 5.73 | 5.73 |
| EuClO | 0.00 | 4.95 | 0.00 | 4.95 |
| Eu2O3 | 0.00 | 3.91 | 0.18 | 3.91 |
| CeAlO3 | 0.00 | 0.00 | 3.55 | 3.55 |
| TiPO4 | 0.06 | 0.00 | 3.08 | 3.08 |
| NaAsO3 | 2.86 | 0.00 | 2.84 | 2.86 |
| Y(CuO2)2 | 0.00 | 2.84 | 2.76 | 2.84 |
| Rb2FeI4 | 0.01 | 0.00 | 2.59 | 2.59 |
| Ba3Nb2CoO9 | 0.00 | 0.00 | 2.58 | 2.58 |
| AlCoO3 | 2.56 | 1.16 | 0.00 | 2.56 |
| NdF3 | 7.62 | 7.81 | 5.27 | 2.54 |
| Li8PrO6 | 0.00 | 0.00 | 2.52 | 2.52 |
| RbInS2 | 2.41 | 0.00 | 2.16 | 2.41 |
| KEuS2 | 0.00 | 2.34 | 0.00 | 2.34 |
| Ni2Te3O8 | 3.03 | 0.73 | 2.93 | 2.30 |
| KTi2F7 | 0.00 | 0.00 | 2.29 | 2.29 |
| YWO3 | 2.26 | 0.00 | 0.00 | 2.26 |
| Na2UI6 | 0.38 | 0.00 | 2.15 | 2.15 |
| Ta2O5 | 1.23 | 3.18 | 3.21 | 1.98 |
| Rb2CrF6 | 1.88 | 0.00 | 0.00 | 1.88 |
| Na6FeS4 | 0.00 | 0.00 | 1.87 | 1.87 |
| PrCuSO | 1.64 | 1.86 | 0.00 | 1.86 |
| VPO4 | 1.83 | 0.00 | 1.42 | 1.83 |
Stable in one database, unstable in another
Measured compounds that sit on the hull in at least one database but 100 meV/atom or more above it in another. Gaps this large usually mean one database never computed the observed structure, not that the energies themselves disagree.
| Compound | MP E_hull | OQMD E_hull | JARVIS E_hull | Spread (eV/atom) |
|---|---|---|---|---|
| Th2In | 0.000 | 2.685 | 0.036 | 2.685 |
| Sm3AlN | 0.000 | 1.906 | 0.000 | 1.906 |
| Ca3SbN | 0.000 | 1.489 | 0.000 | 1.489 |
| TcSe2 | — | 1.442 | 0.000 | 1.442 |
| CsNa2Sb | 1.051 | 0.000 | — | 1.051 |
| AsSeBr | 0.845 | 0.000 | 0.369 | 0.845 |
| Ni(AsO3)2 | 0.000 | 0.412 | 0.618 | 0.618 |
| TaGaPt | 0.484 | 0.000 | 0.447 | 0.484 |
| AsSI | — | 0.000 | 0.480 | 0.480 |
| HfAsRh | 0.480 | 0.000 | 0.472 | 0.480 |
| SbOsS | 0.000 | 0.456 | 0.000 | 0.456 |
| POsS | 0.000 | 0.448 | 0.000 | 0.448 |
| Ca3Sb2 | 0.421 | 0.000 | 0.380 | 0.421 |
| Zr3NiO | 0.404 | 0.263 | 0.000 | 0.404 |
| AsOsS | 0.000 | 0.404 | 0.000 | 0.404 |
| EuN | 0.000 | 0.399 | — | 0.399 |
| SrSbAu | 0.385 | 0.000 | 0.313 | 0.385 |
| AsRuS | 0.000 | 0.378 | 0.000 | 0.378 |
| Yb2O3 | 0.000 | 0.370 | 0.355 | 0.370 |
| Yb2MgSe4 | 0.000 | 0.351 | — | 0.351 |
| ZrTi2O | 0.000 | 0.329 | 0.000 | 0.329 |
| RbInS2 | 0.000 | 0.000 | 0.300 | 0.300 |
| Cr2CuTe4 | 0.000 | 0.000 | 0.271 | 0.271 |
| KEuS2 | 0.000 | 0.269 | 0.000 | 0.269 |
| Ba3Yb4O9 | 0.000 | 0.267 | 0.258 | 0.267 |
How this comparison was built
- Every entry is keyed by its reduced composition (for example LiFePO4 = FeLiO4P), so differently written formulas from different databases line up.
- For each database and composition, we take the lowest-energy entry as that database’s ground state. If that entry lacks a value, a sibling entry may stand in only when it is within 10 meV/atom of the ground state. This stops a gap from a high-energy polymorph being compared with another database’s ground state.
- OQMD reports stability as a signed distance, negative for phases on the hull. We clamp it at zero to match the Materials Project and JARVIS convention. We drop <200 JARVIS rows (mostly elemental polymorphs) that report a zero hull energy alongside a large positive formation energy.
- A gap ≤ 0.05 eV counts as metallic. An energy above hull ≤ 1 meV/atom counts as on the hull.
- Charts show a random sample of up to 900 compounds per pair for legibility. Every statistic and the CSV use all shared compositions.
- GNoME is excluded because its licence (CC BY-NC 4.0) does not permit commercial redistribution. Database snapshots: warehouse build 20260925T154847Z, page built 2026-09-30.
Download and cite
Every row behind this page (62,803 rows) as CSV, with source identifiers so each value can be traced back.
Download CSVLatticeGraph (2026). "How Much Do Materials Databases Disagree? Materials Project vs JARVIS vs AFLOW vs OQMD." LatticeGraph Data Atlas, snapshot 2026-09-30 (warehouse 20260925T154847Z). https://latticegraph.com/atlas/dft-database-disagreement
Please also cite the original datasets listed under Sources.
Datasets and licences
- Summary endpoint, release 2025.09.25. Mostly PBE (GGA) and GGA+U, with r2SCAN for many entries in recent releases.A. Jain et al., APL Materials 1, 011002 (2013).License: CC BY 4.0
- 3D dataset, release 2026.03. OptB88vdW functional, no Hubbard U.K. Choudhary et al., npj Computational Materials 6, 173 (2020).License: US Government public domain (NIST)
- AFLOW entries carrying a band gap, release 2026.03. PBE, with a Hubbard U for many transition-metal compounds.S. Curtarolo et al., Computational Materials Science 58, 218–226 (2012).License: CC BY 4.0
- Formation energies and hull distances, v1.5. PBE, with GGA+U for some transition-metal oxides and fitted elemental reference energies.J. E. Saal et al., JOM 65, 1501–1509 (2013).License: CC BY 4.0
Frequently asked questions
Do Materials Project, JARVIS, AFLOW and OQMD give the same band gap for a compound?
Often, but not always. For the 34,422 compositions that both Materials Project and JARVIS-DFT have computed, half agree to within 0.01 eV (many are metals that both call metallic), and where both report a gap the mean difference is 0.31 eV. Still, 8.5% differ by more than 0.5 eV, and 7.3% are called a metal by one database and a semiconductor by the other. Across the three band-gap pairs we compared, 9–16% of shared compounds differ by more than 0.5 eV.
Why do DFT databases disagree?
Each database makes different choices: the exchange-correlation functional (PBE, OptB88vdW, r2SCAN), whether and where a Hubbard U correction is applied, how magnetic order is initialised, which crystal structures were computed, and which competing phases are on its convex hull. In our comparison the Hubbard U choice stands out: 75% of Materials Project vs JARVIS band-gap disagreements larger than 1 eV are oxides or fluorides of Co, Cr, Fe, Mn, Mo, Ni, V or W, the compounds where Materials Project applies a U and JARVIS does not. Those compounds are only 11% of the compositions the two share.
Which database is right?
None of them is a measurement. GGA-level band gaps typically come out around 30% below measured values (see our companion study comparing DFT gaps with measured gaps), and hull energies depend on which competing phases a database has calculated. When the sources disagree, treat the compound as uncertain and check experimental data. If you only use one database, at least note which one.
How often do databases disagree on whether a compound is stable?
For every pair of databases we compared, 17–18% of shared compositions are on the convex hull (energy above hull ≤ 1 meV/atom) in one database but not the other. The typical hull-energy difference is small (median 3 meV/atom between Materials Project and OQMD). In 64–76% of conflicts, both databases put the compound within 50 meV/atom of the hull, so a small energy shift flips the verdict.
Related studies
Want this kind of ranked, cited comparison for your own candidates?