How Much Do Materials Databases Disagree? Materials Project vs JARVIS vs AFLOW vs OQMD

We matched 62,803 compositions that appear in at least two of four open DFT databases and compared each database’s ground-state answer. Most of the time they agree closely. But for about 1 in 6 shared compounds, two databases disagree on whether the compound is thermodynamically stable at all. And 7–9% flip between metal and semiconductor.
Data snapshot:
62,803
Compositions in two or more databases
Matched on reduced formula
17–18%
Disagree on whether the compound is on the convex hull
Across database pairs
7–9%
Called a metal by one database, a semiconductor by another
Band-gap pairs
9–16%
Band gaps that differ by more than 0.5 eV
Band-gap pairs

Key findings

  • Typical agreement is tight. Half the compounds shared by Materials Project and JARVIS-DFT have the same band gap to within 0.01 eV (many are metals that both call metallic). Where both report a gap, the mean difference is 0.31 eV. The median hull-energy difference between Materials Project and OQMD is 3 meV/atom.
  • The tail is long. One in ten shared compounds differs by more than 0.40 eV in band gap (MP vs JARVIS). One in ten differs by more than 232 meV/atom in hull energy (MP vs OQMD).
  • Stability verdicts are fragile. 17–18% of shared compounds are on the hull in one database and above it in another. In 64–76% of those conflicts, both values are within 50 meV/atom of the hull.
  • One modelling choice explains most large band-gap disagreements. 75% of Materials Project vs JARVIS gaps that differ by more than 1 eV are oxides or fluorides of Co, Cr, Fe, Mn, Mo, Ni, V or W. Materials Project applies a Hubbard U to exactly these compounds; JARVIS applies none. They make up only 11% of shared compositions. LiFePO4 is 3.92 eV in Materials Project (GGA+U) but 0.38 eV in JARVIS (no U). NiO is 2.30 eV versus 0.00 eV.
Part 1

Band gaps: three databases, compared pairwise

Each dot is one composition both databases have computed, placed at the band gap each reports for its lowest-energy structure. Points on the dashed diagonal agree exactly; the shaded band marks ±0.5 eV. Dots along an axis are compounds one database calls metallic (gap ≤ 0.05 eV) and the other does not.

Materials Project vs JARVIS-DFT
0022446688Materials Project (eV)JARVIS-DFT (eV)
34,422 shared compositions · median |Δ| 0.00 eV · 7.3% metal/semiconductor conflicts. 900 shown; statistics use all.
Materials Project vs AFLOW
0022446688Materials Project (eV)AFLOW (eV)
18,414 shared compositions · median |Δ| 0.01 eV · 8.7% metal/semiconductor conflicts. 900 shown; statistics use all.
JARVIS-DFT vs AFLOW
0022446688JARVIS-DFT (eV)AFLOW (eV)
14,184 shared compositions · median |Δ| 0.01 eV · 7.9% metal/semiconductor conflicts. 900 shown; statistics use all.
Band-gap agreement by database pair (eV)
PairSharedMedian |Δ|Mean |Δ|90th pct |Δ||Δ| > 0.5 eVMetal conflictMean |Δ|, both gapped
Materials Project vs JARVIS-DFT34,4220.0000.1670.3988.5%7.3%0.31
Materials Project vs AFLOW18,4140.0110.2590.79813.9%8.7%0.29
JARVIS-DFT vs AFLOW14,1840.0130.2900.94315.8%7.9%0.44
Context

Why open DFT databases disagree

All four databases run density functional theory, but they don’t make the same choices. Materials Project uses PBE and PBE+U, with r2SCAN for many entries in recent releases. JARVIS-DFT uses the OptB88vdW functional without a Hubbard U. AFLOW and OQMD use PBE, with U values for selected transition-metal compounds. A Hubbard U opens gaps in correlated d-electron systems. That is why NiO and LiFePO4 look so different from one database to the next: 75% of the gap disagreements larger than 1 eV between Materials Project and JARVIS are oxides or fluorides of the eight elements Materials Project treats with a U.

Hull energies add a second layer. A compound’s energy above the hull is measured against every competing phase the database has computed in that chemical system. If one database has computed a more stable competitor, or never computed the experimentally observed structure, the verdict changes even when the underlying total energies are close. Each database also applies its own energy corrections to anions and elemental references.

None of this makes one database wrong. It means any single DFT number carries an uncertainty that the number itself doesn’t show. Our companion study, how accurate are DFT band gaps, measures that gap against experiment.

Part 2

Stability: energy above the convex hull

Same comparison for energy above the hull. Values are capped at 1 eV/atom for display, and the shaded band marks ±50 meV/atom. A compound is counted as on the hull at ≤ 1 meV/atom.

Materials Project vs OQMD
000.250.250.50.50.750.7511Materials Project (eV/atom)OQMD (eV/atom)
43,064 shared · 17.3% on-hull conflicts · 20.6% differ by > 50 meV/atom.
Materials Project vs JARVIS-DFT
000.250.250.50.50.750.7511Materials Project (eV/atom)JARVIS-DFT (eV/atom)
34,419 shared · 17.8% on-hull conflicts · 15.2% differ by > 50 meV/atom.
OQMD vs JARVIS-DFT
000.250.250.50.50.750.7511OQMD (eV/atom)JARVIS-DFT (eV/atom)
36,379 shared · 18.3% on-hull conflicts · 24.8% differ by > 50 meV/atom.
Materials Project minus OQMD, energy above hull
010k20k30k< -0.2-0.2…-0.1-0.1…-0.05-0.05…-0.025-0.025…-0.01±0.01+0.01…+0.025+0.025…+0.05+0.05…+0.1+0.1…+0.2> +0.2
Number of shared compositions in each difference bin (eV/atom). Bins widen away from zero; the centre bin is ±10 meV/atom and the end bins collect everything beyond ±0.2 eV/atom.
Hull-energy agreement by database pair (eV/atom)
PairSharedMedian |Δ|Mean |Δ|90th pct |Δ||Δ| > 50 meVOn-hull conflictOn hull in both
Materials Project vs OQMD43,0640.0030.1470.23220.6%17.3%18,388
Materials Project vs JARVIS-DFT34,4190.0050.0570.07815.2%17.8%14,313
OQMD vs JARVIS-DFT36,3790.0060.0760.20424.8%18.3%14,776
Look-up

Familiar compounds across all four databases

Ground-state band gaps (eV) and energies above hull (eV/atom). A dash means that database has no entry, or (for AFLOW) no band gap on its lowest-energy structure.

Benchmark compounds
CompoundMP gapJARVIS gapAFLOW gapGap spreadMP E_hullOQMD E_hullJARVIS E_hull
Si0.610.74—0.130.0000.0000.000
Ge0.000.00—0.000.0000.0000.000
GaAs0.190.09—0.100.0000.0000.000
GaN1.731.94—0.220.0000.0000.000
ZnO0.720.96—0.240.0000.0000.000
TiO22.062.05—0.010.0000.0000.000
SiC1.841.621.970.350.0000.0000.000
AlN4.054.474.060.430.0000.0000.000
MgO4.434.854.470.420.0000.0000.000
ZnS2.022.092.690.670.0000.0000.000
CdTe0.580.50—0.090.0000.0000.000
InP0.460.33—0.120.0000.0000.000
LiFePO43.920.383.633.540.0000.0000.014
Cu2O0.510.64—0.130.0000.0000.000
NiO2.300.00—2.300.0000.0000.127
SrTiO31.851.91—0.060.0000.0000.000
BaTiO32.292.33—0.030.0000.0000.000
Fe2O30.000.41—0.410.0000.0000.000
LiCoO20.660.972.742.080.0000.0000.000
Al2O35.856.435.860.580.0000.0000.000
Outliers

Measured compounds with the largest band-gap disagreement

Compounds present in all three band-gap databases and in a measured band-gap compilation, ranked by the spread between databases. Most contain a transition metal or a rare earth, where the treatment of localised d and f electrons varies most between databases.

Largest band-gap disagreements
CompoundMP gapJARVIS gapAFLOW gapSpread (eV)
EuF30.008.100.808.10
KYb2F77.450.000.447.45
CeF30.000.005.735.73
EuClO0.004.950.004.95
Eu2O30.003.910.183.91
CeAlO30.000.003.553.55
TiPO40.060.003.083.08
NaAsO32.860.002.842.86
Y(CuO2)20.002.842.762.84
Rb2FeI40.010.002.592.59
Ba3Nb2CoO90.000.002.582.58
AlCoO32.561.160.002.56
NdF37.627.815.272.54
Li8PrO60.000.002.522.52
RbInS22.410.002.162.41
KEuS20.002.340.002.34
Ni2Te3O83.030.732.932.30
KTi2F70.000.002.292.29
YWO32.260.000.002.26
Na2UI60.380.002.152.15
Ta2O51.233.183.211.98
Rb2CrF61.880.000.001.88
Na6FeS40.000.001.871.87
PrCuSO1.641.860.001.86
VPO41.830.001.421.83
Outliers

Stable in one database, unstable in another

Measured compounds that sit on the hull in at least one database but 100 meV/atom or more above it in another. Gaps this large usually mean one database never computed the observed structure, not that the energies themselves disagree.

Stability verdict flips
CompoundMP E_hullOQMD E_hullJARVIS E_hullSpread (eV/atom)
Th2In0.0002.6850.0362.685
Sm3AlN0.0001.9060.0001.906
Ca3SbN0.0001.4890.0001.489
TcSe2—1.4420.0001.442
CsNa2Sb1.0510.000—1.051
AsSeBr0.8450.0000.3690.845
Ni(AsO3)20.0000.4120.6180.618
TaGaPt0.4840.0000.4470.484
AsSI—0.0000.4800.480
HfAsRh0.4800.0000.4720.480
SbOsS0.0000.4560.0000.456
POsS0.0000.4480.0000.448
Ca3Sb20.4210.0000.3800.421
Zr3NiO0.4040.2630.0000.404
AsOsS0.0000.4040.0000.404
EuN0.0000.399—0.399
SrSbAu0.3850.0000.3130.385
AsRuS0.0000.3780.0000.378
Yb2O30.0000.3700.3550.370
Yb2MgSe40.0000.351—0.351
ZrTi2O0.0000.3290.0000.329
RbInS20.0000.0000.3000.300
Cr2CuTe40.0000.0000.2710.271
KEuS20.0000.2690.0000.269
Ba3Yb4O90.0000.2670.2580.267
Methods

How this comparison was built

  1. Every entry is keyed by its reduced composition (for example LiFePO4 = FeLiO4P), so differently written formulas from different databases line up.
  2. For each database and composition, we take the lowest-energy entry as that database’s ground state. If that entry lacks a value, a sibling entry may stand in only when it is within 10 meV/atom of the ground state. This stops a gap from a high-energy polymorph being compared with another database’s ground state.
  3. OQMD reports stability as a signed distance, negative for phases on the hull. We clamp it at zero to match the Materials Project and JARVIS convention. We drop <200 JARVIS rows (mostly elemental polymorphs) that report a zero hull energy alongside a large positive formation energy.
  4. A gap ≤ 0.05 eV counts as metallic. An energy above hull ≤ 1 meV/atom counts as on the hull.
  5. Charts show a random sample of up to 900 compounds per pair for legibility. Every statistic and the CSV use all shared compositions.
  6. GNoME is excluded because its licence (CC BY-NC 4.0) does not permit commercial redistribution. Database snapshots: warehouse build 20260925T154847Z, page built 2026-09-30.
Open data

Download and cite

Download the data

Every row behind this page (62,803 rows) as CSV, with source identifiers so each value can be traced back.

Download CSV
Cite this page

LatticeGraph (2026). "How Much Do Materials Databases Disagree? Materials Project vs JARVIS vs AFLOW vs OQMD." LatticeGraph Data Atlas, snapshot 2026-09-30 (warehouse 20260925T154847Z). https://latticegraph.com/atlas/dft-database-disagreement

Please also cite the original datasets listed under Sources.

Sources

Datasets and licences

  • Summary endpoint, release 2025.09.25. Mostly PBE (GGA) and GGA+U, with r2SCAN for many entries in recent releases.
    A. Jain et al., APL Materials 1, 011002 (2013).
    License: CC BY 4.0
  • 3D dataset, release 2026.03. OptB88vdW functional, no Hubbard U.
    K. Choudhary et al., npj Computational Materials 6, 173 (2020).
    License: US Government public domain (NIST)
  • AFLOW entries carrying a band gap, release 2026.03. PBE, with a Hubbard U for many transition-metal compounds.
    S. Curtarolo et al., Computational Materials Science 58, 218–226 (2012).
    License: CC BY 4.0
  • Formation energies and hull distances, v1.5. PBE, with GGA+U for some transition-metal oxides and fitted elemental reference energies.
    J. E. Saal et al., JOM 65, 1501–1509 (2013).
    License: CC BY 4.0
FAQ

Frequently asked questions

Do Materials Project, JARVIS, AFLOW and OQMD give the same band gap for a compound?

Often, but not always. For the 34,422 compositions that both Materials Project and JARVIS-DFT have computed, half agree to within 0.01 eV (many are metals that both call metallic), and where both report a gap the mean difference is 0.31 eV. Still, 8.5% differ by more than 0.5 eV, and 7.3% are called a metal by one database and a semiconductor by the other. Across the three band-gap pairs we compared, 9–16% of shared compounds differ by more than 0.5 eV.

Why do DFT databases disagree?

Each database makes different choices: the exchange-correlation functional (PBE, OptB88vdW, r2SCAN), whether and where a Hubbard U correction is applied, how magnetic order is initialised, which crystal structures were computed, and which competing phases are on its convex hull. In our comparison the Hubbard U choice stands out: 75% of Materials Project vs JARVIS band-gap disagreements larger than 1 eV are oxides or fluorides of Co, Cr, Fe, Mn, Mo, Ni, V or W, the compounds where Materials Project applies a U and JARVIS does not. Those compounds are only 11% of the compositions the two share.

Which database is right?

None of them is a measurement. GGA-level band gaps typically come out around 30% below measured values (see our companion study comparing DFT gaps with measured gaps), and hull energies depend on which competing phases a database has calculated. When the sources disagree, treat the compound as uncertain and check experimental data. If you only use one database, at least note which one.

How often do databases disagree on whether a compound is stable?

For every pair of databases we compared, 17–18% of shared compositions are on the convex hull (energy above hull ≤ 1 meV/atom) in one database but not the other. The typical hull-energy difference is small (median 3 meV/atom between Materials Project and OQMD). In 64–76% of conflicts, both databases put the compound within 50 meV/atom of the hull, so a small energy shift flips the verdict.

More from the atlas

Related studies

Want this kind of ranked, cited comparison for your own candidates?