Skip to content

Validation and Verification

Warning

The validation of the first migration showed that all the metadata at the LLNL, ANL and ORNL for the projects (except e3sm) in the design document have been migrated to the public Globus index (the metadata of the read-write projects were also migrated to their corresponding staged indexes). The discrepancies in the metadata counts (i.e., the total counts from the Solr indexes are less than the counts in the public indexes) calculated on the basis of the data_nodes and institution_ids are due to the missing dataset and file metadata in the solr indexes. We do not know the reason yet.

Sankey Diagram

Datasets:

sankey-beta

ANL, cmip3,29331
LLNL,cmip3,29331
ORNL,cmip3,29331

cmip3,Skipped,0
cmip3,Skipped,0
cmip3,Skipped,0

cmip3,public,87993

ANL, cmip5,35148
LLNL,cmip5,62791
ORNL,cmip5,57109

cmip5,Skipped,0
cmip5,Skipped,0
cmip5,Skipped,21960

cmip5,public,133088

ANL, cmip6,5686552
LLNL,cmip6,9080328
ORNL,cmip6,9037273

cmip6,Skipped,0
cmip6,Skipped,997
cmip6,Skipped,3074192

cmip6,public,20728964

ANL, create-ip,0
LLNL,create-ip,112
ORNL,create-ip,112

create-ip,Skipped,0
create-ip,Skipped,0
create-ip,Skipped,112

create-ip,public,112

ANL, e3sm-supplement,0
LLNL,e3sm-supplement,53
ORNL,e3sm-supplement,53

e3sm-supplement,Skipped,0
e3sm-supplement,Skipped,0
e3sm-supplement,Skipped,0

e3sm-supplement,public,106

ANL, geomip,0
LLNL,geomip,290
ORNL,geomip,290

geomip,Skipped,0
geomip,Skipped,0
geomip,Skipped,290

geomip,public,290

ANL, lucid,0
LLNL,lucid,131
ORNL,lucid,131

lucid,Skipped,0
lucid,Skipped,0
lucid,Skipped,131

lucid,public,131

ANL, tamip,0
LLNL,tamip,192
ORNL,tamip,192

tamip,Skipped,0
tamip,Skipped,0
tamip,Skipped,192

tamip,public,192

Files: 

sankey-beta

ANL, cmip3,82172
LLNL,cmip3,82172
ORNL,cmip3,82172

cmip3,Skipped,0
cmip3,Skipped,0
cmip3,Skipped,0

cmip3,public,246516

ANL, cmip5,1983272
LLNL,cmip5,4522442
ORNL,cmip5,3711854

cmip5,Skipped,0
cmip5,Skipped,0
cmip5,Skipped,1710500

cmip5,public,8507068

ANL, cmip6,23119490
LLNL,cmip6,38921810
ORNL,cmip6,36278980

cmip6,Skipped,0
cmip6,Skipped,8759
cmip6,Skipped,9434533

cmip6,public,88876988

ANL, create-ip,0
LLNL,create-ip,39071
ORNL,create-ip,39071

create-ip,Skipped,0
create-ip,Skipped,0
create-ip,Skipped,39071

create-ip,public,39071

ANL, e3sm-supplement,0
LLNL,e3sm-supplement,3172
ORNL,e3sm-supplement,3172

e3sm-supplement,Skipped,0
e3sm-supplement,Skipped,0
e3sm-supplement,Skipped,0

e3sm-supplement,public,6344

ANL, geomip,0
LLNL,geomip,14742
ORNL,geomip,14742

geomip,Skipped,0
geomip,Skipped,0
geomip,Skipped,14742

geomip,public,14742

ANL, lucid,0
LLNL,lucid,16264
ORNL,lucid,16264

lucid,Skipped,0
lucid,Skipped,0
lucid,Skipped,16264

lucid,public,16264

ANL, tamip,0
LLNL,tamip,4480
ORNL,tamip,4480

tamip,Skipped,0
tamip,Skipped,0
tamip,Skipped,4480

tamip,public,4480