scieee AI-readable full text Open interactive document viewer

Curated European animal data from the BOLD public dataset version 17-Oct-2025

Price, Benjamin; Deister, Fabian; Vos, Rutger

Abstract

Curated using this pipeline release: https://github.com/bge-barcoding/bold-library-curation/releases/tag/v4.2 bold_17Oct25.tar.gz = original unprocessed BOLD data package (i.e. all records)result_output.tsv.gz = Processed records in BCDM TSV format with additional columns from ranking.bold.db.gz = Processed records in SQL database format.logs.tar.gz = logs from analysis.family_databases_compressed.tar.gz = manual curation package for each family (database file, PDF checklist, PDF & SVG phylogeny).bold_database_statistics.pdf = summary of dataset.

Full text

BOLD Database Statistics Report Database: bold.db Mode: Full Analysis Generated: 2025-10-29 04:55:19 SUMMARY STATISTICS Total records: 2,546,772 Unique species: 89,605 Unique BINs: 96,168 Unique OTUs: 316,848 Records without BIN: 0 CURATION CATEGORIES Auto-curatable species: 20,693 Needs attention: 21,522 Manual intervention: 54,814 PROCESSING PERFORMANCE Total processing time: 2.1 minutes Peak memory usage: 429.8 MB Processing mode: Full dataset Database size: 13.15 GB Summary Statistics A B C D E F BAGS Grade 0 10000 20000 30000 40000 Number of Species 7973 10532 9105 11787 45709 4499 BAGS Grade Distribution BAGS scoring summary: Grade A = Species has > 10 specimens in 1 BIN Grade B = Species has 3 - 10 specimens in 1 BIN Grade C = Species has > 1 BIN (BIN splitting) Grade D = Species has < 3 specimens in 1 BIN Grade E = BIN with > 1 species (BIN sharing) Grade F = other BAGS Grade Distribution 1234567 Rank 0.0 0.2 0.4 0.6 0.8 1.0 1.2 1.4 Number of Records 1e6 4280 409406 235657 1493156 188762 115023100488 Rank Distribution Rank Categories Rank Distribution 0 2 4 6 8 10 12 14 16 Sumscore 0 100000 200000 300000 400000 500000 Number of Records 159 17673 127341 168923 147256 137651 93512 105400 59544 174323 460520 499073 347489 198663 9131 114 Sumscore Distribution (0-16) The sum of all passed criteria, out of a total of 16 criteria assessed for each record. A higher score indicates a record with better specimen data. Fail 3.9% Pass 96.1% SPECIES_ID Fail 99.8% Pass 0.2% TYPE_SPECIMEN Fail 4.7% Pass 95.3% SEQ_QUALITY Fail 81.3% Pass 18.7% HAS_IMAGE Fail 40.9% Pass 59.1% ID_METHOD Fail 61.1% Pass 38.9% PUBLIC_VOUCHER Fail 27.8% Pass 72.2% INSTITUTION Fail 29.9% Pass 70.1% MUSEUM_ID Criteria Distribution (Pass/Fail) - Page 1 Fail 8.6% Pass 91.4% COUNTRY Fail 41.6% Pass 58.4% REGION Fail 61.4% Pass 38.6% SECTOR Fail 49.8% Pass 50.2% SITE Fail 18.9% Pass 81.1% COORD Fail 27.2% Pass 72.8% COLLECTORS Fail 23.6% Pass 76.4% COLLECTION_DATE Fail 59.4% Pass 40.6% IDENTIFIER Criteria Distribution (Pass/Fail) - Page 2 1234567 Best Rank ABCDEF BAGS Grade 252 6071 675 781 40 4 150 236 6691 1130 1748 201 22 504 186 6431 755 1393 159 3 178 127 4149 1362 3539 1107 125 1378 923 19939 3461 6012 1695 522 13157 102 989 261 1150 268 1153 576 Species Distribution: BAGS Grade vs Best Rank 2.5 5.0 7.5 10.0 12.5 15.0 17.5 20.0 Proportion (%) The rank of the best specimen record within each species within each BAGS grade. Top left box indicates the number of species with a BAGS grade A which have a specimen of rank of 1 (= type specimens). Auto-curatable 21.3% Needs attention 22.2% Manual intervention 56.5% Curation Categories Auto-curatable Needs attention Manual intervention 0 10000 20000 30000 40000 50000 Number of Species 20693 21522 54814 Species by Curation Category Curation Analysis Distribution of species which are possible to auto-curate, probably need attention and require manual intervention. Auto-curatable = BAGS grade A, B or D and specimen ranks 1, 2, or 3 Need attention = BAGS grade A, B or D and specimen ranks >=4 Manual intervention = BAGS grade C or E