Data-Validation on 春江暮客

Data-Validation on 春江暮客 https://www.bobobk.com/en/tags/data-validation/ Recent content in Data-Validation on 春江暮客 Hugo en Thu, 22 Oct 2026 05:02:11 +0800 Python CSV Totals with Decimal: Validate Input and Control Rounding https://www.bobobk.com/en/python-csv-decimal-total.html Thu, 22 Oct 2026 05:02:11 +0800 https://www.bobobk.com/en/python-csv-decimal-total.html Sum CSV amounts with the Python standard library, define per-row rounding, validate prices and quantities, and stop on invalid data. Compare CSV Snapshots by ID with Python: Added, Removed, and Changed Records https://www.bobobk.com/en/python-csv-diff-by-key.html Wed, 21 Oct 2026 14:20:30 +0800 https://www.bobobk.com/en/python-csv-diff-by-key.html Compare CSV snapshots by a unique ID with the Python standard library, reject duplicate keys, and report additions, removals, and changed fields with automation-friendly exit codes. Validate CSV Structure with Python: Exact Headers, Column Order, and Field Counts https://www.bobobk.com/en/python-csv-schema-check.html Sat, 17 Oct 2026 11:43:33 +0800 https://www.bobobk.com/en/python-csv-schema-check.html Check exact CSV headers and field counts with the Python standard library, test multiline records and failure exit codes, and stop schema drift before imports. Validate JSONL with Python: Find Broken Lines and Duplicate Keys https://www.bobobk.com/en/python-jsonl-validation.html Wed, 14 Oct 2026 20:57:24 +0800 https://www.bobobk.com/en/python-jsonl-validation.html Validate JSONL line by line, locate syntax and encoding errors, and gate batch jobs with reliable exit codes. Check Protein Embeddings Before Training with Python https://www.bobobk.com/en/protein-embedding-audit-python.html Sat, 10 Oct 2026 14:31:16 +0800 https://www.bobobk.com/en/protein-embedding-audit-python.html Validate pooled protein embeddings with NumPy, compare sample IDs in label order, and catch duplicate IDs, shape errors, NaN and infinity before training. Find Duplicate CSV IDs with Python and SQLite https://www.bobobk.com/en/python-csv-duplicate-ids-sqlite.html Thu, 08 Oct 2026 08:01:42 +0800 https://www.bobobk.com/en/python-csv-duplicate-ids-sqlite.html Stream a CSV into a temporary SQLite index, report repeated sample IDs and record positions, and validate the result without keeping every ID in a Python set. Stream Large CSV Files with Python: Validate Rows and Count Labels https://www.bobobk.com/en/python-stream-large-csv.html Mon, 28 Sep 2026 15:31:31 +0800 https://www.bobobk.com/en/python-stream-large-csv.html Read CSV records one at a time with Python, validate sample IDs and labels, and produce a small JSON summary without loading the whole file. Join Protein Sequences and Labels Safely with pandas https://www.bobobk.com/en/pandas-protein-label-join.html Sun, 27 Sep 2026 08:02:59 +0800 https://www.bobobk.com/en/pandas-protein-label-join.html Match protein sequences to labels by sample ID, preserve string identifiers, and reject duplicates and missing records before building a training table. Verify Research Datasets with SHA-256 Manifests in Python https://www.bobobk.com/en/python-dataset-sha256-manifest.html Sun, 27 Sep 2026 07:49:43 +0800 https://www.bobobk.com/en/python-dataset-sha256-manifest.html Record dataset file checksums with Python, detect added, missing, and changed inputs, and keep an exact file record for reproducible experiments.