Corpus Engine Towards a reproducible .science file.
← All .science files

pmid:34553213

Bias-invariant RNA-sequencing metadata annotation.

Hannes Wartmann · Sven Heins · Karin Kloiber · Stefan Bonn

GigaScience · 2021 doi:10.1093/gigascience/giab064

Paper

complete

Experiment

partial

Data

partial

Analysis

partial

Execution

absent

Execution evidence has not yet been added to this .science file. Explore its methods, data and open questions to plan the next step.
Record details sci_version · id · kind · revision · content_hash · schema · created_at · updated_at · generator
id
pmid:34553213
kind
science-record
content_hash
sha256:50de0180c12bb124558bc476e32c4ce1de49fa0b4b1c5eac6e90ea382b66ffdb
schema
https://corpus.bntrg.co.uk/sci/1.0/sci.schema.json
created_at
2026-11-01T15:41:53Z
updated_at
2026-11-01T22:04:47Z
generator object · 2 fields
name
corpus-assay-engine
run_id
reading-sci-2026-11-01
paper object · 10 fields
state
complete
title
Bias-invariant RNA-sequencing metadata annotation.
doi
10.1093/gigascience/giab064
pmid
34553213
authors array · 4 items
[0]
Hannes Wartmann
[1]
Sven Heins
[2]
Karin Kloiber
[3]
Stefan Bonn
journal
GigaScience
year
2021
abstract
BACKGROUND: Recent technological advances have resulted in an unprecedented increase in publicly available biomedical data, yet the reuse of the data is often precluded by experimental bias and a lack of annotation depth and consistency. Missing annotations makes it impossible for researchers to find datasets specific to their needs. FINDINGS: Here, we investigate RNA-sequencing metadata prediction based on gene expression values. We present a deep-learning-based domain adaptation algorithm for the automatic annotation of RNA-sequencing metadata. We show, in multiple experiments, that our model is better at integrating heterogeneous training data compared with existing linear regression-based approaches, resulting in improved tissue type classification. By using a model architecture similar to Siamese networks, the algorithm can learn biases from datasets with few samples. CONCLUSION: Using our novel domain adaptation approach, we achieved metadata annotation accuracies up to 15.7% better than a previously published method. Using the best model, we provide a list of >10,000 novel tissue and sex label annotations for 8,495 unique SRA samples. Our approach has the potential to revive idle datasets by automated annotation making them more searchable.
claims array · 2 items
[0] object · 6 fields
id
claim-method
statement
Accuracy distributions were tested for significance using the non-parametric Mann-Whitney U test (scipy.stats.mannwhitneyu v 1.3.1).
kind
methodological
target
null
evidence array · 1 item
[0] object · 3 fields
asset
source:pmid:34553213
locator
sections[24] "Statistical tests" paragraph 2
quote
Accuracy distributions were tested for significance using the non-parametric Mann-Whitney U test (scipy.stats.mannwhitneyu v 1.3.1).
state
complete
[1] object · 6 fields
id
claim-data-access
statement
To avoid additional biases by the use of different bioinformatic alignment pipelines [27] all data were downloaded from recount2 (release 13.09.19) [28].
kind
methodological
target
null
evidence array · 1 item
[0] object · 3 fields
asset
source:pmid:34553213
locator
sections[3] "Data acquisition" paragraph 2
quote
To avoid additional biases by the use of different bioinformatic alignment pipelines [27] all data were downloaded from recount2 (release 13.09.19) [28].
state
complete
gaps array · 0 items
experiment object · 8 fields
state
partial
objective
null
steps array · 3 items
[0] object · 13 fields
id
read_published_estimate
order
1
name
Read the published estimate from the source
kind
other
state
complete
blocked_on
null
description
The claim, method and evidence span published with the source article.
parameters object · 0 fields
inputs array · 1 item
[0]
source:pmid:34553213
outputs array · 1 item
[0]
the published estimate and its evidence
instruments array · 0 items
reagents array · 0 items
[1] object · 13 fields
id
obtain_source_data
order
2
name
Obtain the source data from the named repository
kind
data-preparation
state
blocked
blocked_on
data:accession_absent
description
The GEO series accession resolves and its sample accessions are listed. This lane did not download the dataset or read its licence.
parameters object · 0 fields
inputs array · 0 items
outputs array · 1 item
[0]
the source data with its repository provenance
instruments array · 0 items
reagents array · 0 items
[2] object · 13 fields
id
run_analysis
order
3
name
Run the published analysis
kind
analysis
state
blocked
blocked_on
method:group_comparison_mann_whitney
description
Apply the paper's statistical method to the resolved series and compare the result with the published target.
parameters object · 0 fields
inputs array · 0 items
outputs array · 1 item
[0]
the replicated result and its comparison
instruments array · 0 items
reagents array · 0 items
materials array · 0 items
instruments array · 0 items
reagents array · 0 items
conditions object · 0 fields
gaps array · 2 items
[0]
step:run_analysis blocked on method:group_comparison_mann_whitney
[1]
step:obtain_source_data blocked on data:accession_absent
data object · 3 fields
state
partial
assets array · 1 item
[0] object · 15 fields
id
source:pmid:34553213
role
manuscript
format
xml
media_type
application/xml
uri
https://doi.org/10.1093/gigascience/giab064
sha256
sha256:c5e98940e916867b5be7a99c1703c1f9268cccb446dfc398941be182149f1bb2
bytes
67959
access
open
state
resolved
reader
null
reader_status
reader_required
identifier
10.1093/gigascience/giab064
version
null
note
Full article fetched from PMC; the checksum covers the rendered section body, not the original XML bytes.
structure object · 4 fields
pmcid
PMC8559615
source
europe_pmc_fulltext
coverage
whole_body_without_references
text_hash_scope
rendered_section_body
gaps array · 0 items
analysis object · 4 fields
state
partial
methods array · 2 items
[0] object · 10 fields
id
method-1
family
group_comparison
specific
mann_whitney
label
Group comparison
dsl_operations array · 0 items
missing_operations array · 1 item
[0]
group_comparison_mann_whitney
expressible
false
parameters object · 0 fields
data_shapes array · 1 item
[0]
two_or_more_groups_continuous
evidence object · 3 fields
score
1
band
verbatim
quote
Accuracy distributions were tested for significance using the non-parametric Mann-Whitney U test (scipy.stats.mannwhitneyu v 1.3.1).
[1] object · 10 fields
id
method-2
family
regression_modelling
specific
ols
label
Regression modelling
dsl_operations array · 1 item
[0]
ols_fit
missing_operations array · 0 items
parameters object · 0 fields
data_shapes array · 1 item
[0]
predictors_and_outcome
evidence object · 3 fields
score
0.7
band
medium
quote
linear regression
targets array · 0 items
gaps array · 1 item
[0]
method.group_comparison_mann_whitney
capability object · 3 fields
state
complete
requirements array · 1 item
[0] object · 6 fields
capability_id
capability:computational_analysis
label
Computational analysis platform
assay_families array · 9 items
[0]
meta_analysis
[1]
machine_learning
[2]
survival_analysis
[3]
statistical_regression
[4]
pca
[5]
molecular_docking
[6]
network_analysis
[7]
differential_expression
[8]
gwas
candidate
Automated Assays Laravel application and simulated adapters
gaps array · 0 items
readiness object · 8 fields
state
blocked
tier
R4
blocked_on
data:accession_absent
axes object · 3 fields
method object · 5 fields
tier
R1
expressible
false
required_operations array · 0 items
missing_operations array · 1 item
[0]
group_comparison_mann_whitney
basis
The paper names the method it used and the corpus's method extractor maps it onto the DSL catalogue: mann_whitney.
capability object · 4 fields
tier
R1
capability_id
capability:computational_analysis
availability_state
owned
basis
The computational analysis is owned. The physical bench the paper used is not, so a physical validation cannot be run here.
data object · 6 fields
tier
R4
reachable
false
accessions array · 0 items
resolved_accessions array · 0 items
statements array · 1 item
[0]
To avoid additional biases by the use of different bioinformatic alignment pipelines [27] all data were downloaded from recount2 (release 13.09.19) [28].
basis
The paper names no accession to its source data, so the data has to come from the authors.
can_run object · 3 fields
dsl_operations array · 0 items
assets array · 1 item
[0]
source:pmid:34553213
steps array · 0 items
must_build object · 5 fields
dsl_operations array · 1 item
[0] object · 3 fields
operation
group_comparison_mann_whitney
priority
null
converters array · 0 items
readers array · 0 items
capabilities array · 0 items
data_gaps array · 1 item
[0]
data:geo:None
gaps array · 1 item
[0]
data:accession_absent
review object · 5 fields
state
partial
machine_critique object · 5 fields
kind
extraction_review
reader object · 5 fields
model
MiniMax-M3.1-Flash
provider
minimax
provider_family
minimax
read_at
2026-10-31T19:49:47Z
independence
single_reader
evidence_check object · 2 fields
method
verbatim
availability
null
calls
3
usage object · 3 fields
prompt_tokens
33344
completion_tokens
2786
cached_tokens
520
stages array · 1 item
[0] object · 4 fields
id
extraction
state
complete
reader
MiniMax-M3.1-Flash
provider
minimax
gaps array · 3 items
[0]
review.independent_reader
[1]
review.machine_critique
[2]
review.human_critique
execution object · 5 fields
state
absent
status
not_run
mode
null
runs array · 0 items
gaps array · 1 item
[0]
execution.not_run
provenance object · 7 fields
entities array · 3 items
[0] object · 3 fields
id
pmid:34553213
type
paper
label
pmid:34553213
[1] object · 3 fields
id
source:pmid:34553213
type
manuscript
label
PMID 34553213 full text
[2] object · 3 fields
id
data:geo:None
type
dataset
label
GEO None
activities array · 3 items
[0] object · 4 fields
id
activity-reading-sci-2026-11-01
type
classification
used array · 3 items
[0] object · 3 fields
id
pmid:34553213
type
paper
label
pmid:34553213
[1] object · 3 fields
id
source:pmid:34553213
type
manuscript
label
PMID 34553213 full text
[2] object · 3 fields
id
data:geo:None
type
dataset
label
GEO None
agent
agent:corpus-assay-engine
[1] object · 4 fields
id
activity-read-34553213
type
extraction
used array · 1 item
[0]
source:pmid:34553213
agent
agent:minimax-reader
[2] object · 4 fields
id
activity-resolve-None
type
accession_resolution
used array · 1 item
[0]
data:geo:None
agent
agent:corpus-assay-engine
agents array · 2 items
[0] object · 3 fields
id
agent:corpus-assay-engine
type
software
label
Corpus assay engine
[1] object · 3 fields
id
agent:minimax-reader
type
software
label
MiniMax literature reader
source_run_id
reading-sci-2026-11-01
dsl_catalogue_fingerprint
343fb30756ba6ec3
capability_table_fingerprint
2cb3e42f047d2ecf
snapshot_id
ba34b49490d9bfaf
lineage object · 4 fields
parent_id
pmid:34553213
parent_hash
sha256:2158caefa0066b9d0096237d079bb7d6cd1e0f6621275709b7c4e09d72774b93
fork_of
null
gaps array · 7 items
[0]
execution.not_run
[1]
method.group_comparison_mann_whitney
[2]
review.human_critique
[3]
review.independent_reader
[4]
review.machine_critique
[5]
step:obtain_source_data blocked on data:accession_absent
[6]
step:run_analysis blocked on method:group_comparison_mann_whitney
assays array · 2 items
[0] object · 11 fields
role
data_generation
definition_id
rna_seq
definition_version
99e1195c7d6f
required_operations array · 0 items
support_state
partial
source_hashes object · 1 field
assay_lexicon
99e1195c7d6f
confidence
0.99
evidence array · 4 items
[0]
Bias-invariant RNA-sequencing metadata annotation.
[1]
their needs. FINDINGS: Here, we investigate RNA-sequencing metadata prediction based on gene expression
[2]
on algorithm for the automatic annotation of RNA-sequencing metadata. We show, in multiple experiments,
[3]
p This study aims to find the best model for RNA-seq metadata annotation based on gene expression
order_basis
paper_text_order:0
id
assay:1
[1] object · 11 fields
role
analysis
definition_id
group_comparison
definition_version
f2132e96ae6c7a4e
required_operations array · 0 items
support_state
partial
source_hashes object · 1 field
dsl_catalogue
f2132e96ae6c7a4e
evidence array · 1 item
[0]
Accuracy distributions were tested for significance using the non-parametric Mann-Whitney U test (scipy.stats.mannwhitneyu v 1.3.1).
order_basis
consumes_earlier_output
id
assay:2
Complete file
{"sci_version": "1.2", "schema": "https://corpus.bntrg.co.uk/sci/1.0/sci.schema.json", "id": "pmid:34553213", "kind": "science-record", "revision": 7, "content_hash": "sha256:50de0180c12bb124558bc476e32c4ce1de49fa0b4b1c5eac6e90ea382b66ffdb", "created_at": "2026-11-01T15:41:53Z", "updated_at": "2026-11-01T22:04:47Z", "generator": {"name": "corpus-assay-engine", "run_id": "reading-sci-2026-11-01"}, "paper": {"state": "complete", "title": "Bias-invariant RNA-sequencing metadata annotation.", "doi": "10.1093/gigascience/giab064", "pmid": "34553213", "authors": ["Hannes Wartmann", "Sven Heins", "Karin Kloiber", "Stefan Bonn"], "journal": "GigaScience", "year": 2021, "abstract": "BACKGROUND: Recent technological advances have resulted in an unprecedented increase in publicly available biomedical data, yet the reuse of the data is often precluded by experimental bias and a lack of annotation depth and consistency. Missing annotations makes it impossible for researchers to find datasets specific to their needs.\nFINDINGS: Here, we investigate RNA-sequencing metadata prediction based on gene expression values. We present a deep-learning-based domain adaptation algorithm for the automatic annotation of RNA-sequencing metadata. We show, in multiple experiments, that our model is better at integrating heterogeneous training data compared with existing linear regression-based approaches, resulting in improved tissue type classification. By using a model architecture similar to Siamese networks, the algorithm can learn biases from datasets with few samples.\nCONCLUSION: Using our novel domain adaptation approach, we achieved metadata annotation accuracies up to 15.7% better than a previously published method. Using the best model, we provide a list of >10,000 novel tissue and sex label annotations for 8,495 unique SRA samples. Our approach has the potential to revive idle datasets by automated annotation making them more searchable.", "claims": [{"id": "claim-method", "statement": "Accuracy distributions were tested for significance using the non-parametric Mann-Whitney U test (scipy.stats.mannwhitneyu v 1.3.1).", "kind": "methodological", "target": null, "evidence": [{"asset": "source:pmid:34553213", "locator": "sections[24] \"Statistical tests\" paragraph 2", "quote": "Accuracy distributions were tested for significance using the non-parametric Mann-Whitney U test (scipy.stats.mannwhitneyu v 1.3.1)."}], "state": "complete"}, {"id": "claim-data-access", "statement": "To avoid additional biases by the use of different bioinformatic alignment pipelines [27] all data were downloaded from recount2 (release 13.09.19) [28].", "kind": "methodological", "target": null, "evidence": [{"asset": "source:pmid:34553213", "locator": "sections[3] \"Data acquisition\" paragraph 2", "quote": "To avoid additional biases by the use of different bioinformatic alignment pipelines [27] all data were downloaded from recount2 (release 13.09.19) [28]."}], "state": "complete"}], "gaps": []}, "experiment": {"state": "partial", "objective": null, "steps": [{"id": "read_published_estimate", "order": 1, "name": "Read the published estimate from the source", "kind": "other", "state": "complete", "blocked_on": null, "description": "The claim, method and evidence span published with the source article.", "duration_hours": null, "parameters": {}, "inputs": ["source:pmid:34553213"], "outputs": ["the published estimate and its evidence"], "instruments": [], "reagents": []}, {"id": "obtain_source_data", "order": 2, "name": "Obtain the source data from the named repository", "kind": "data-preparation", "state": "blocked", "blocked_on": "data:accession_absent", "description": "The GEO series accession resolves and its sample accessions are listed. This lane did not download the dataset or read its licence.", "duration_hours": null, "parameters": {}, "inputs": [], "outputs": ["the source data with its repository provenance"], "instruments": [], "reagents": []}, {"id": "run_analysis", "order": 3, "name": "Run the published analysis", "kind": "analysis", "state": "blocked", "blocked_on": "method:group_comparison_mann_whitney", "description": "Apply the paper's statistical method to the resolved series and compare the result with the published target.", "duration_hours": null, "parameters": {}, "inputs": [], "outputs": ["the replicated result and its comparison"], "instruments": [], "reagents": []}], "materials": [], "instruments": [], "reagents": [], "conditions": {}, "gaps": ["step:run_analysis blocked on method:group_comparison_mann_whitney", "step:obtain_source_data blocked on data:accession_absent"]}, "data": {"state": "partial", "assets": [{"id": "source:pmid:34553213", "role": "manuscript", "format": "xml", "media_type": "application/xml", "uri": "https://doi.org/10.1093/gigascience/giab064", "sha256": "sha256:c5e98940e916867b5be7a99c1703c1f9268cccb446dfc398941be182149f1bb2", "bytes": 67959, "access": "open", "state": "resolved", "reader": null, "reader_status": "reader_required", "identifier": "10.1093/gigascience/giab064", "version": null, "note": "Full article fetched from PMC; the checksum covers the rendered section body, not the original XML bytes.", "structure": {"pmcid": "PMC8559615", "source": "europe_pmc_fulltext", "coverage": "whole_body_without_references", "text_hash_scope": "rendered_section_body"}}], "gaps": []}, "analysis": {"state": "partial", "methods": [{"id": "method-1", "family": "group_comparison", "specific": "mann_whitney", "label": "Group comparison", "dsl_operations": [], "missing_operations": ["group_comparison_mann_whitney"], "expressible": false, "parameters": {}, "data_shapes": ["two_or_more_groups_continuous"], "evidence": {"score": 1.0, "band": "verbatim", "quote": "Accuracy distributions were tested for significance using the non-parametric Mann-Whitney U test (scipy.stats.mannwhitneyu v 1.3.1)."}}, {"id": "method-2", "family": "regression_modelling", "specific": "ols", "label": "Regression modelling", "dsl_operations": ["ols_fit"], "missing_operations": [], "expressible": true, "parameters": {}, "data_shapes": ["predictors_and_outcome"], "evidence": {"score": 0.7, "band": "medium", "quote": "linear regression"}}], "targets": [], "gaps": ["method.group_comparison_mann_whitney"]}, "capability": {"state": "complete", "requirements": [{"capability_id": "capability:computational_analysis", "label": "Computational analysis platform", "assay_families": ["meta_analysis", "machine_learning", "survival_analysis", "statistical_regression", "pca", "molecular_docking", "network_analysis", "differential_expression", "gwas"], "availability_state": "owned", "tier_unlocked": "R1", "candidate": "Automated Assays Laravel application and simulated adapters"}], "gaps": []}, "readiness": {"state": "blocked", "tier": "R4", "blocking_axis": "data", "blocked_on": "data:accession_absent", "axes": {"method": {"tier": "R1", "expressible": false, "required_operations": [], "missing_operations": ["group_comparison_mann_whitney"], "basis": "The paper names the method it used and the corpus's method extractor maps it onto the DSL catalogue: mann_whitney."}, "capability": {"tier": "R1", "capability_id": "capability:computational_analysis", "availability_state": "owned", "basis": "The computational analysis is owned. The physical bench the paper used is not, so a physical validation cannot be run here."}, "data": {"tier": "R4", "reachable": false, "accessions": [], "resolved_accessions": [], "statements": ["To avoid additional biases by the use of different bioinformatic alignment pipelines [27] all data were downloaded from recount2 (release 13.09.19) [28]."], "basis": "The paper names no accession to its source data, so the data has to come from the authors."}}, "can_run": {"dsl_operations": [], "assets": ["source:pmid:34553213"], "steps": []}, "must_build": {"dsl_operations": [{"operation": "group_comparison_mann_whitney", "unlocks_papers": null, "priority": null}], "converters": [], "readers": [], "capabilities": [], "data_gaps": ["data:geo:None"]}, "gaps": ["data:accession_absent"]}, "review": {"state": "partial", "machine_critique": {"kind": "extraction_review", "reader": {"model": "MiniMax-M3.1-Flash", "provider": "minimax", "provider_family": "minimax", "read_at": "2026-10-31T19:49:47Z", "independence": "single_reader"}, "evidence_check": {"method": "verbatim", "availability": null}, "calls": 3, "usage": {"prompt_tokens": 33344, "completion_tokens": 2786, "cached_tokens": 520}}, "human_critique": null, "stages": [{"id": "extraction", "state": "complete", "reader": "MiniMax-M3.1-Flash", "provider": "minimax"}], "gaps": ["review.independent_reader", "review.machine_critique", "review.human_critique"]}, "execution": {"state": "absent", "status": "not_run", "mode": null, "runs": [], "gaps": ["execution.not_run"]}, "provenance": {"entities": [{"id": "pmid:34553213", "type": "paper", "label": "pmid:34553213"}, {"id": "source:pmid:34553213", "type": "manuscript", "label": "PMID 34553213 full text"}, {"id": "data:geo:None", "type": "dataset", "label": "GEO None"}], "activities": [{"id": "activity-reading-sci-2026-11-01", "type": "classification", "used": [{"id": "pmid:34553213", "type": "paper", "label": "pmid:34553213"}, {"id": "source:pmid:34553213", "type": "manuscript", "label": "PMID 34553213 full text"}, {"id": "data:geo:None", "type": "dataset", "label": "GEO None"}], "agent": "agent:corpus-assay-engine"}, {"id": "activity-read-34553213", "type": "extraction", "used": ["source:pmid:34553213"], "agent": "agent:minimax-reader"}, {"id": "activity-resolve-None", "type": "accession_resolution", "used": ["data:geo:None"], "agent": "agent:corpus-assay-engine"}], "agents": [{"id": "agent:corpus-assay-engine", "type": "software", "label": "Corpus assay engine"}, {"id": "agent:minimax-reader", "type": "software", "label": "MiniMax literature reader"}], "source_run_id": "reading-sci-2026-11-01", "dsl_catalogue_fingerprint": "343fb30756ba6ec3", "capability_table_fingerprint": "2cb3e42f047d2ecf", "snapshot_id": "ba34b49490d9bfaf"}, "lineage": {"parent_id": "pmid:34553213", "parent_hash": "sha256:2158caefa0066b9d0096237d079bb7d6cd1e0f6621275709b7c4e09d72774b93", "fork_of": null, "generation": 6}, "gaps": ["execution.not_run", "method.group_comparison_mann_whitney", "review.human_critique", "review.independent_reader", "review.machine_critique", "step:obtain_source_data blocked on data:accession_absent", "step:run_analysis blocked on method:group_comparison_mann_whitney"], "assays": [{"role": "data_generation", "definition_id": "rna_seq", "definition_version": "99e1195c7d6f", "definition_digest": null, "required_operations": [], "support_state": "partial", "source_hashes": {"assay_lexicon": "99e1195c7d6f"}, "confidence": 0.99, "evidence": ["Bias-invariant RNA-sequencing metadata annotation.", "their needs. FINDINGS: Here, we investigate RNA-sequencing metadata prediction based on gene expression", "on algorithm for the automatic annotation of RNA-sequencing metadata. We show, in multiple experiments,", "p This study aims to find the best model for RNA-seq metadata annotation based on gene expression"], "order_basis": "paper_text_order:0", "id": "assay:1"}, {"role": "analysis", "definition_id": "group_comparison", "definition_version": "f2132e96ae6c7a4e", "definition_digest": null, "required_operations": [], "support_state": "partial", "source_hashes": {"dsl_catalogue": "f2132e96ae6c7a4e"}, "confidence": 1.0, "evidence": ["Accuracy distributions were tested for significance using the non-parametric Mann-Whitney U test (scipy.stats.mannwhitneyu v 1.3.1)."], "order_basis": "consumes_earlier_output", "id": "assay:2"}]}