Predicting fine-grained cell types from histology images through cross-modal learning in spatial transcriptomics.

{"sci_version": "1.2", "schema": "https://corpus.bntrg.co.uk/sci/1.0/sci.schema.json", "id": "pmid:40662792", "kind": "science-record", "revision": 2, "content_hash": "sha256:9736243792db8d707102cc56ec1f96d0e43ed1d8524482cb84ccd04327d3ac15", "created_at": "2026-11-01T20:30:45Z", "updated_at": "2026-11-01T21:35:27Z", "generator": {"name": "corpus-assay-engine", "run_id": "reading-sci-2026-11-01"}, "paper": {"state": "complete", "title": "Predicting fine-grained cell types from histology images through cross-modal learning in spatial transcriptomics.", "doi": "10.1093/bioinformatics/btaf201", "pmid": "40662792", "authors": ["Chaoyang Yan", "Zhihan Ruan", "Songkang Chen", "Yichen Pan", "Xue Han", "Yuanyu Li", "Jian Liu"], "journal": "Bioinformatics (Oxford, England)", "year": 2025, "abstract": "MOTIVATION: Fine-grained cellular characterization provides critical insights into biological processes, including tissue development, disease progression, and treatment responses. The spatial organization of cells and the interactions among distinct cell types play a pivotal role in shaping the tumor micro-environment, driving heterogeneity, and influencing patient prognosis. While computational pathology can uncover morphological structures from tissue images, conventional methods are often restricted to identifying coarse-grained and limited cell types. In contrast, spatial transcriptomics-based approaches hold promise for pinpointing fine-grained transcriptional cell types using histology data. However, these methods tend to overlook key molecular signatures inherent in gene expression data.\nRESULTS: To this end, we propose a cross-modal unified representation learning framework (CUCA) for identifying fine-grained cell types from histology images. CUCA is trained on paired morphology-molecule spatial transcriptomics data, enabling it to infer fine-grained cell types solely from pathology images. Our model aims to harness the cross-modal embedding alignment paradigm to harmonize the embedding spaces of morphological and molecular modalities, bridging the gap between image patterns and molecular expression signatures. Extensive results across three datasets show that CUCA captures molecule-enhanced cross-modal representations and improves the prediction of fine-grained transcriptional cell abundances. Downstream analyses of cellular spatial architectures and intercellular co-localization reveal that CUCA provides insights into tumor biology, offering potential advancements in cancer research.\nAVAILABILITY AND IMPLEMENTATION: The source code of CUCA is available in Zenodo: 10.5281/zenodo.15087256.", "claims": [{"id": "claim-method", "statement": "The results demonstrate that CUCA outperformed existing approaches in predicting fine-grained cell abundance profiles from histology images, as evidenced by higher Spearman’s rank (Spearman’s ρ) correlation coefficients and Jensen–Shannon Divergence (JSD) values (Fig. 2a and b, Supplementary Figs S3 and S4, and Supplementary Table S1–S3).", "kind": "methodological", "target": null, "evidence": [{"asset": "source:pmid:40662792", "locator": "sections[14] \"3.3 CUCA enhances cell abundance prediction capability\" paragraph 2", "quote": "The results demonstrate that CUCA outperformed existing approaches in predicting fine-grained cell abundance profiles from histology images, as evidenced by higher Spearman’s rank (Spearman’s ρ) correlation coefficients and Jensen–Shannon Divergence (JSD) values (Fig. 2a and b, Supplementary Figs S3 and S4, and Supplementary Table S1–S3)."}], "state": "complete"}, {"id": "claim-data-access", "statement": "All the data used in this manuscript are publicly available. The healthy lung dataset derived from the integrated Human Lung Cell Atlas can be obtained from the public domain: https://5locationslung.cellgeni.sanger.ac.uk/. The her2st data is available in Zenodo, at https://doi.org/10.5281/zenodo.4751624. The STNet data is available in Mendeley Data at https://data. mendeley.com/datasets/29ntw7sh4r/5. The source code of CUCA is available in GitHub, at github.com/lyotvincent/CUCA.", "kind": "methodological", "target": null, "evidence": [{"asset": "source:pmid:40662792", "locator": "sections[28] \"Data availability\" paragraph 2", "quote": "All the data used in this manuscript are publicly available. The healthy lung dataset derived from the integrated Human Lung Cell Atlas can be obtained from the public domain: https://5locationslung.cellgeni.sanger.ac.uk/. The her2st data is available in Zenodo, at https://doi.org/10.5281/zenodo.4751624. The STNet data is available in Mendeley Data at https://data. mendeley.com/datasets/29ntw7sh4r/5. The source code of CUCA is available in GitHub, at github.com/lyotvincent/CUCA."}], "state": "complete"}], "gaps": []}, "experiment": {"state": "partial", "objective": "", "steps": [{"id": "read_published_estimate", "order": 1, "name": "Read the published estimate from the source", "kind": "other", "state": "complete", "blocked_on": null, "description": "The claim, method and evidence span published with the source article.", "duration_hours": null, "parameters": {}, "inputs": ["source:pmid:40662792"], "outputs": ["the published estimate and its evidence"], "instruments": [], "reagents": []}, {"id": "obtain_source_data", "order": 2, "name": "Obtain the source data from the named repository", "kind": "data-preparation", "state": "blocked", "blocked_on": "data:accession_absent", "description": "The GEO series accession resolves and its sample accessions are listed. This lane did not download the dataset or read its licence.", "duration_hours": null, "parameters": {}, "inputs": [], "outputs": ["the source data with its repository provenance"], "instruments": [], "reagents": []}, {"id": "run_analysis", "order": 3, "name": "Run the published analysis", "kind": "analysis", "state": "complete", "blocked_on": null, "description": "Apply the paper's statistical method to the resolved series and compare the result with the published target.", "duration_hours": null, "parameters": {}, "inputs": [], "outputs": ["the replicated result and its comparison"], "instruments": [], "reagents": []}], "materials": [], "instruments": [], "reagents": [], "conditions": {}, "gaps": ["step:obtain_source_data blocked on data:accession_absent"]}, "data": {"state": "partial", "assets": [{"id": "source:pmid:40662792", "role": "manuscript", "format": "xml", "media_type": "application/xml", "uri": "https://doi.org/10.1093/bioinformatics/btaf201", "sha256": "sha256:0731c58ba3c396eb3f7bb7e357ea23c870700a4c3155a9b3ac654748e64e5b84", "bytes": 44004, "access": "open", "state": "resolved", "reader": null, "reader_status": "reader_required", "identifier": "10.1093/bioinformatics/btaf201", "version": null, "note": "Full article fetched from PMC; the checksum covers the rendered section body, not the original XML bytes.", "structure": {"pmcid": "PMC12261428", "source": "europe_pmc_fulltext", "coverage": "whole_body", "text_hash_scope": "rendered_section_body"}}], "gaps": []}, "analysis": {"state": "partial", "methods": [{"id": "method-1", "family": null, "specific": null, "label": "Spearman’s rank correlation coefficient and Jensen–Shannon Divergence", "dsl_operations": [], "missing_operations": [], "expressible": null, "parameters": {}, "data_shapes": [], "evidence": {"score": 1.0, "band": "verbatim", "quote": "The results demonstrate that CUCA outperformed existing approaches in predicting fine-grained cell abundance profiles from histology images, as evidenced by higher Spearman’s rank (Spearman’s ρ) correlation coefficients and Jensen–Shannon Divergence (JSD) values (Fig. 2a and b, Supplementary Figs S3 and S4, and Supplementary Table S1–S3)."}}], "targets": [], "gaps": ["method.reader_named_unmapped"]}, "capability": {"state": "complete", "requirements": [{"capability_id": "capability:computational_analysis", "label": "Computational analysis platform", "assay_families": ["meta_analysis", "machine_learning", "survival_analysis", "statistical_regression", "pca", "molecular_docking", "network_analysis", "differential_expression", "gwas"], "availability_state": "owned", "tier_unlocked": "R1", "candidate": "Automated Assays Laravel application and simulated adapters"}], "gaps": []}, "readiness": {"state": "blocked", "tier": "R4", "blocking_axis": "data", "blocked_on": "data:accession_absent", "axes": {"method": {"tier": "R4", "expressible": false, "required_operations": [], "missing_operations": [], "basis": "The reader quoted the method the paper names (Spearman’s rank correlation coefficient and Jensen–Shannon Divergence), but the corpus's method extractor could not map it onto a DSL operation, so the method is published but not expressible."}, "capability": {"tier": "R1", "capability_id": "capability:computational_analysis", "availability_state": "owned", "basis": "The computational analysis is owned. The physical bench the paper used is not, so a physical validation cannot be run here."}, "data": {"tier": "R4", "reachable": false, "accessions": [], "resolved_accessions": [], "statements": ["All the data used in this manuscript are publicly available. The healthy lung dataset derived from the integrated Human Lung Cell Atlas can be obtained from the public domain: https://5locationslung.cellgeni.sanger.ac.uk/. The her2st data is available in Zenodo, at https://doi.org/10.5281/zenodo.4751624. The STNet data is available in Mendeley Data at https://data. mendeley.com/datasets/29ntw7sh4r/5. The source code of CUCA is available in GitHub, at github.com/lyotvincent/CUCA."], "basis": "The paper names no accession to its source data, so the data has to come from the authors."}}, "can_run": {"dsl_operations": [], "assets": ["source:pmid:40662792"], "steps": ["run_analysis"]}, "must_build": {"dsl_operations": [], "converters": [], "readers": [], "capabilities": [], "data_gaps": ["data:geo:None"]}, "gaps": ["data:accession_absent"]}, "review": {"state": "partial", "machine_critique": {"kind": "extraction_review", "reader": {"model": "MiniMax-M3.1-Flash", "provider": "minimax", "provider_family": "minimax", "read_at": "2026-11-01T19:56:59Z", "independence": "single_reader"}, "evidence_check": {"method": "verbatim", "availability": "verbatim"}, "calls": 5, "usage": {"prompt_tokens": 11882, "completion_tokens": 1510, "cached_tokens": 128}}, "human_critique": null, "stages": [{"id": "extraction", "state": "complete", "reader": "MiniMax-M3.1-Flash", "provider": "minimax"}], "gaps": ["review.independent_reader", "review.machine_critique", "review.human_critique"]}, "execution": {"state": "absent", "status": "not_run", "mode": null, "runs": [], "gaps": ["execution.not_run"]}, "provenance": {"entities": [{"id": "pmid:40662792", "type": "paper", "label": "pmid:40662792"}, {"id": "source:pmid:40662792", "type": "manuscript", "label": "PMID 40662792 full text"}, {"id": "data:geo:None", "type": "dataset", "label": "GEO None"}], "activities": [{"id": "activity-reading-sci-2026-11-01", "type": "classification", "used": [{"id": "pmid:40662792", "type": "paper", "label": "pmid:40662792"}, {"id": "source:pmid:40662792", "type": "manuscript", "label": "PMID 40662792 full text"}, {"id": "data:geo:None", "type": "dataset", "label": "GEO None"}], "agent": "agent:corpus-assay-engine"}, {"id": "activity-read-40662792", "type": "extraction", "used": ["source:pmid:40662792"], "agent": "agent:minimax-reader"}, {"id": "activity-resolve-None", "type": "accession_resolution", "used": ["data:geo:None"], "agent": "agent:corpus-assay-engine"}], "agents": [{"id": "agent:corpus-assay-engine", "type": "software", "label": "Corpus assay engine"}, {"id": "agent:minimax-reader", "type": "software", "label": "MiniMax literature reader"}], "source_run_id": "reading-sci-2026-11-01", "dsl_catalogue_fingerprint": "343fb30756ba6ec3", "capability_table_fingerprint": "2cb3e42f047d2ecf", "snapshot_id": "ba34b49490d9bfaf"}, "lineage": {"parent_id": "pmid:40662792", "parent_hash": "sha256:a6f7e1775bb3ad14b1992667c954e72ce2447a75498c590b67385bbed6e06269", "fork_of": null, "generation": 1}, "gaps": ["execution.not_run", "method.reader_named_unmapped", "review.human_critique", "review.independent_reader", "review.machine_critique", "step:obtain_source_data blocked on data:accession_absent"], "assays": [{"role": "data_generation", "definition_id": "scrna_seq", "definition_version": "99e1195c7d6f", "definition_digest": null, "required_operations": [], "support_state": "unsupported", "source_hashes": {"assay_lexicon": "99e1195c7d6f"}, "confidence": 0.93, "evidence": ["imation. This approach leverages a reference single-cell transcriptomics atlas alongside ST spot gene expression data"], "order_basis": "paper_text_order:3078", "id": "assay:1"}]}