Multicohort study testing the generalisability of the SASKit-ML stroke and PDAC prognostic model pipeline to other chronic diseases.

{"sci_version": "1.0", "schema": "https://corpus.bntrg.co.uk/sci/1.0/sci.schema.json", "id": "pmid:39349378", "kind": "science-record", "revision": 2, "content_hash": "sha256:b0ddfecab9de01a3d18293b0bcc4c462c89a2d19fd6a27cf5661d211e157b2cc", "created_at": "2026-11-01T20:29:33Z", "updated_at": "2026-11-01T21:34:02Z", "generator": {"name": "corpus-assay-engine", "run_id": "reading-sci-2026-11-01"}, "paper": {"state": "complete", "title": "Multicohort study testing the generalisability of the SASKit-ML stroke and PDAC prognostic model pipeline to other chronic diseases.", "doi": "10.1136/bmjopen-2024-088181", "pmid": "39349378", "authors": ["Daniel Palmer", "Larissa Henze", "Hugo Murua Escobar", "Uwe Walter", "Axel Kowald", "Georg Fuellen"], "journal": "BMJ open", "year": 2024, "abstract": "OBJECTIVES: To validate and test the generalisability of the SASKit-ML pipeline, a prepublished feature selection and machine learning pipeline for the prediction of health deterioration after a stroke or pancreatic adenocarcinoma event, by using it to identify biomarkers of health deterioration in chronic disease.\nDESIGN: This is a validation study using a predefined protocol applied to multiple publicly available datasets, including longitudinal data from cohorts with type 2 diabetes (T2D), inflammatory bowel disease (IBD), rheumatoid arthritis (RA) and various cancers. The datasets were chosen to mimic as closely as possible the SASKit cohort, a prospective, longitudinal cohort study.\nDATA SOURCES: Public data were used from the T2D (77 patients with potential pre-diabetes and 18 controls) and IBD (49 patients with IBD and 12 controls) branches of the Human Microbiome Project (HMP), RA Map (RA-MAP, 92 patients with RA, 22 controls) and The Cancer Genome Atlas (TCGA, 16 cancers).\nMETHODS: Data integration steps were performed in accordance with the prepublished study protocol, generating features to predict disease outcomes using 10-fold cross-validated random survival forests.\nOUTCOME MEASURES: Health deterioration was assessed using disease-specific clinical markers and endpoints across different cohorts. In the HMP-T2D cohort, the worsening of glycated haemoglobin (HbA1c) levels (5.7% or more HbA1c in the blood), fasting plasma glucose (at least 100 mg/dL) and oral glucose tolerance test (at least 140) results were considered. For the HMP-IBD cohort, a worsening by at least 3 points of a disease-specific severity measure, the \"Simple Clinical Colitis Activity Index\" or \"Harvey-Bradshaw Index\" indicated an event. For the RA-MAP cohort, the outcome was defined as the worsening of the \"Disease Activity Score 28\" or \"Simple Disease Activity Index\" by at least five points, or the worsening of the \"Health Assessment Questionnaire\" score or an increase in the number of swollen/tender joints were evaluated. Finally, the outcome for all TCGA datasets was the progression-free interval.\nRESULTS: Models for the prediction of health deterioration in T2D, IBD, RA and 16 cancers were produced. The T2D (C-index of 0.633 and Integrated Brier Score (IBS) of 0.107) and the RA (C-index of 0.654 and IBS of 0.150) models were modestly predictive. The IBD model was uninformative. TCGA models tended towards modest predictive power.\nCONCLUSIONS: The SASKit-ML pipeline produces informative and useful features with the power to predict health deterioration in a variety of diseases and cancers; however, this performance is disease-dependent.", "claims": [{"id": "claim-method", "statement": "Integrated features were used to train a random survival forest model, using the randomForestSRC package of R, with evaluation carried out using the survcomp package to calculate the Integrated Brier Score (IBS) and C-index using 10-fold cross-validation, following the example in Dereli et al.", "kind": "methodological", "target": null, "evidence": [{"asset": "source:pmid:39349378", "locator": "sections[12] \"Random survival forest\" paragraph 2", "quote": "Integrated features were used to train a random survival forest model, using the randomForestSRC package of R, with evaluation carried out using the survcomp package to calculate the Integrated Brier Score (IBS) and C-index using 10-fold cross-validation, following the example in Dereli et al."}], "state": "complete"}, {"id": "claim-data-access", "statement": "Data are available in a public, open access repository. Data are available on reasonable request.", "kind": "methodological", "target": null, "evidence": [{"asset": "source:pmid:39349378", "locator": "sections[21] \"Data availability statement\" paragraph 2", "quote": "Data are available in a public, open access repository. Data are available on reasonable request."}], "state": "complete"}, {"id": "claim-target-result", "statement": "The SASKit-ML pipeline produced informative and useful features for predicting health deterioration across multiple diseases and cancers, but predictive performance was disease-dependent.", "kind": "qualitative", "target": null, "evidence": [{"asset": "source:pmid:39349378", "locator": "sections[0] \"Abstract\" paragraph 6", "quote": "The T2D (C-index of 0.633 and Integrated Brier Score (IBS) of 0.107) and the RA (C-index of 0.654 and IBS of 0.150) models were modestly predictive. The IBD model was uninformative. TCGA models tended towards modest predictive power."}, {"asset": "source:pmid:39349378", "locator": "sections[0] \"Abstract\" paragraph 7", "quote": "The SASKit-ML pipeline produces informative and useful features with the power to predict health deterioration in a variety of diseases and cancers; however, this performance is disease-dependent."}], "state": "complete"}], "gaps": []}, "experiment": {"state": "partial", "objective": "The SASKit-ML pipeline produced informative and useful features for predicting health deterioration across multiple diseases and cancers, but predictive performance was disease-dependent.", "steps": [{"id": "read_published_estimate", "order": 1, "name": "Read the published estimate from the source", "kind": "other", "state": "complete", "blocked_on": null, "description": "The claim, method and evidence span published with the source article.", "duration_hours": null, "parameters": {}, "inputs": ["source:pmid:39349378"], "outputs": ["the published estimate and its evidence"], "instruments": [], "reagents": []}, {"id": "obtain_source_data", "order": 2, "name": "Obtain the source data from the named repository", "kind": "data-preparation", "state": "blocked", "blocked_on": "data:accession_absent", "description": "The GEO series accession resolves and its sample accessions are listed. This lane did not download the dataset or read its licence.", "duration_hours": null, "parameters": {}, "inputs": [], "outputs": ["the source data with its repository provenance"], "instruments": [], "reagents": []}, {"id": "run_analysis", "order": 3, "name": "Run the published analysis", "kind": "analysis", "state": "complete", "blocked_on": null, "description": "Apply the paper's statistical method to the resolved series and compare the result with the published target.", "duration_hours": null, "parameters": {}, "inputs": [], "outputs": ["the replicated result and its comparison"], "instruments": [], "reagents": []}], "materials": [], "instruments": [], "reagents": [], "conditions": {}, "gaps": ["step:obtain_source_data blocked on data:accession_absent"]}, "data": {"state": "partial", "assets": [{"id": "source:pmid:39349378", "role": "manuscript", "format": "xml", "media_type": "application/xml", "uri": "https://doi.org/10.1136/bmjopen-2024-088181", "sha256": "sha256:f3dcdd1c39608108897f1ed250992188c5da8de38811efab004adf6d4b45ac8c", "bytes": 45994, "access": "open", "state": "resolved", "reader": null, "reader_status": "reader_required", "identifier": "10.1136/bmjopen-2024-088181", "version": null, "note": "Full article fetched from PMC; the checksum covers the rendered section body, not the original XML bytes.", "structure": {"pmcid": "PMC11448215", "source": "europe_pmc_fulltext", "coverage": "whole_body", "text_hash_scope": "rendered_section_body"}}], "gaps": []}, "analysis": {"state": "partial", "methods": [{"id": "method-1", "family": null, "specific": null, "label": "10-fold cross-validated random survival forests", "dsl_operations": [], "missing_operations": [], "expressible": null, "parameters": {}, "data_shapes": [], "evidence": {"score": 1.0, "band": "verbatim", "quote": "Integrated features were used to train a random survival forest model, using the randomForestSRC package of R, with evaluation carried out using the survcomp package to calculate the Integrated Brier Score (IBS) and C-index using 10-fold cross-validation, following the example in Dereli et al."}}], "targets": [], "gaps": ["method.reader_named_unmapped"]}, "capability": {"state": "complete", "requirements": [{"capability_id": "capability:computational_analysis", "label": "Computational analysis platform", "assay_families": ["meta_analysis", "machine_learning", "survival_analysis", "statistical_regression", "pca", "molecular_docking", "network_analysis", "differential_expression", "gwas"], "availability_state": "owned", "tier_unlocked": "R1", "candidate": "Automated Assays Laravel application and simulated adapters"}], "gaps": []}, "readiness": {"state": "blocked", "tier": "R4", "blocking_axis": "data", "blocked_on": "data:accession_absent", "axes": {"method": {"tier": "R4", "expressible": false, "required_operations": [], "missing_operations": [], "basis": "The reader quoted the method the paper names (10-fold cross-validated random survival forests), but the corpus's method extractor could not map it onto a DSL operation, so the method is published but not expressible."}, "capability": {"tier": "R1", "capability_id": "capability:computational_analysis", "availability_state": "owned", "basis": "The computational analysis is owned. The physical bench the paper used is not, so a physical validation cannot be run here."}, "data": {"tier": "R4", "reachable": false, "accessions": [], "resolved_accessions": [], "statements": ["Data are available in a public, open access repository. Data are available on reasonable request."], "basis": "The paper names no accession to its source data, so the data has to come from the authors."}}, "can_run": {"dsl_operations": [], "assets": ["source:pmid:39349378"], "steps": ["run_analysis"]}, "must_build": {"dsl_operations": [], "converters": [], "readers": [], "capabilities": [], "data_gaps": ["data:geo:None"]}, "gaps": ["data:accession_absent"]}, "review": {"state": "partial", "machine_critique": {"kind": "extraction_review", "reader": {"model": "MiniMax-M3.1-Flash", "provider": "minimax", "provider_family": "minimax", "read_at": "2026-11-01T19:33:42Z", "independence": "single_reader"}, "evidence_check": {"method": "verbatim", "availability": "verbatim"}, "calls": 5, "usage": {"prompt_tokens": 12750, "completion_tokens": 1958, "cached_tokens": 264}}, "human_critique": null, "stages": [{"id": "extraction", "state": "complete", "reader": "MiniMax-M3.1-Flash", "provider": "minimax"}], "gaps": ["review.independent_reader", "review.machine_critique", "review.human_critique"]}, "execution": {"state": "absent", "status": "not_run", "mode": null, "runs": [], "gaps": ["execution.not_run"]}, "provenance": {"entities": [{"id": "pmid:39349378", "type": "paper", "label": "pmid:39349378"}, {"id": "source:pmid:39349378", "type": "manuscript", "label": "PMID 39349378 full text"}, {"id": "data:geo:None", "type": "dataset", "label": "GEO None"}], "activities": [{"id": "activity-reading-sci-2026-11-01", "type": "classification", "used": [{"id": "pmid:39349378", "type": "paper", "label": "pmid:39349378"}, {"id": "source:pmid:39349378", "type": "manuscript", "label": "PMID 39349378 full text"}, {"id": "data:geo:None", "type": "dataset", "label": "GEO None"}], "agent": "agent:corpus-assay-engine"}, {"id": "activity-read-39349378", "type": "extraction", "used": ["source:pmid:39349378"], "agent": "agent:minimax-reader"}, {"id": "activity-resolve-None", "type": "accession_resolution", "used": ["data:geo:None"], "agent": "agent:corpus-assay-engine"}], "agents": [{"id": "agent:corpus-assay-engine", "type": "software", "label": "Corpus assay engine"}, {"id": "agent:minimax-reader", "type": "software", "label": "MiniMax literature reader"}], "source_run_id": "reading-sci-2026-11-01", "dsl_catalogue_fingerprint": "343fb30756ba6ec3", "capability_table_fingerprint": "2cb3e42f047d2ecf", "snapshot_id": "ba34b49490d9bfaf"}, "lineage": {"parent_id": "pmid:39349378", "parent_hash": "sha256:eda8d52a55832b083e062df189c82d786e9416cf9b4ad6265835dc90e9fe78d4", "fork_of": null, "generation": 1}, "gaps": ["execution.not_run", "method.reader_named_unmapped", "review.human_critique", "review.independent_reader", "review.machine_critique", "step:obtain_source_data blocked on data:accession_absent"]}