Data marketplace
CD

Cypress Bay Digestive Health — Colonoscopy Surveillance (US)

RestrictedGatekeeper

by QA SUP-825 · Healthcare · 120K records

Usability 9.0121 columnsNot for sale
healthcareclinicalgastroenterologycolonoscopysurveillanceidentifyingsynthetic

About this dataset

Identifying clinical records from a six-site US gastroenterology network: patients, office encounters, colonoscopies and upper endoscopies, polyp-level findings, histopathology, post-polypectomy surveillance recommendations with the guideline basis for each, the recall each one generates, every outreach attempt against it, and the register of clinical documents the practice holds. Synthetic throughout.

Expected update
On demand
Access price
Not for sale
Provenance
Attested

Access & permissions

Set by the data owner — enforced in the enclave

Visibility

Restricted — only organizations the owner names can discover and use it. The allow-list itself is the owner’s to see.

Apps allowed to use this data

2 applications are on the allow-list.

Any other app is rejected at mount time — the gatekeeper checks the deployment evidence against this allow-list before releasing data.

Works with

Published apps with a slot this dataset can be mounted into

cbdh_sites6 fieldsThe network's clinical sites. One row per site. Join from any table carrying `site_id` to get the city a procedure or an encounter happened in.
ColumnTypeDescription
site_idstringSite identifier (primary key), e.g. S01.
site_namestringName of the clinic or endoscopy center.
citystringCity the site is in.
statestringTwo-letter US state code. Every site is in FL.
endoscopy_suitesintegerNumber of procedure rooms at the site — its capacity.
opened_ondateDate the site opened. Earlier sites carry longer histories.
cbdh_providers6 fieldsClinicians and surveillance staff. One row per person. Endoscopists appear as `cbdh_procedures.provider_id`, pathologists as `cbdh_pathology.pathologist_id`, surveillance coordinators as `cbdh_recalls.assigned_coordinator_id`, so a per-clinician figure is a join away.
ColumnTypeDescription
provider_idstringProvider identifier (primary key), e.g. PR-0007.
provider_namestringFull name with credential, e.g. 'Vance Hollingsworth, MD'.
npistringTen-digit National Provider Identifier. Deliberately invalid: every one begins with 9, which no issued NPI does.
rolestringGastroenterologist / Advanced endoscopist / Colorectal surgeon / Nurse practitioner / Physician assistant / Surveillance coordinator / Pathologist. Only the first three perform procedures.
site_idstringThe site the provider is based at.
specialty_focusstringClinical interest, e.g. 'Advanced polypectomy and EMR', 'Colorectal cancer screening', 'Hereditary GI cancer risk'.
cbdh_patients19 fieldsOne row per patient, with direct identifiers. This is a live clinical record, not a de-identified extract: a name, a date of birth and a medical record number are present because the clinical work needs them. `mrn` is the number that appears on the practice's documents and is how a scanned note is matched to this row.
ColumnTypeDescription
patient_idstringInternal patient identifier (primary key), e.g. P-0004296.
mrnstringMedical record number, e.g. CB-1004296. The identifier printed on clinical documents — use it to match a note or a report to a patient.
family_namestringPatient family name (surname).
given_namestringPatient given name (first name).
date_of_birthdateDate of birth. Age is not stored; compute it from this and the date of interest, because the age that matters is the age at the procedure, not today's.
sexstringF or M.
phonestringTelephone number on file — the number recall outreach dials. Every one is in the North American fiction range (`555-0100` to `555-0199`), so patients share numbers; outside that range a generated number belongs to a real person.
emailstringEmail address on file. Every one is in the example.org reserved domain.
address_linestringStreet address on file. Letters go here, and come back from here.
citystringCity of residence.
statestringTwo-letter US state code.
postal_codestringFive-digit ZIP code.
primary_site_idstringThe site the patient is registered at.
primary_provider_idstringThe patient's usual gastroenterologist.
payer_typestringMedicare Part B / Medicare Advantage / Commercial / Medicaid / Self-pay.
insurance_planstringName of the specific plan, e.g. 'Sunstate Advantage HMO'.
preferred_languagestringLanguage the patient prefers to be contacted in. Relevant to recall outreach: a letter in the wrong language is an attempt that was never going to land.
registered_ondateDate the patient registered with the network.
patient_statusstringactive / inactive / transferred out / deceased. A recall on a patient who is not active should not be generating outreach, which makes this column worth checking against `cbdh_recalls.recall_status`.
cbdh_encounters8 fieldsOffice and telehealth visits. One row per visit. A procedure is normally preceded by a pre-procedure consultation and followed by a results review; a procedure performed at another facility instead has a 'New patient consultation' at which the outside records were requested.
ColumnTypeDescription
encounter_idstringEncounter identifier (primary key).
patient_idstringThe patient seen.
site_idstringWhere the visit happened.
provider_idstringWho the patient saw.
encounter_datedateDate of the visit.
encounter_typestringPre-procedure consultation / Results review / New patient consultation.
chief_complaintstringWhy the patient came, as a short category rather than free text.
dispositionstringWhat was decided, e.g. 'Colonoscopy scheduled', 'Pathology discussed, surveillance interval agreed', 'Outside records requested', 'Referred to colorectal surgery'.
cbdh_procedures16 fieldsEndoscopic procedures. One row per procedure — colonoscopies (screening, surveillance, diagnostic), flexible sigmoidoscopies and upper endoscopies. Read `report_source` before any aggregate over this table. 'Structured capture' means the practice performed the procedure and keyed its detail in, so `cbdh_findings`, `cbdh_pathology` and `cbdh_surveillance_recommendations` all have rows for it. 'Outside report' means it was performed at another facility: the date, the type and the indication are all that reached the structured record, every other column is empty, and there are NO findings, NO pathology and NO surveillance recommendation anywhere. That detail exists only in a document — see `cbdh_clinical_documents`. A quality figure such as an adenoma detection rate must be restricted to 'Structured capture' or it is diluted by procedures whose findings were never entered.
ColumnTypeDescription
procedure_idstringProcedure identifier (primary key), e.g. PROC-0000905.
patient_idstringThe patient.
site_idstringWhere it was performed. Empty when `report_source` is 'Outside report'.
provider_idstringThe endoscopist. Empty when `report_source` is 'Outside report' — the person who performed it does not work here and is named only in the document.
procedure_datedateDate of the procedure.
procedure_typestringScreening colonoscopy / Surveillance colonoscopy / Diagnostic colonoscopy / Flexible sigmoidoscopy / EGD. Only the first three examine the whole colon, and only they appear in `cbdh_surveillance_recommendations`. A flexible sigmoidoscopy examines the left colon and stops — by design, not by failure, so it has no `cecal_intubation` result and earns no surveillance interval; there is nothing to say about a colon two thirds of which was not looked at. An EGD is an upper endoscopy and says nothing about the colon at all. Restrict any colonoscopy quality figure to the three colonoscopy types.
indicationstringWhy the procedure was done, e.g. 'Average-risk colorectal cancer screening, age-appropriate', 'Positive fecal immunochemical test', 'Post-polypectomy surveillance, prior adenoma'. Average-risk screening begins at 45, so 'age-appropriate' appears only on patients who were 45 or older on the day; a younger patient scoped for screening carries the reason instead — a first-degree relative, Lynch syndrome, familial adenomatous polyposis.
report_sourcestring'Structured capture' — performed here, detail entered, findings and pathology present. 'Outside report' — performed elsewhere, clinical detail exists only as a document and nothing below is populated.
bowel_prep_qualitystringExcellent / Good / Fair / Poor. The adjective straddles the adequacy threshold; `bbps_total` is what decides it. Empty for an outside report.
bbps_totalnullableintegerBoston Bowel Preparation Scale, 0 to 9 across three colon segments. A total under 6 is an inadequate preparation and the examination has to be repeated within a year whatever was found. Null for an outside report.
cecal_intubationnullableinteger1 when the cecum was reached, 0 when it was not. A COLONOSCOPY that did not reach the cecum did not examine the whole colon and is a repeat, not a surveillance decision. Null where the question does not apply: an outside report, an EGD, and a flexible sigmoidoscopy — which was never going to the cecum, so counting it as a failure overstates the failure rate badly. Compute a cecal intubation rate over the three colonoscopy types only.
withdrawal_time_minnullablenumberMinutes spent withdrawing the scope and inspecting the mucosa. Six minutes is the accepted floor; it correlates with how many polyps get found. Null for an outside report and for an EGD.
sedationstringMonitored anesthesia care / Moderate sedation / General anesthesia.
asa_classstringAmerican Society of Anesthesiologists physical status, I to IV.
completion_statusstring'Complete to cecum' — a colonoscopy that reached the cecum. 'Incomplete — cecum not reached' — one that did not; it has to be repeated. 'Complete to the extent intended — left colon only' — a flexible sigmoidoscopy, which is a finished examination and not a failed colonoscopy. 'Complete — upper tract' — an EGD. 'Unknown — outside report not abstracted' — performed elsewhere; the document says and no column does.
complicationstring'None' or the complication, e.g. 'Post-polypectomy bleeding, managed endoscopically'. Empty for an outside report.
cbdh_findings9 fieldsPolyps and lesions, one row per lesion — so a procedure that removed four polyps has four rows here. Only procedures with `report_source = 'Structured capture'` appear. Count rows per `procedure_id` for the polyp burden of an examination.
ColumnTypeDescription
finding_idstringFinding identifier (primary key). One lesion.
procedure_idstringThe procedure it was found at.
patient_idstringThe patient.
segmentstringCecum / Ascending colon / Transverse colon / Descending colon / Sigmoid colon / Rectum, from the far end of the colon to the near. The first three are the proximal colon, where serrated lesions concentrate and are easiest to miss. A finding is never recorded beyond where that examination's scope actually reached: a sigmoidoscopy has findings no further in than the descending colon, and a colonoscopy with `cecal_intubation = 0` has none in the cecum.
size_mmintegerLargest dimension in millimetres, as the endoscopist measured it. Ten millimetres is the threshold that makes a lesion advanced on size alone; twenty is the threshold at which a piecemeal resection needs a six-month check.
morphologystringParis classification, e.g. 'Paris Is — sessile', 'Paris IIa — flat elevated', 'Paris Ip — pedunculated'. Flat and depressed lesions are the ones that get missed.
resection_methodstringCold snare polypectomy / Cold forceps biopsy / Hot snare polypectomy / Endoscopic mucosal resection, en bloc / Endoscopic mucosal resection, piecemeal / Not resected.
resection_completestringYes / No / 'Endoscopically complete, piecemeal'. The last one means the endoscopist believes the lesion is gone but the pathologist cannot confirm it from fragments.
piecemealinteger1 when the lesion was removed in fragments. A piecemeal resection of a lesion 20 mm or larger earns a six-month examination of the scar, which is the shortest interval in routine surveillance.
cbdh_pathology14 fieldsHistopathology, one row per specimen, keyed to the lesion it came from. A lesion that was not resected has no row here. `adenoma` and `advanced_histology` are precomputed because they are the two flags every surveillance rule turns on.
ColumnTypeDescription
pathology_idstringPathology record identifier (primary key).
finding_idstringThe lesion this specimen came from.
procedure_idstringThe procedure.
patient_idstringThe patient.
accession_numberstringLaboratory accession, shared by every specimen from one procedure.
received_datedateDate the specimen reached the laboratory.
reported_datedateDate the report was issued. The gap from `received_date` is laboratory turnaround, and a long one delays the surveillance decision.
lab_namestringReporting laboratory.
pathologist_idstringThe reporting pathologist.
histologystringThe diagnosis. Tubular adenoma / Tubulovillous adenoma / Villous adenoma / Traditional serrated adenoma — all neoplastic, all count toward surveillance. Sessile serrated lesion — neoplastic, and dangerous precisely because it looks innocuous. Hyperplastic polyp / Inflammatory polyp / Normal colonic mucosa — not neoplastic, no surveillance consequence. Adenocarcinoma — cancer, and not a surveillance decision at all.
dysplasia_gradestringNone / Low-grade / High-grade. High-grade dysplasia shortens the interval to three years on its own, whatever the lesion's size.
adenomainteger1 when the histology is an adenoma. The adenoma detection rate is the share of screening colonoscopies at which AT LEAST ONE adenoma was found — a per-procedure figure, so count distinct `procedure_id` with any adenoma over all screening colonoscopies. Averaging this column across rows instead gives the share of specimens that were adenomas, which is a different and much larger number. Restrict to `cbdh_procedures.report_source = 'Structured capture'` either way, or the figure is diluted by procedures whose findings were never entered.
advanced_histologyinteger1 when the lesion is one of the ones that earns a three-year interval on its own: 10 mm or larger, or high-grade dysplasia, or tubulovillous or villous histology, or a traditional serrated adenoma, or a sessile serrated lesion with any dysplasia. The flag and `cbdh_surveillance_recommendations.basis` are computed from the same rule, so they cannot disagree.
margin_statusstringClear / Involved / 'Cannot be assessed' / 'Cannot be assessed — piecemeal specimen' / 'Not applicable — lesion not resected'.
cbdh_surveillance_recommendations11 fieldsThe interval each completed examination earned, one row per procedure that generated one. `basis` states the rule that produced it in words, so a recommendation can be checked rather than taken on trust. A patient accumulates one row per examination; `superseded_by` names the later examination that replaced this recommendation, and is empty on the one that is still live.
ColumnTypeDescription
recommendation_idstringRecommendation identifier (primary key).
procedure_idstringThe examination it followed.
patient_idstringThe patient.
recommended_ondateDate of the examination the recommendation followed.
interval_monthsintegerMonths until the next examination: 3 or 6 for a repeat or a piecemeal scar check, 12, 36, 60, 84 or 120 for routine surveillance and screening.
due_datedate`recommended_on` plus `interval_months` — when the next examination is due.
risk_tierstringLow / Intermediate / High / Malignant / 'Repeat required'. The last two are not surveillance: 'Malignant' means cancer was found in a polypectomy specimen and the case needs multidisciplinary review; 'Repeat required' means the examination itself was inadequate — the cecum was not reached, or the preparation was too poor to see through — so nothing was learned and it has to be done again.
basisstringThe rule in words, e.g. '3 small adenomas, none 10 mm or larger — 3 years', 'Advanced histology — lesion 10 mm or larger, villous histology — 3 years', 'Piecemeal resection of a lesion 20 mm or larger — 6 months to confirm clearance'.
recommending_provider_idstringWho made the recommendation.
recommendation_sourcestring'Endoscopist at discharge' — decided before the pathology came back. 'Pathology-triggered revision' — revised once it had.
superseded_bystringThe later examination that answered this recommendation. Empty when the recommendation is still the patient's current one — which is the only kind that can be overdue.
cbdh_recalls12 fieldsThe recall each surveillance recommendation generates, and what became of it. One row per recommendation. This is the table the overdue-surveillance question is answered from. `recall_status = 'overdue'` means the due date has passed, no later examination happened, and outreach is still being attempted; 'lost_to_follow_up' means outreach has been exhausted or the patient cannot be reached at all. Both carry a positive `days_overdue`. 'completed' names the later examination in `completed_procedure_id`, so it can be verified rather than believed. 'not_yet_due' is the large, uninteresting majority: a ten-year interval set last year.
ColumnTypeDescription
recall_idstringRecall identifier (primary key).
recommendation_idstringThe recommendation being chased.
patient_idstringThe patient.
due_datedateWhen the next examination is due. Copied from the recommendation.
recall_statusstringnot_yet_due — due more than 90 days away. due_soon — due within 90 days, no appointment. scheduled — appointment booked. completed — a later examination answered it. overdue — past due, no appointment, outreach continuing. lost_to_follow_up — past due, outreach exhausted or undeliverable. declined — patient refused. deferred_medical — postponed for a clinical reason, see `deferral_reason`. moved_away — transferred out of the network. deceased.
days_overdueintegerDays past `due_date` as of the dataset's as-of date, for the overdue and lost-to-follow-up statuses only. Zero everywhere else — so sum or average it over those two statuses, not over the whole table.
outreach_attemptsintegerHow many times the practice has tried to reach the patient about this recall. The individual attempts are in `cbdh_recall_outreach`.
last_outreach_datenullabledateDate of the most recent attempt, or null if none has been made.
scheduled_datenullabledateThe booked appointment when the status is 'scheduled', or the date of the examination that closed it when the status is 'completed'.
completed_procedure_idstringThe examination that answered this recall. Populated only when the status is 'completed', and it always resolves — an unverifiable 'completed' is how a recall register comes to disagree with the clinical record.
assigned_coordinator_idstringThe surveillance coordinator who owns this recall.
deferral_reasonstringWhy the recall was postponed, when the status is 'deferred_medical' — e.g. 'Anticoagulation cannot be interrupted', 'Active cardiac workup'. Empty otherwise.
cbdh_recall_outreach8 fieldsEvery attempt to reach a patient about a recall, one row per attempt. The outcome is a code, not a narrative: it records that the call did not land, never why. Why is in the coordinator's note, which is a document.
ColumnTypeDescription
outreach_idstringOutreach attempt identifier (primary key).
recall_idstringThe recall being chased.
patient_idstringThe patient.
attempt_nointeger1 for the first attempt against this recall, ascending.
attempt_datedateDate of the attempt.
channelstringTelephone / Patient portal / Letter / SMS.
outcomestringWhat the attempt ended in, and it is always something that channel can produce: a telephone call ends 'No answer', 'Voicemail left', 'Wrong or disconnected number', 'Reached — will call back', 'Reached — declined' or 'Reached — appointment scheduled'; a letter ends 'No response to letter' or 'Mail returned undeliverable'; a portal message ends 'Portal message unread' or 'Portal message read, no reply'; an SMS ends 'No reply to text message' or 'Text message undeliverable'. 'Wrong or disconnected number', 'Mail returned undeliverable' and 'Text message undeliverable' mean the contact details on file are wrong — a different problem from a patient who will not come, and a different fix.
coordinator_idstringThe surveillance coordinator who made the attempt.
cbdh_clinical_documents12 fieldsThe register of documents the practice holds about a procedure — what the file is, where it came from, and whether anyone has read it into the record yet. The documents themselves are PDF, DOCX and text files outside this database; `document_filename` names one. Two cohorts live here. `abstraction_status = 'pending'` on an 'Outside records packet' is a colonoscopy performed elsewhere whose entire clinical detail — preparation, cecal intubation, every polyp, every histology, the recommended interval — is in the document and in no column of this database. `abstraction_status = 'quality review'` on an 'Endoscopy and pathology report' is the signed report that a structurally captured procedure's columns were keyed in from by a person, sampled to be read back against the record.
ColumnTypeDescription
document_idstringDocument register identifier (primary key).
procedure_idstringThe procedure the document is about. Empty for a document that is not about a procedure, such as a recall coordinator's note.
patient_idstringThe patient.
document_typestring'Outside records packet' / 'Endoscopy and pathology report' / 'Referral letter' / 'Recall coordinator note'.
source_facilitystringWhere the document came from. Empty for a document created here.
received_onnullabledateDate the document reached the practice. Null when it has not arrived — the long gap from `cbdh_procedures.procedure_date` is how long the records office spent chasing it.
document_statusstringreceived / requested / 'not received'. A procedure whose document has not arrived cannot be abstracted at all, which is a different queue from one that can.
document_filenamestringFilename of the document, e.g. 'arrington-deborah-outside-colonoscopy-2022-09-06.pdf'. Empty when the document has not arrived.
document_formatstringpdf / docx / txt.
document_pagesnullableintegerPages in the document. Null when it has not arrived.
abstraction_statusstringpending — the document is in hand and nobody has read it into the record. 'blocked - awaiting records' — it has not arrived. 'quality review' — the record was keyed in from this document and the sample is being read back against it. complete.
assigned_abstractor_idstringThe nurse practitioner or physician assistant who owns the abstraction.