Skip to content

Data Sources

This documentation identifies the sources of data used for Monty. This has been initiated from the GCDB excel source sheet.

Sources are declared in sources.yml, the single source of truth this section and docs/sources.json are generated from — see scripts/gen_sources_index.py. Run it after editing sources.yml; CI runs it with --check and fails on drift.

Available Sources

Source Organisation Status
AlertHub — undocumented
Copernicus Emergency Management Service — Rapid Mapping Copernicus Emergency Management Service (CEMS) etl
International Charter on Space and Major Disasters International Charter on Space and Major Disasters etl
DesInventar United Nations Office for Disaster Risk Reduction (UNDRR) production
EM-DAT Centre for Research on the Epidemiology of Disasters (CRED) production
GDACS European Commission - Joint Research Centre (JRC) production
Global Flood Database (GFD) Cloud to Street production
GLIDE Asian Disaster Reduction Center (ADRC) production
IBTrACS National Oceanic and Atmospheric Administration (NOAA) production
IDMC — Global Internal Displacement Database (GIDD) Internal Displacement Monitoring Centre (IDMC) production
IDMC — Internal Displacement Updates (IDU) Internal Displacement Monitoring Centre (IDMC) production
IFRC DREF International Federation of Red Cross and Red Crescent Societies (IFRC) production
Pacific Disaster Center (PDC) Pacific Disaster Center production
Reference Events — undocumented
USGS Earthquake Catalog United States Geological Survey (USGS) production

Data Types by Source

Source Events Hazards Impacts Response
AlertHub ✓ ✓ - -
Copernicus Emergency Management Service — Rapid Mapping ✓ ✓ ✓ ✓
International Charter on Space and Major Disasters ✓ ✓ - ✓
DesInventar ✓ - ✓ -
EM-DAT ✓ ✓ ✓ -
GDACS ✓ ✓ ✓ -
Global Flood Database (GFD) ✓ ✓ ✓ -
GLIDE ✓ ✓ - -
IBTrACS ✓ ✓ - -
IDMC — Global Internal Displacement Database (GIDD) ✓ - ✓ -
IDMC — Internal Displacement Updates (IDU) ✓ - ✓ -
IFRC DREF ✓ ✓ ✓ -
Pacific Disaster Center (PDC) ✓ ✓ ✓ -
Reference Events ✓ - - -
USGS Earthquake Catalog ✓ ✓ ✓ -

Source Characteristics

Each source has specific characteristics that determine how their data is used in Monty:

  • Update Frequency: Ranges from near real-time (GDACS, USGS) to annual updates (EM-DAT)
  • Geographic Coverage: Global vs. regional focus
  • Data Types: Events, hazards, and impacts coverage
  • Access Methods: API, file downloads, or direct database access
  • Data Format: Various formats including JSON, CSV, XML, and GeoJSON

For detailed information about each source, including specific data structures and integration methods, visit the respective source documentation pages linked above.

Role Conventions

Use the following role conventions consistently in source mappings:

  • Item properties.roles should include the data type role plus source for source-derived items:
    • event item: include event and source
    • hazard item: include hazard and source
    • impact item: include impact and source
  • For cross-item relationships using link rel="related", link roles should contain exactly one target type value: event, hazard, or impact.

Role order in arrays is not semantically significant.

Source Analysis Process

Adding a source follows a five-stage pipeline — from hands-on API familiarisation through the Monty mapping, worked examples, and the ETL transformer — documented in METHODOLOGY.md, along with the rules every source doc must follow (the taxonomy-first gate, fixture grounding, hazard-code verification) and the fixture size/placement policy.

Each source README follows the structure in SOURCE_TEMPLATE.md: Collections → Object model (+ Mermaid) → per-type field-carriage tables → Tracking over time → Cross-source linkage → Hazard codes → Examples → Reference files → Decisions → Resources.

The CEMS and Charter analyses are the worked reference implementations to read alongside the template.