Data Sources

The external sources DeltaForge reads, spanning cloud storage, databases, file formats, EDI, and healthcare feeds.

Cloud Storage

• Amazon S3Amazon S3 storage backend for zones, enabling external tables over S3-hosted data files
• Azure Blob StorageAzure Blob Storage backend for zones, enabling external tables over Azure-hosted data files
• Google Cloud StorageGoogle Cloud Storage backend for zones, enabling external tables over GCS-hosted data files

Databases

• MySQL / MariaDBRead from MySQL and MariaDB databases with connection pooling and SSL support
• Oracle DatabaseRead from Oracle Database (12c and later) using service name or SID connections
• PostgreSQLRead from PostgreSQL databases with connection pooling and SSL support
• SQL ServerRead from Microsoft SQL Server with Windows, SQL, and Azure AD authentication

EDI

• TRADACOMSParse TRADACOMS UK retail EDI messages for orders, invoices, and deliveries
• UN/EDIFACTParse UN/EDIFACT (ISO 9735) international EDI messages for trade, transport, and customs
• X12 (ASC X12)Parse ASC X12 EDI messages used in North American B2B transactions (healthcare, supply chain, finance)

File Formats

• Apache IcebergRead Apache Iceberg tables with time-travel support via snapshot selection
• AvroRead Apache Avro binary serialized format files
• CSVRead comma-separated or delimiter-separated text files
• ExcelRead Microsoft Excel (.xls, .xlsx, .xlsm, .xlsb) and ODS spreadsheet files
• JSON / NDJSONRead JSON and newline-delimited JSON files with optional flattening
• ORCRead Apache ORC optimized columnar format files
• ParquetRead Apache Parquet columnar format files
• Protocol BuffersRead Protocol Buffers binary format using an external .proto schema
• XMLRead and flatten XML documents using XPath row selection

Healthcare

• FHIR JSONRead FHIR R4/R5 resources from JSON and NDJSON formats using the JSON format handler with json_flatten_config
• FHIR RDF/TurtleParse FHIR resources from RDF/Turtle format for semantic web and linked data workflows
• FHIR XMLRead FHIR R4/R5 resources from XML format using the XML format handler with xml_flatten_config
• HL7 v2Parse HL7 v2 healthcare messages (ADT, ORU, ORM, etc.) with segment-level access