Read from PostgreSQL databases with connection pooling and SSL support
## Overview The PostgreSQL connector enables DeltaForge to read data from PostgreSQL 10+ servers. Connections are configured through the GUI on the Configuration > Connections page. Once a connection is registered, remote tables and views are automatically discovered and appear in the catalog under the Database Tables section, where they can be browsed and queried using standard SQL with the zone.schema.table naming pattern. ## Configuration Database connections are not defined in SQL. Instead, use the Configuration > Connections page in the DeltaForge GUI to create a new PostgreSQL connection. Provide the host, port, database, credentials, and any SSL or advanced settings. After the connection is saved and tested, the connector introspects the target schema and populates the catalog with the available tables. Once registered, remote PostgreSQL tables can be queried directly: ```sql SELECT * FROM my_zone.public.customers WHERE region = 'EMEA'; ``` ## Authentication The connector supports password-based login and SSL client certificates. For production workloads, using VerifyFull SSL mode with a CA certificate is recommended to ensure both encryption and server identity verification. Mutual TLS can be configured by providing ssl_client_cert and ssl_client_key alongside the CA certificate. Passwords are stored in the secure credential vault and never persisted in plaintext or included in log output. ## Key Options The connector supports two data-access modes: - **Table mode**: Set the table option to read from a specific table. The connector generates a SELECT * and can push WHERE predicates and column projections down to the source, reducing data transfer over the network. - **Query mode**: Set the query option to execute an arbitrary SQL statement on the source server. This enables pre-aggregated extracts, CTEs, window functions, and other PostgreSQL-specific features. The query is sent to the source as-is. Only one mode may be active at a time. SSL/TLS modes control connection encryption: - **Disable**: No encryption. - **Prefer**: Use TLS if the server supports it, fall back to plaintext. - **Require**: Enforce TLS but skip certificate verification. - **VerifyCa**: Verify the server certificate against the provided CA. - **VerifyFull**: Verify the server certificate and hostname match. Connection pooling is managed internally. Connections are validated before use, automatically reconnected on transient failures, and released back to the pool after each operation. The statement_timeout_secs option provides a safety net to abort queries that exceed the expected execution time on the source server.