This table outlines the compatibility of various datasources with observability. Understanding this compatibility is important to optimize data observability, ensuring that relevant metrics and logs can be effectively monitored and analyzed.
| Datasource | Deployment method | Catalog Profiling | Data Observability | ||||||
|---|---|---|---|---|---|---|---|---|---|
| Alerts | Filter datasets | Profilers | Popularity | ||||||
| Schema Drift | Data Drift | Freshness | Volume | ||||||
| Google BigQuery | Cloud | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| Databricks | Cloud | Yes | Yes | Yes | Yes | Yes | Yes | Yes | No |
| Snowflake | Cloud | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| Amazon Redshift | Cloud | Yes | Yes | Yes | Yes | Yes | Yes | Yes | Yes |
| Microsoft Azure Synapse Analytics | On-premise | Yes | Yes | Yes | No | Yes | No | No | No |
| Microsoft SQL server | On-premise | Yes | Yes | Yes | Yes | Yes | No | No | No |
| Oracle | On-premise | Yes | Yes | Yes | Yes | Yes | No | No | No |
| PostgreSQL | On-premise | Yes | Yes | Yes | No | Yes | No | No | No |
| Azure SQL server | On-premise | Yes | Yes | Yes | No | Yes | No | No | No |
To configure each datasource, refer to the Supported datasources. This documentation directs you to step-by-step instructions, including necessary parameters, and connection settings for each datasource.
Note:
- Snowflake: The tables and schemas is displayed in the application for Snowflake users having accountadmin role or roles having access to the Snowflake database. The accountadmin can grant Snowflake database access to other roles. To grant Snowflake database access to other roles, refer to Enabling Snowflake database usage for other roles.
- BigQuery: The tables and schemas is displayed in the application for BigQuery users having resourceViewer role. Ask your administrator to grant you the BigQuery Resource Viewer (roles/bigquery.resourceViewer) IAM role on your project. For more information about granting roles, see Manage access for Google BigQuery.