Databricks Lakehouse Federation
Lakehouse Federation in Databricks🔗
This feature allows us to query external system data without replicating storage on databricks.
Steps to Setup Federation🔗
We need the external location to setup connection.
Create a new Connection.
- Foreign catalogs are read only.
- Any catalog that doesnt come under Unity Catalog scheme of things is Foreign Catalog.
- We can manage permissions and also check lineage of tables of Foreign Catalogs.
Creating Catalogs using SQL