REST catalog

​

Required settings

• REST Catalog URI
• Authentication (Bearer token or OAuth2)
• Catalog name

​

Databricks Unity catalog

• Enable external data access
• Modify the service principal to have the following permissions:
  • EXTERNAL USE SCHEMA, EXTERNAL USE LOCATION
  • USE CATALOG, USE SCHEMA
  • SELECT
  • MANAGE, CREATE SCHEMA, CREATE TABLE, MODIFY, WRITE VOLUME

GRANT EXTERNAL USE SCHEMA ON SCHEMA catalog_name.schema_name TO `6f0c8a4e-2b1d-4c7a-9e3f-5d8b1a2c4e6f`;

1. REST Catalog URI (https://{{DATABRICKS_INSTANCE_URL}}/api/2.1/unity-catalog/iceberg-rest)
2. Catalog name

​

Authentication

• Bearer token
• OAuth2 M2M

A bearer token is a personal access token, so Artie acts as the user who created it. Grant the permissions above to that user, or use OAuth2 M2M with the service principal instead.To generate a personal access token:Go into your workspace and do the following:

• Click on your username in the top bar and select Settings from the dropdown.
• Click Developer
• Click Access tokens then Generate new token
• (Optional) Provide a description for the token and if you set expiration, make sure to note it down.

To generate an OAuth2 M2M token, you’ll want to generate an OAuth2 token for your service principal:

• Follow this guide to create an OAuth secret for your service principal
• Put the token URL as https://{{DATABRICKS_INSTANCE_URL}}/oidc/v1/token
• Put all-apis as the OAuth2 scope