The Scrut - Databricks integration fetches user access data, permissions, and role assignments from your Databricks account and syncs them with the Access Review module. This integration enables your organization to maintain comprehensive visibility over user access rights and streamline periodic access reviews for compliance and security.
Heads Up!
The data synced from Databricks flows into the Access Review module in Scrut.
Prerequisites
Before starting the integration, ensure you have the following access and permissions:
Access
You must be a Scrut Admin (or Contributor with access to the Integrations module)
You must have permissions to generate an API key in Databricks
Permissions
Scrut requires read-only access to the following data in Databricks
User Accounts: View name, email, and user role
Pro Tip!
We recommend logging into your Databricks account before starting the integration to avoid doing so later.
How To Connect Databricks With Scrut
Step 1: Fetch API Key from Databricks
Sign in to your Databricks workspace, click your username in the top menu, and select Settings from the dropdown.
.png)
Click Developer, and then click the Manage button next to Access Tokens.
Click Generate new token.
(Optional) Enter a comment that helps you identify this token, such as Scrut Integration.
Enter a numerical value to set the token lifetime to your preferred number of days, such as 90.
Click Generate.
Copy the displayed token and save it in a safe location, as you’ll need to enter it in Scrut in the next step.
Note: The token value will not be displayed again after you close this screen. So, make sure to copy and save it in a safe location.
Pro Tip!
Refer to this guide from Databricks for more information about personal access tokens.
Step 2: Go To Integrations in Scrut
Sign in to Scrut and click Integrations on the left navigation panel.
Navigate to the Integrations Library tab, and choose Database in the Categories section.
Scroll to the Databricks tile and click Integrate.
On the integration page, paste the API token obtained in Step 1.
Copy the base URL that you use to sign into Databricks. For example, https://dbc-12345-abc.cloud.databricks.com/
Click Submit.
Once authorization is done, you’ll see the “Connected Successfully” message and the Connected status indicator.
Synchronization Details
Initial Sync: Upon completing the integration, Scrut will start syncing user data from Databricks. This process typically takes a few hours to complete. Check the Audit Log on the Databricks integration page in Scrut to review the status.
Recurring Sync: After this, Scrut performs the sync once every 24 hours to fetch incremental data such as new users, role changes, and permission updates.
Data Fetched from Databricks
Scrut fetches the following access-related data points from Databricks:
User Name
User Email
User Role
Viewing Databricks Data in Scrut
To view the data fetched from your Databricks account, go to the People → Access → Overview tab. On this page, you can see the user details for your Databricks account.
You can also create an Access Review (or edit an existing one) and include the Databricks application in scope. Refer to this guide for step-by-step instructions on creating an access review.
Follow these steps to create a new access review for Databricks:
Go to People → Access and click Create New.
Enter Review Details: Name, Description, Owner, and Review Days.
In step 2, search for and select Databricks in the Applications in Scope.
Select Reviewer and Approver.
Review the details and click Save Review.
From the Access Review page, click Databricks to view user details in Scrut.
If you face any difficulties connecting Databricks with Scrut, please contact the Scrut support team at support@scrut.io.