databricks-lakeflow-connect
This skill builds managed ingestion pipelines into Databricks Unity Catalog using Lakeflow Connect, handling data pulls from SaaS applications like Salesforce…
Identity proven by GitHub's verified organisation badge (databricks)
- Agents
- Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot, OpenCode
- License
- LicenseRef-Databricks (restricted)
- Pin
- e3df77bpinned Oct 9, 2026
- Context cost
- about 3,700 tokenswhen the skill loads
- GitHub stars
- 345on databricks/databricks-agent-skills
- Scripts
- None found
What it does
“Build managed ingestion pipelines into Databricks using Lakeflow Connect. Use when ingesting from SaaS apps (Salesforce, Workday Reports, ServiceNow, Google Analytics 4, HubSpot, Confluence) or databases (SQL Server cloud and on-prem; PostgreSQL/MySQL CDC in PuPr) into Unity Catalog with serverless pipelines.”
Generated summary from the skill's own text
This skill builds managed ingestion pipelines into Databricks Unity Catalog using Lakeflow Connect, handling data pulls from SaaS applications like Salesforce and ServiceNow, databases via CDC or gateway patterns, and file sources. Pipelines run serverless on Spark Declarative Pipelines with built-in change tracking and schema evolution, requiring Databricks CLI v0.294.0 or higher.
When to use it
- Ingesting from SaaS apps or databases with managed connectors into UC
- Building incremental CDC pipelines with serverless compute
- Setting up ongoing data synchronization from external sources
- Consolidating multiple source tables into Unity Catalog schemas
When not to
- Ingesting files from cloud storage without CDC needs, use Auto Loader instead
- Querying sources in place without copying data, use Lakehouse Federation
- Receiving pushed events from external systems, use Zerobus instead
Install
Restricted license: install from the publisher's repository and read its terms.
These commands install from the publisher's repository and need no account.
skills CLI
npx skills add databricks/databricks-agent-skills --skill databricks-lakeflow-connectInstalls from the repository's default branch, which may have changed since the commit we checked.
GitHub CLI 2.90 or later
gh skill install databricks/databricks-agent-skills databricks-lakeflow-connect@e3df77b3f0eb5d70392eb35c6761ca0f2929a4f6Installs the commit we checked (e3df77b).
Copy by hand
Download the folder at e3df77b and put it in .claude/skills/databricks-lakeflow-connect for Claude Code and in .agents/skills/databricks-lakeflow-connect for Codex, Cursor, Gemini CLI, GitHub Copilot and OpenCode.
Claude Code plugin
/plugin install databricks@claude-plugins-officialThe publisher's plugin in Claude's official marketplace. It may hold more than this skill, and we have not pinned it.
Copy for your agent
A prompt for any coding agent. It installs this skill from GitHub at the pinned commit, copies the files as they are, and runs nothing unless you ask.
Prompt
Install the agent skill "databricks-lakeflow-connect" by Databricks. Source, pinned to commit e3df77b3f0eb5d70392eb35c6761ca0f2929a4f6: https://github.com/databricks/databricks-agent-skills/tree/e3df77b3f0eb5d70392eb35c6761ca0f2929a4f6/plugins/databricks/claude/skills/databricks-lakeflow-connect 1. Download that folder at exactly this commit. Do not use the default branch. 2. Copy every file unchanged, keeping the folder structure, into .claude/skills/databricks-lakeflow-connect/ for Claude Code and .agents/skills/databricks-lakeflow-connect/ for Codex, Cursor, Gemini CLI, GitHub Copilot and OpenCode. Create the folders if they do not exist. 3. Do not edit the files, and do not run any script in the folder unless I ask you to. 4. When you are done, list the files you copied and where you put them. Its license is restricted or not stated. Show me the license terms from the repository before you copy anything. Listing and checks: https://www.agentnative.dev/skills/databricks/databricks-lakeflow-connect
SKILL.md at the pin
The license of this skill does not let us show its files here.
Files
- SKILL.md15 KB · 1a04fd7a6263
- agents/
- openai.yaml389 B · a75c6eb464a9
- assets/
- databricks.png15 KB · 06873c31ebda
- databricks.svg582 B · 00e528e4d5e6
- references/
- 1-saas-connectors.md7.9 KB · ec39b97b26a9
- 2-database-connectors.md7.9 KB · 043c7b510640
- 4-ingestion-decision-tree.md7.6 KB · a9b7d23d3f74
- 5-troubleshooting-and-monitoring.md4.3 KB · ae6d2b522e74
8 files, 59 KB in total. Each file has a sha256 in the pin's manifest; the first 12 characters are shown.
Skill folder on GitHub at e3df77bAlso in
The same SKILL.md content appears in these places too. We list it once and credit the oldest public source.
- databricks/databricks-agent-skills/plugins/databricks/codex/skills/databricks-lakeflow-connect
- databricks/databricks-agent-skills/plugins/databricks/copilot/skills/databricks-lakeflow-connect
- databricks/databricks-agent-skills/plugins/databricks/cursor/skills/databricks-lakeflow-connect
- databricks/databricks-agent-skills/skills/databricks-lakeflow-connect
More from Databricks
databricks-agent-bricks
This skill enables agents to create and manage Knowledge Assistants for document question-answering via RAG on Volumes, and Supervisor Agents that orchestrate…
Claude Code, Codex, Cursor +3 · about 1.7K tokens · pinned 7 days ago
databricks-ai-functions
This skill provides built-in Databricks AI Functions that add AI capabilities directly to SQL and PySpark pipelines, including classification, extraction…
Claude Code, Codex, Cursor +3 · about 3.8K tokens · pinned 7 days ago
databricks-ai-runtime
This skill enables agents to submit and manage GPU training workloads on Databricks serverless compute using the `databricks air` CLI.
Claude Code, Codex, Cursor +4 · about 2.9K tokens · pinned 7 days ago
databricks-aibi-dashboards
Creates Databricks AI/BI dashboards using JSON specifications with support for multiple visualization types.
Claude Code, Codex, Cursor +3 · about 9.5K tokens · pinned 7 days ago
databricks-app-design
This skill helps design the user experience of custom-code Databricks Apps built with AppKit and React that display data.
Claude Code, Codex, Cursor +3 · about 1.6K tokens · pinned 7 days ago
databricks-apps
Build custom interactive data apps on Databricks using AppKit (TypeScript/React framework) or other frameworks like Streamlit or FastAPI.
Claude Code, Codex, Cursor +3 · about 5.5K tokens · pinned 7 days ago
Related in Data and databases
dsql
This skill enables agents to build and manage Aurora DSQL, a serverless PostgreSQL-compatible distributed SQL database.
by Amazon (AWS)Official publisher
Contains scripts
Claude Code, Codex, Cursor +3 · about 6.5K tokens · pinned 7 days ago
chdb-datastore
This skill enables working with tabular data using a pandas-compatible API backed by ClickHouse for faster execution.
by ClickHouseOfficial publisher
Contains scripts
Claude Code, Codex, Cursor +3 · about 1.2K tokens · pinned 7 days ago
chdb-sql
The skill enables running ClickHouse SQL queries on local files (parquet, csv, json), remote databases (Postgres, MySQL, MongoDB, ClickHouse Cloud), and cloud…
by ClickHouseOfficial publisher
Contains scripts
Claude Code, Codex, Cursor +3 · about 960 tokens · pinned 7 days ago
databricks-lakebase
This skill enables agents to manage Databricks Lakebase Postgres Autoscaling projects, including database creation, branching, compute scaling, and…
by DatabricksOfficial publisher
Claude Code, Codex, Cursor +3 · about 4.9K tokens · pinned 7 days ago
prisma-orm-setup
This skill sets up Prisma ORM in new applications, defaulting to version 8, or connects and troubleshoots existing Prisma 6, 7, or 8 applications.
by PrismaOfficial publisher
Claude Code, Codex, Cursor +4 · about 1.6K tokens · pinned 7 days ago
magic-data-loading
This skill loads data from files (CSV, TSV, Parquet, JSON, JSONL, Excel), databases (SQLite, PostgreSQL, MySQL), and HuggingFace datasets.
by Votee-AICommunity
Contains scripts
Claude Code, Codex, Cursor +3 · about 5.3K tokens · pinned 7 days ago
Open roles at Databricks
5 of 132 open roles on the jobs board
- Sr. Forward Deployed Engineer
Tokyo, Japan
- Senior Software Engineer - Backend
San Francisco, California, USA
- Software Engineer - Backend
Aarhus, Denmark
- Senior Production Engineer - Realtime Products
Mountain View, California, USA
- Sr. Forward Deployed Engineer (FDE) - Retail
Austin, Texas, USA