Skip to content

docs: add DuckDB, Dremio, Spark support to OSS documentation#2136

Open
devin-ai-integration[bot] wants to merge 5 commits intodocsfrom
devin/ELE-5266-1772375633-docs
Open

docs: add DuckDB, Dremio, Spark support to OSS documentation#2136
devin-ai-integration[bot] wants to merge 5 commits intodocsfrom
devin/ELE-5266-1772375633-docs

Conversation

@devin-ai-integration
Copy link
Contributor

@devin-ai-integration devin-ai-integration bot commented Mar 1, 2026

Summary

Adds OSS documentation for DuckDB, Dremio, and Spark adapters, and fills in previously missing CLI snippet files for Athena and Trino.

Changes:

  • install-cli.mdx: Added pip install lines for duckdb, dremio, spark extras
  • all-profiles.mdx: Added connection profile templates for DuckDB, Dremio, Spark
  • adapters-cards.mdx: Added adapter cards with official brand SVG icons for DuckDB, Dremio, Spark
  • Created 5 new CLI snippet files (duckdb-cli.mdx, dremio-cli.mdx, spark-cli.mdx, athena-cli.mdx, trino-cli.mdx)
  • Created 4 new OSS integration pages (duckdb.mdx, spark.mdx, athena.mdx, trino.mdx)
  • The dremio-cli.mdx snippet fixes a broken import in the pre-existing docs/oss/integrations/dremio.mdx

Companion to code/CI PR: #2135

Mintlify Preview: https://elementary-devin-ele-5266-1772375633-docs.mintlify.app

Updates since last revision

  • Replaced placeholder SVG icons with official brand logos for DuckDB (duck mascot), Dremio (multi-color logo), and Apache Spark (flame logo)
  • Dremio CLI profile now shows both Dremio Cloud and Dremio Software connection options using <Tabs>, matching dbt's Dremio setup docs
  • Updated Dremio dbt docs link to the current URL

Review & Testing Checklist for Human

  • Verify SVG icons render correctly at 35×35 — Icons were converted from official SVGs to inline JSX. Check the Mintlify preview to confirm DuckDB, Dremio, and Spark icons display properly at the card size and are visually consistent with the existing adapter icons (Snowflake, BigQuery, etc.)
  • Dremio profile inconsistencydremio-cli.mdx now shows both Cloud and Software tabs, but all-profiles.mdx still only shows the Software profile format. Verify whether all-profiles.mdx should also be updated to show both options.
  • Verify pip install 'elementary-data[spark]' works — PR feat: add DuckDB, Trino, Dremio & Spark support to CI and CLI #2135 (pyproject.toml) only added duckdb and dremio as new extras groups. Confirm that a spark extra already exists or needs to be added; otherwise the install-cli.mdx instruction is broken.
  • New integration pages may be unreachable — The 4 new OSS integration pages (athena.mdx, duckdb.mdx, spark.mdx, trino.mdx) are not referenced in docs.json navigation. Verify how existing warehouse pages (e.g. snowflake.mdx) are discovered by users and ensure the new ones are reachable the same way.
  • Profile template fields — Double-check that the Dremio Cloud profile fields (cloud_host, cloud_project_id, pat, etc.) and Spark template fields (method: thrift/http/odbc) match dbt-dremio and dbt-spark's actual connection parameters.

Suggested test plan: Open the Mintlify preview, navigate to the OSS adapters page, and confirm all three new adapter cards display with correct icons. Click through to each new integration page and verify the profile YAML examples render correctly (especially the Dremio Cloud/Software tabs).

Notes

  • All CLI snippets follow the existing pattern (generate profile with dbt run-operation elementary.generate_elementary_cli_profile, then show example YAML)
  • Dremio CLI snippet fixes a pre-existing broken import
  • Athena and Trino were already supported in Elementary Cloud docs, now adding OSS CLI instructions
  • The code-quality CI failure is from pre-commit hooks fixing typos in unrelated files (tresholdthreshold, seperatorseparator) — not caused by this PR's changes

Requested by: @haritamar
Link to Devin Session: https://app.devin.ai/sessions/6c12a19d456541568bcd7974623f3557


Open with Devin

- install-cli.mdx: add pip install lines for duckdb, dremio, spark
- all-profiles.mdx: add DuckDB, Dremio, Spark profile templates
- adapters-cards.mdx: add DuckDB, Dremio, Spark adapter cards
- CLI snippets: create duckdb-cli, dremio-cli, spark-cli, athena-cli, trino-cli
- OSS integration pages: create duckdb, spark, athena, trino pages

Co-Authored-By: Itamar Hartstein <haritamar@gmail.com>
@devin-ai-integration
Copy link
Contributor Author

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

  • Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
  • Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

  • Disable automatic comment and CI monitoring

@linear
Copy link

linear bot commented Mar 1, 2026

@coderabbitai
Copy link

coderabbitai bot commented Mar 1, 2026

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment
  • Commit unit tests in branch devin/ELE-5266-1772375633-docs

Comment @coderabbitai help to get the list of available commands and usage tips.

Copy link
Contributor Author

@devin-ai-integration devin-ai-integration bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no potential bugs to report.

View in Devin Review to see 3 additional findings.

Open in Devin Review

## Configure the database and schema of elementary models. ##
## Check where 'elementary_test_results' is to find it. ##

elementary:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we should show here either the cloud or the software option
https://docs.getdbt.com/docs/core/connect-data-platform/dremio-setup#profiles

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed — now shows both Dremio Cloud and Dremio Software profile options using tabs, with the correct fields for each (Cloud: cloud_host, cloud_project_id, pat; Software: software_host, port, password/pat). Also updated the dbt docs link to the current URL.

Co-Authored-By: Itamar Hartstein <haritamar@gmail.com>
## DREMIO ##
## By default, edr expects the profile name 'elementary'. ##
## Configure the database and schema of elementary models. ##
## Check where 'elementary_test_results' is to find it. ##
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we include here also cloud + software?
It should stay a single tab, but just have a section of cloud and below it software

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done — updated the Dremio section in all-profiles.mdx to show both Cloud and Software profiles within the same tab, using ## -- Dremio Cloud -- ## and ## -- Dremio Software -- ## section headers.

Co-Authored-By: Itamar Hartstein <haritamar@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant