docs: add DuckDB, Dremio, Spark support to OSS documentation#2136
docs: add DuckDB, Dremio, Spark support to OSS documentation#2136devin-ai-integration[bot] wants to merge 5 commits intodocsfrom
Conversation
- install-cli.mdx: add pip install lines for duckdb, dremio, spark - all-profiles.mdx: add DuckDB, Dremio, Spark profile templates - adapters-cards.mdx: add DuckDB, Dremio, Spark adapter cards - CLI snippets: create duckdb-cli, dremio-cli, spark-cli, athena-cli, trino-cli - OSS integration pages: create duckdb, spark, athena, trino pages Co-Authored-By: Itamar Hartstein <haritamar@gmail.com>
🤖 Devin AI EngineerI'll be helping with this pull request! Here's what you should know: ✅ I will automatically:
Note: I can only respond to comments from users who have write access to this repository. ⚙️ Control Options:
|
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
…k brand logos Co-Authored-By: Itamar Hartstein <haritamar@gmail.com>
| ## Configure the database and schema of elementary models. ## | ||
| ## Check where 'elementary_test_results' is to find it. ## | ||
|
|
||
| elementary: |
There was a problem hiding this comment.
we should show here either the cloud or the software option
https://docs.getdbt.com/docs/core/connect-data-platform/dremio-setup#profiles
There was a problem hiding this comment.
Fixed — now shows both Dremio Cloud and Dremio Software profile options using tabs, with the correct fields for each (Cloud: cloud_host, cloud_project_id, pat; Software: software_host, port, password/pat). Also updated the dbt docs link to the current URL.
Co-Authored-By: Itamar Hartstein <haritamar@gmail.com>
| ## DREMIO ## | ||
| ## By default, edr expects the profile name 'elementary'. ## | ||
| ## Configure the database and schema of elementary models. ## | ||
| ## Check where 'elementary_test_results' is to find it. ## |
There was a problem hiding this comment.
Can we include here also cloud + software?
It should stay a single tab, but just have a section of cloud and below it software
There was a problem hiding this comment.
Done — updated the Dremio section in all-profiles.mdx to show both Cloud and Software profiles within the same tab, using ## -- Dremio Cloud -- ## and ## -- Dremio Software -- ## section headers.
Co-Authored-By: Itamar Hartstein <haritamar@gmail.com>
Summary
Adds OSS documentation for DuckDB, Dremio, and Spark adapters, and fills in previously missing CLI snippet files for Athena and Trino.
Changes:
install-cli.mdx: Addedpip installlines for duckdb, dremio, spark extrasall-profiles.mdx: Added connection profile templates for DuckDB, Dremio, Sparkadapters-cards.mdx: Added adapter cards with official brand SVG icons for DuckDB, Dremio, Sparkduckdb-cli.mdx,dremio-cli.mdx,spark-cli.mdx,athena-cli.mdx,trino-cli.mdx)duckdb.mdx,spark.mdx,athena.mdx,trino.mdx)dremio-cli.mdxsnippet fixes a broken import in the pre-existingdocs/oss/integrations/dremio.mdxCompanion to code/CI PR: #2135
Mintlify Preview: https://elementary-devin-ele-5266-1772375633-docs.mintlify.app
Updates since last revision
<Tabs>, matching dbt's Dremio setup docsReview & Testing Checklist for Human
dremio-cli.mdxnow shows both Cloud and Software tabs, butall-profiles.mdxstill only shows the Software profile format. Verify whetherall-profiles.mdxshould also be updated to show both options.pip install 'elementary-data[spark]'works — PR feat: add DuckDB, Trino, Dremio & Spark support to CI and CLI #2135 (pyproject.toml) only addedduckdbanddremioas new extras groups. Confirm that asparkextra already exists or needs to be added; otherwise the install-cli.mdx instruction is broken.athena.mdx,duckdb.mdx,spark.mdx,trino.mdx) are not referenced indocs.jsonnavigation. Verify how existing warehouse pages (e.g.snowflake.mdx) are discovered by users and ensure the new ones are reachable the same way.cloud_host,cloud_project_id,pat, etc.) and Spark template fields (method: thrift/http/odbc) match dbt-dremio and dbt-spark's actual connection parameters.Suggested test plan: Open the Mintlify preview, navigate to the OSS adapters page, and confirm all three new adapter cards display with correct icons. Click through to each new integration page and verify the profile YAML examples render correctly (especially the Dremio Cloud/Software tabs).
Notes
dbt run-operation elementary.generate_elementary_cli_profile, then show example YAML)treshold→threshold,seperator→separator) — not caused by this PR's changesRequested by: @haritamar
Link to Devin Session: https://app.devin.ai/sessions/6c12a19d456541568bcd7974623f3557