Qubit Docs العربية

Dremio

Connect Dremio through its Arrow Flight port. Qubit copies the datasets in one source or space on a schedule.

Before you start

  • Create a Dremio user for Qubit that can read the datasets you want to use. It can sign in with a password or a personal access token.
  • Make sure the Arrow Flight port (32010 by default) accepts connections from Qubit's servers.
  • Find the schema name as it appears in Dremio's INFORMATION_SCHEMA, for example mysource or mysource.folder.

Connect Dremio

  1. Open Data Catalog from the sidebar, click Add Data, then choose Connect a database.
  2. On the New Data Source page, click Dremio. It is under Databases.
  3. Enter a Connection Name.
  4. Fill in the connection details:
    • Hostname: the Dremio host.
    • Arrow Flight port: defaults to 32010.
    • Username: the Dremio user.
    • Password or Personal access token: fill in one of the two.
    • Schema: the source or space to read, as described above.
    • Underlying source type: optional. If the schema is backed by PostgreSQL, MySQL, or SQL Server, choose it so Qubit detects column types more accurately.
    • Use TLS: turn on if your Flight endpoint uses TLS.
  5. Choose a Sync Schedule. The default is Daily.
  6. Click Create.

After you connect

Qubit checks that the required fields are filled in, including a password or a token, saves the connection, and starts the first sync. It confirms that it can reach Dremio during that sync.

To check the connection at any time, open its menu in the Data Catalog and choose Test connection. If Last sync shows Failed, hover over it to see the reason, correct the details with Edit, then choose Sync now.