Skip to main content

Apache Ozone

Starting from version 4.0.4, Doris supports accessing Apache Ozone through the S3 Gateway.

This document describes the parameters required to access Apache Ozone. These parameters apply to:

  • Catalog properties
  • Table Valued Function properties
  • Broker Load properties
  • Export properties
  • Outfile properties

To use Ozone as a dedicated storage type, configure "fs.ozone.support" = "true" explicitly.

Parameter Overview

Property NameLegacy NameDescriptionDefault ValueRequired
ozone.endpoints3.endpointOzone S3 Gateway endpoint, for example http://ozone-s3g:9878NoneYes
ozone.regions3.regionRegion of Ozone S3 Gatewayus-east-1No
ozone.access_keys3.access_key, s3.access-key-idAccess key used for authenticationNoneNo*
ozone.secret_keys3.secret_key, s3.secret-access-keySecret key used for authenticationNoneNo*
ozone.session_tokens3.session_token, s3.session-tokenSession tokenNoneNo
ozone.connection.maximums3.connection.maximumMaximum number of connections100No
ozone.connection.request.timeouts3.connection.request.timeoutRequest timeout in milliseconds10000No
ozone.connection.timeouts3.connection.timeoutConnection timeout in milliseconds10000No
ozone.use_path_styleuse_path_style, s3.path-style-accessWhether to use path-style accesstrueNo
ozone.force_parsing_by_standard_uriforce_parsing_by_standard_uriWhether to force standard URI parsingfalseNo
fs.ozone.supportWhether to enable Ozone as storage typefalseYes

Notes:

  • ozone.access_key and ozone.secret_key must be configured together.
  • fs.s3a.* keys are not parsed directly by Ozone properties. Use ozone.* or compatible s3.* keys.
  • Ozone supports s3://, s3a://, and s3n:// URI schemas.
  • Setting ozone.endpoint (or s3.endpoint) alone does not enable Ozone. You must set fs.ozone.support=true.

Example Configuration

Using ozone.* keys:

"fs.ozone.support" = "true",
"ozone.endpoint" = "http://ozone-s3g:9878",
"ozone.access_key" = "hadoop",
"ozone.secret_key" = "hadoop",
"ozone.region" = "us-east-1",
"ozone.use_path_style" = "true"

Using compatible s3.* aliases:

"fs.ozone.support" = "true",
"s3.endpoint" = "http://ozone-s3g:9878",
"s3.access_key" = "hadoop",
"s3.secret_key" = "hadoop",
"s3.region" = "us-east-1",
"s3.path-style-access" = "true"