analytics-catalog-server/me.ahoo.wow.analytics.catalog.server/AnalyticsCatalogProperties

AnalyticsCatalogProperties

@ConfigurationProperties(prefix = "wow.analytics.catalog")

class AnalyticsCatalogProperties(var connection: String = DEFAULT_CONNECTION, var databases: MutableList<String> = mutableListOf(), var trustedWriters: MutableMap<String, MutableList<String>> = linkedMapOf(), var refreshInterval: Duration = DEFAULT_REFRESH_INTERVAL, var watch: AnalyticsCatalogProperties.Watch = Watch(), var datasets: AnalyticsCatalogProperties.Datasets = Datasets(), var requireSourceApproval: Boolean = false, var requirePublicationApproval: Boolean = false)

The analytics catalog service's settings, wow.analytics.catalog.*: the warehouse whose tables and views are the sources, the accounts trusted to describe them, how the catalog watches them, and its datasets.

Constructors

constructor(connection: String = DEFAULT_CONNECTION, databases: MutableList<String> = mutableListOf(), trustedWriters: MutableMap<String, MutableList<String>> = linkedMapOf(), refreshInterval: Duration = DEFAULT_REFRESH_INTERVAL, watch: AnalyticsCatalogProperties.Watch = Watch(), datasets: AnalyticsCatalogProperties.Datasets = Datasets(), requireSourceApproval: Boolean = false, requirePublicationApproval: Boolean = false)

Types

Companion

object Companion

Datasets

class Datasets(var database: String = DatasetCompiler.DEFAULT_DATABASE, var retention: Duration = Duration.ofDays(DEFAULT_RETENTION_DAYS), var serving: AnalyticsCatalogProperties.Serving = Serving(), var refreshInterval: Duration = Duration.ofSeconds(DEFAULT_REFRESH_SECONDS), var reconcileInterval: Duration = Duration.ofMinutes(DEFAULT_RECONCILE_MINUTES))

The datasets' settings, wow.analytics.catalog.datasets.*.

Serving

class Serving(var enabled: Boolean = true)

Whether a node serves the published datasets' queries, wow.analytics.catalog.datasets.serving.*.

Watch

class Watch(var enabled: Boolean = true)

How the catalog watches the warehouse, wow.analytics.catalog.watch.*.

Properties

connection

var connection: String

The name of the warehouse connection, the first part of each source's id.

databases

var databases: MutableList<String>

The databases whose tables and views are sources; wow.clickhouse.database when empty.

datasets

var datasets: AnalyticsCatalogProperties.Datasets

The datasets: where their views are created, how long a retired one is kept, and whether this node serves them.

refreshInterval

var refreshInterval: Duration

How often the catalog compares system.tables and wow_catalog with what it saw last and brings each changed table's source up to date.

requirePublicationApproval

var requirePublicationApproval: Boolean

Whether every publication takes an approver (ApproveDatasetPublication); a publication that computes from sensitive values or lowers a protection takes one either way.

requireSourceApproval

var requireSourceApproval: Boolean

Whether a dataset reads only the sources an approver approved (ApproveSource).

trustedWriters

var trustedWriters: MutableMap<String, MutableList<String>>

By warehouse account, the contexts whose tables the wow_catalog rows of that account are trusted to describe: the account each context's Sink inserts as. Nobody is trusted by default.

watch

var watch: AnalyticsCatalogProperties.Watch

How the catalog watches the warehouse for changed tables.