Batch Job Settings

This page covers settings that manage access and behavior for the batch job process.

You can establish or modify settings by defining:

  • an environment variable on the host system prior to starting or restarting the AIStor Server. Refer to your operating system’s documentation for how to define an environment variable.
  • a configuration setting using mc admin config set.

If you define both an environment variable and the similar configuration setting, AIStor uses the environment variable value.

Some settings have only an environment variable or a configuration setting, but not both.

Each configuration setting controls fundamental AIStor behavior and functionality. Test configuration changes in a lower environment, such as DEV or QA, before applying to production.

Replication

The following configuration options define settings used for replication jobs.

Replication workers

Defines the maximum number of concurrent workers used to transfer data in batch replication per job. Defaults to half of CPU cores.

Value should be an integer.

Replication workers wait time

Defines the maximum sleep time a worker should wait before starting to work on the next object. Increase the duration to slow down batch replication operations.

By default, AIStor Server waits 30ms.

Value should be a time duration.

Expiration

The following configuration options define settings used for expiration jobs.

Expiration workers

Defines the maximum number of concurrent workers used to expire objects data in batch expiration job. Defaults to half of CPU cores.

Value should be an integer.

Expiration workers wait time

Defines the maximum sleep time a worker should wait before starting to work on the next object expiration. Increase the duration to slow down batch expiration operations.

By default, AIStor Server waits 30ms.

Value should be a time duration.

Key rotation

The following configuration options define settings used for key rotation jobs.

Key rotation workers

Defines the maximum number of concurrent workers used to rotate encryption keys in batch key rotation job. Defaults to half of CPU cores.

Value should be an integer.

Expiration workers wait time

Defines the maximum sleep time a worker should wait before starting to work on the next object’s key rotation. Increase the duration to slow down batch key rotation operations.

By default, AIStor Server waits 30ms.

Value should be a time duration.

All rights reserved 2024-Present, MinIO, Inc.