Skip to main content

Config

This class represents a common storage configuration. It allows for specifying different storage backends like S3, Minio, local, memory, Stow, or Redis, and includes configurations for connection details, container management, caching, and performance limits.

Attributes

AttributeTypeDescription
Type[Type](../../flyteplugins/go/tasks/pluginmachinery/secretmanager/type.md?sid=flyteplugins_go_tasks_pluginmachinery_secretmanager_type)Sets the type of storage [s3/minio/local/mem/stow/redis].
Connection[ConnectionConfig](connectionconfig.md?sid=flytestdlib_storage_connectionconfig)Please use StowConfig instead
Stow[StowConfig](stowconfig.md?sid=flytestdlib_storage_stowconfig)Storage config for stow backend.
Redis[RedisConfig](redisconfig.md?sid=flytestdlib_storage_redisconfig)Storage config for the redis backend.
InitContainerstringInitial container (in s3 a bucket) to create -if it doesn't exist-.'
MultiContainerEnabledboolIf this is true, then the container argument is overlooked and redundant. This config will automatically open new connections to new containers/buckets as they are encountered
Cache[CachingConfig](../../flyteplugins/go/tasks/pluginmachinery/webapi/cachingconfig.md?sid=flyteplugins_go_tasks_pluginmachinery_webapi_cachingconfig)Caching is recommended to improve the performance of underlying systems. It caches the metadata and resolving inputs is accelerated. The size of the cache is large so understand how to configure the cache.
Limits[LimitsConfig](limitsconfig.md?sid=flytestdlib_storage_limitsconfig)Sets limits for stores.
DefaultHTTPClient[HTTPClientConfig](httpclientconfig.md?sid=flytestdlib_storage_httpclientconfig)Sets the default http client config.
SignedURL[SignedURLConfig](signedurlconfig.md?sid=flytestdlib_storage_signedurlconfig)Sets config for SignedURL.