Skip to content

Uploader

The Conductor Upload tool allows you to upload files to Conductor. It provides multiple options for customization and flexibility.

Usage

To use the Conductor Upload tool, you need to run the following command:

conductor upload [OPTIONS] [PATHS]...

By default, without any arguments, the uploader runs in daemon mode. In this mode, it continuously watches for files to upload for submitted jobs. If you want to manually specify a list of paths to upload, you can provide them as arguments after the command.

For example, to upload multiple files named file1, file2, and file3, you can run:

conductor upload file1 file2 file3

Options

The Conductor Upload tool provides several options to customize its behavior. Here are the available options:

Option
Type
Default
-db, --database_filepath
TEXT

This option allows you to specify a filepath to the local md5 caching database. The md5 caching feature improves uploading times by skipping md5 generation for previously uploaded files that haven't been modified since the last upload.

-md5, --md5_caching
BOOLEAN

When set to true (default), the tool uses cached md5s to skip md5 checking for subsequent uploads of the same files. This dramatically improves uploading times. However, if there is concern that files may not be getting re-uploaded properly, you can set this flag to false.

-lv, --log_level
ENUM

This option allows you to set the logging level to display. You can choose from the following levels: CRITICAL, ERROR, WARNING, INFO, DEBUG, NOTSET. By default, the log level is set to INFO.

Options are: CRITICAL, ERROR, WARNING, INFO, DEBUG, NOTSET

-ld, --log_dir
TEXT

If you want to write a log file, you can specify the directory using this option. The log file rotates, creating a new log file every day and storing logs for the last 7 days. The log file is named conductor_ul.log.

-tc, --thread_count
INTEGER

This option sets the number of threads that should download simultaneously. Increasing the thread count may improve upload performance, but it can also consume more system resources.

-lc, --location
TEXT

If you want to associate uploads, downloads, and submissions with a specific location tag, you can use this option. A location tag allows you to limit the scope of your uploads and downloads to jobs sharing the same location tag. This is particularly useful when using the uploader or downloader in daemon mode.

--help

Print help.

Conclusion

The Conductor Upload tool provides a convenient way to upload files to Conductor. With its options and flexibility you can customize its behavior to suit your needs.