SentenceTransformerModel.set_up_accelerate_config

opensearch_py_ml.ml_models.SentenceTransformerModel.set_up_accelerate_config(self, compute_environment: str | None = None, num_machines: int = 1, num_processes: int | None = None, verbose: bool = False) → None

Get default config setting based on the number of GPU on the machine if users require other configs, users can run !acclerate config for more options

Parameters:

  • compute_environment (string) – optional, compute environment type to run model, if None, default using ‘LOCAL_MACHINE’

  • num_machines (int) – optional, number of machine to run model , if None, default using 1

  • num_processes (int) – optional, number of processes to run model, if None, default to check how many gpus are available and use all. if no gpu is available, use cpu

  • verbose (bool) – optional, use printing more logs. Default as false

Returns:

no return value expected

Return type:

None