cortex run

The lazy dev's way to run models. Does three things:

1. cortex pull: Grabs the model if you don't have it
2. cortex engines install: Sets up engines if missing
3. cortex models start: Fires up the model

Usage

info

Need the gory details? Use --verbose flag like this: cortex --verbose [subcommand]

MacOs/Linux

cortex run [options] <model_id>

Windows

cortex.exe run [options] <model_id>

Options

Option	Description	Required	Default value	Example
model_id	The identifier of the model you want to chat with.	Yes	-	mistral
--gpus	List of GPUs to use.	No	-	[0,1]
--ctx_len	Maximum context length for inference.	No	min(8192, max_model_context_length)	1024
-h, --help	Display help information for the command.	No	-	-h
-d, --detached	Load the model without starting an interactive chat	No	-	-d