Simple example of FastAPI + Celery + Triton for benchmarking
You can see the previous work from: with Triton Server without Triton Server Benchmark Results See Benchmark Results Preparation 1. Setup packages Install Anaconda and execute the following commands: $ make env # create a conda environment (need only once) $ source init.sh # activate the env $ make setup # setup packages (need only once) 2. Train a CNN model (Recommended on GPU) 3. Check the model repository
Read more