GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models
Dependencies This code is written using PyTorch and HuggingFace’s Transformer repo. Running GrIPS with GPT-2 models requires access to GPUs. The search is quite light-weight (no model training involved) and therefore one GPU should suffice. On the other hand, running GrIPS with InstructGPT or GPT-3 models requires an OpenAI API key. Please add your key to the openai_key.txt file. Installation The simplest way to run our code is to start with a fresh environment. conda create -n GrIPS python=3.9 source […]
Read more