A Tutorial@IEEE CoG 2024

Prompt Engineering for Science Birds Level Generation and Beyond

Slide

The slide deck for the tutorial can be found here

Latest update: August 5, 2024 9:45AM (GMT+2)

Prerequisite

If you want to follow along with the tutorial, you will need a computer with sufficient performance. LLMs are downloaded as files and will be stored on your computer and later loaded into RAM, so you will need to have sufficient storage and memory for that purpose. In addition, while the program works with CPU-only computers, its performance is not optimal, i.e., slow processing speed. Therefore, we recommend a computer with a sufficiently powerful discrete GPU, NPU, or M-series chip.

Please download and install the following software before the tutorial if you want to follow along:

  1. Download LM Studio from LM Studio
    LM Studio download page
  2. Open the downloaded file and follow the installation instructions. Once installed, open LM Studio.
    LM Studio
  3. Download one of the following large language models from the "Search" page:Please note that you can use any model you like that suits your needs. We encourage you to experiment with different models.
    LM Studio search page
    LM Studio download complete
  4. Once the model is downloaded, navigate to the "Local Server" tab, select the model, and click "Start Server".
    LM Studio local server tab
    LM Studio loaded model
    LM Studio started server

(Optional) Additional Configurations

  1. You may want to configure the following settings for faster inference speed. However, please note that these settings are subject to compatibility with the computer's hardware.
    LM Studio Advanced Configuration
    LM Studio Advanced Configuration (details)

Starting Code

Starting code can be found at this GitHub repository.

Additional instruction on how to run the code can be found in theREADME.md file of the repository.