Skip to content

Latest commit

 

History

History
111 lines (80 loc) · 4.29 KB

rewriter-tutorial.md

File metadata and controls

111 lines (80 loc) · 4.29 KB

Alright, cool cats and kittens! Grab your keyboards and fire up your terminals, 'cause we're about to embark on a groovy journey into the world of AI-powered writing style mimicry. Today, we're gonna learn how to use our paragraph rewriter to train a model that can match any writing style faster than you can say "beatnik Shakespeare." Let's dive in!

How to Train Your AI: The Art of Style Mimicry

Ever wished you could write like Hemingway, but your prose comes out more "Ham-away"? Fear not, for we're about to turn your AI into a literary chameleon. Here's how to use our paragraph rewriter to train a model that'll make your favorite authors say, "Did I write that?"

Step 1: Gather Your Ingredients

First things first, you'll need:

  • A folder full of text files in the style you want to mimic (let's call it "data/hemingway_texts/")
  • Our ModelTrainSet project (if you don't have it, clone it faster than Hemingway downs a mojito)
  • A computer (duh)
  • A burning desire to revolutionize the written word

Step 2: Cook Up Your Config

Whip up a config file faster than you can say "The Old Man and the C++ Sea". Create a file named hemingway_style_config.yaml in your config/ folder:

creator_type: ParagraphRewriteCreator
input_directory: ./data/hemingway_texts
output_file: ./datasets/hemingway_style_dataset.json
min_paragraph_length: 100
max_paragraphs_per_file: 50
formatter_type: conversation
style: paraphrasing

This config is telling our system, "Hey, grab those Hemingway texts, chop 'em up, and serve 'em on a silver platter for our AI to devour."

Step 3: Let the Rewriting Begin

Now, fire up your terminal and run:

python main.py --mode dataset --config config/hemingway_style_config.yaml

Sit back and watch as your computer turns into a literary food processor, chopping up Hemingway's prose and rewriting it faster than you can say "For Whom the Bell Tolls."

Step 4: Train Your Model Like It's Rocky

Now that you've got your dataset, it's time to train your model. Create another config file, train_hemingway_config.yaml:

model_name: mistralai/Mistral-7B-Instruct-v0.2
max_seq_length: 2048
load_in_4bit: true
r: 16
target_modules: 
  - q_proj
  - k_proj
  - v_proj
  - o_proj
  - gate_proj
  - up_proj
  - down_proj
lora_alpha: 16
lora_dropout: 0.05
bias: none
use_gradient_checkpointing: true
per_device_train_batch_size: 4
gradient_accumulation_steps: 4
warmup_steps: 100
num_train_epochs: 3
learning_rate: 2.0e-4
logging_steps: 25
weight_decay: 0.01
dataset_num_proc: 4
packing: true
output_dir: ./outputs/hemingway_model
push_to_hub: false
dataset_file: ./datasets/hemingway_style_dataset.json

This config is like a training montage for your AI. It's gonna make it run up stairs, punch meat, and write short, punchy sentences.

Now, let's get this show on the road:

python main.py --mode train --config config/train_hemingway_config.yaml

Grab a coffee (or a mojito, in honor of Papa Hemingway) while your model trains. It's learning to write like the master faster than you can finish "The Sun Also Rises."

Step 5: Test Your Literary Doppelganger

Once your model's trained, it's showtime! Fire up your favorite LLM interface (we're partial to Ollama around here), and give it a whirl:

User: Write a short paragraph about fishing, in the style we just learned.

AI: The old man stood on the beach. The sea was calm. The sun, rising. He gripped his rod, felt its weight. The line taut. A fish stirred below. The old man waited. Patience. Always patience. The fish would come. Or it wouldn't. That was fishing. That was life.

Hot damn! If that doesn't sound like Hemingway, I'll eat my typewriter!

Wrap It Up, Champ

And there you have it, folks! You've just turned your AI into a literary shapeshifter. With this power, you can:

  • Generate content in any author's style
  • Create writing exercises for students
  • Finally finish that novel you've been putting off (no judgment)

Remember, with great power comes great responsibility. Use your newfound abilities wisely. Don't go writing fake Hemingway novels or anything. Unless... no, nevermind. Just be cool, alright?

Now go forth and write! And remember, in the words of definitely-not-AI Hemingway: "Write drunk, edit sober, and always blame the computer if it doesn't sound right."

Happy styling, you crazy cats!