someone's avatar
someone 11 months ago
Download all the notes. Take the "content" field from the notes and change the name to "text": Previously: {"id":".....................", "pubkey": ".................", "content": "gm, pv, bitcoin fixes this!", .......} {"id":".....................", "pubkey": ".................", "content": "second note", .......} Converted into jsonl file: {"text": "gm, pv, bitcoin fixes this!" } {"text": "second note" } Used Unsloth and ms-swift to train. Unsloth needed to convert from base to instruct. This is a little advanced. If you don't want to do that and just start with instruct model, you can use ms-swift or llama-factory. You will do lora, pretraining. I used 32 as lora rank but you can choose another number.

Replies (1)