Members-Only
Recent Talks & Demos are for members only
You must be an AI Tinkerers active member to view these talks and demos.
Monarch-1: Africa LLM Fine-Tuning
Step‑by‑step walkthrough of adapting Mistral‑7B for African languages using LoRA, handling code‑switching, limited GPUs, and custom African benchmark, data cleaning techniques, and performance evaluation.
I’ll walk through how I took Mistral-7B-Instruct-v0.3 and adapted it into Monarch-1, an AI model specifically tuned for African languages, cultural nuances, and real-world applications. This session will be a deep dive into every step, managing limited GPU resources, handling code-switching in multilingual data, and implementing LoRA-based fine-tuning to keep computational costs low.
We’ll also explore the Monarch Benchmark, a custom suite of tests that capture cultural-linguistic nuances and real-world African contexts often missed by mainstream benchmarks. Along the way, I’ll discuss how recent AI developments like the Model Context Protocol (MCP), large context windows, and next-gen multimodal approaches (e.g., Google Gemini2.5 Pro) could extend Monarch-1’s capabilities.
Think of it as a code-centric “tell-all” on how to push large language models beyond generic datasets and into localized, ethically grounded AI, no slides, no pitches, just an unfiltered look at building Africa-centric LLMs from scratch.
Monarch-1: Mistral-based AI, LoRA-fine-tuned for African linguistic, cultural data.