Hey Maxime,
it would be awesome to have some MLX examples for Apple silicon, with MLX-LM, MLX-VLM, and MLX-LM-LoRA. MLX-LM-LoRA is build like unsloth and you can find example notebooks for orpo, dpo, grpo, etc. if you need help feel free to hmu!
cheers,
Gökdeniz