Frameworks
``MLXOptimizers``
MLXOptimizers Built in optimizers. MLX has a number of built in optimizers that are useful for training models. Here is a simple training loop: Other MLX Packages MLX MLXNN Python mlx Topics Optimizers AdaDelta Adafactor AdaGrad AdamW Adam
MLXOptimizers
Built-in optimizers.
MLX has a number of built in optimizers that are useful for training models. Here is a simple training loop:
func loss(model: Model, x: MLXArray, y: MLXArray) -> MLXArray {
// choose the loss function
mseLoss(predictions: model(x), targets: y, reduction: .mean)
}
// function to compute the value (loss) and gradient
let lg = valueAndGrad(model: model, loss)
let optimizer = SGD(learningRate: 1e-1)
for _ in 0 ..< epochs {
let (x, y) = ...
// evaluate the training data
let (loss, grads) = lg(model, x, y)
// use the optimizer to update the model parameters
optimizer.update(model: model, gradients: grads)
eval(model, optimizer)
}
Other MLX Packages
MLX
MLXNN
Topics
Optimizers
AdaDeltaAdafactorAdaGradAdamWAdamAdamaxLionRMSpropSGD
Base Classes and Protocols
OptimizerOptimizerBaseOptimizerBaseArrayState