Changement by mlx_lm 0.0.10 update lead to an error using the load, generate call
#1
by BenBenser - opened
Hello,
I recently ran into a typeError (raise TypeError(f'non-default argument {f.name!r} ' TypeError: non-default argument 'model_type' follows default argument
) after updating the package.
Since im pretty new to all this im not really sure if this error is caused by myself, but apparently it seems like the changed file "mixtral.py" in mlx_lm/models and its dataclass-decorated class "ModelArgs(BaseModelArgs):" ist causing the error by the misplaced attribute "model_type: str". After I positioned it before the optional attributes, it worked again.
@BenBenser Good catch. Created PR here in the repository: https://github.com/ml-explore/mlx-examples/pull/450.
Thanks! And thanks for creating PR repo, wasn't sure if I should create one.