mlx-community/Apertus-8B-Instruct-2509-8bit doesn't work on Google Colaboratory
From the code:
! pip install --upgrade mlx-lm &>/dev/null
from mlx_lm import load, generate
I have the following error:
"""
ImportError Traceback (most recent call last)
/tmp/ipython-input-173744910.py in <cell line: 0>()
----> 1 from mlx_lm import load, generate
2
1 frames
/usr/local/lib/python3.12/dist-packages/mlx_lm/convert.py in
5 from typing import Callable, Optional, Union
6
----> 7 import mlx.core as mx
8 import mlx.nn as nn
9 from mlx.utils import tree_map_with_path
ImportError: libmlx.so: cannot open shared object file: No such file or directory
NOTE: If your import is failing due to a missing package, you can
manually install dependencies using either !pip or !apt.
To view examples of installing some common dependencies, click the
"Open Examples" button below.
"""
Isn't MLX only for Apple Silicon? Meaning it won't run on any hardware other than apple silicon.
Ah ok, I didn't know that MLX works only for Apple. Thank you