MLX Make More
WIP. Make More with MLX!
makemore takes one text file as input, and predicts more for you. With a wide range of model selections, such as:
- Bigram
- Bigram Neural Network
- Multi-layer Perceptron (MLP)
- Convolution Nerual Network (CNN)
- Recurrent Neural Network (RNN)
- Long Short-Term Memory (LSTM)
- Gated Recurrent Unit (GRU)
- Transform
This project also implemented many functions and modules commonly used in deep learning. Some are out of necessity (e.g. oneHot()
and multinomial
) as they are missing from MLX. And some are to learn understand how ML frameworks work.
oneHot
searchSorted
multinomial
plot
CustomLinear
BatchNorm1d
CustomTanh
Plots
Bigram Frequencies
MLP Word Embedddings (C) Principal Components (1&2)
MLP Learning Rates
MLP Losses (log10)
Build Run in CLI
To run in command line, go to the package directory.
Then chmod
the helper script:
chmod +x mlx-run.sh
Then:
./mlx-run.sh --package mlx-makemore
Troubleshoot
Try build and run project following CLI instruction.
Alternatively run xcodebuild build -scheme mlx-makemore -destination 'platform=OS X' -derivedDataPath ./.derivedData
Reference
See original python repo by one and only Andrej