Stable FP4 Training via Transposition-Invariant Block Quantization
Mehdi Rahimifar, Amin Darabi, Mehran Taghian Jazi, Xing Huang, Yao Wang, Zhijun Tu, Yufei Cui, Yunke Peng, Hongliang Li
ML Researcher & Engineer
ML researcher and engineer specializing in efficient large-scale training, GPU kernel development, and low-precision training.
Montreal, Canada

Dec 2024 – Present
Huawei Canada
Low-bit training (FP8 / FP4), model pruning, and test-time adaptation. GPU kernel development in Triton and CUDA. Pre-training large transformers in multi-node, multi-GPU distributed setups.
Sep 2023 – Present
Mila – Quebec AI Institute
Research on time-series and neuroimaging foundation models at the CERC-AAI Lab, supervised by Professor Irina Rish.
Mehdi Rahimifar, Amin Darabi, Mehran Taghian Jazi, Xing Huang, Yao Wang, Zhijun Tu, Yufei Cui, Yunke Peng, Hongliang Li
Mohammad Javad Darvishi Bayazi, Hena Ghonia, Roland Riachi, Bruno Aristimunha, Arian Khorasani, Md Rifat Arefin, Amin Darabi, Guillaume Dumas, Irina Rish
Amin Darabi, Sayeh Sobhani, Rosa Aghdam, Changiz Eslahchi