
Rafael Celente
Aerospace engineer and ML researcher focused on foundation models
Network
763 connectionsSummary
Work
Education
Projects
Writing
How Nubank Uses Transformers to Model Financial Habits at Scale
April 1, 2026Company post describing nuFormer, a transformer-based foundation model for financial transaction sequences, and how the research (including work by Rafael Celente) is applied to production use cases like credit and recommendation.
Effective Quantization of Muon Optimizer States
September 1, 2025Academic paper introducing an 8-bit (blockwise) quantized variant of the Muon optimizer, demonstrating memory savings and empirical/theoretical analysis of quantization robustness for large-model pretraining.
Muon for Improved Foundation Model Pretraining Data Efficiency
September 1, 2025Nubank engineering blog post describing experiments using the Muon optimizer to improve data and compute efficiency when pretraining transaction-based foundation models; shows faster convergence vs AdamW.
Medium posts and personal writing
Personal blog posts on Medium about aerospace engineering, data and machine learning, entrepreneurship, and space/rockets.