Skip to content
Back to talent search

Candidate profile

Senior Deep Learning Systems & AI Infrastructure Engineer

Flash AttentionAutogradAI InfrastructureLinuxPythonCUDApybind11C++CUDA KernelsAI InferenceDeep Learning SystemsSIMDGPU ProgrammingPyTorch

Description

I'm an engineer focused on deep learning systems and AI infrastructure. Over the past few years, I've been building NexusGrad, a deep learning framework written from scratch in modern C++ and CUDA to better understand how frameworks like PyTorch work internally. The project includes a custom tensor library (CPU/CUDA), reverse-mode automatic differentiation, an explicit computational graph runtime, CUDA kernels for tensor operations and attention, Flash Attention, ALiBi attention, Transformer components, AVX2/OpenMP CPU kernels, pybind11 Python bindings, and numerical verification against PyTorch using finite-difference gradient checking. I'm interested in roles involving AI model optimization, LLM inference, deep learning runtimes, AI infrastructure, CUDA development, GPU software, distributed training/inference systems, and performance engineering. GitHub: https://github.com/Plkmoi/NexusGrad