d-Matrix is hiring a Software Engineering Intern for its Kernels team. You will play a key role in developing the high-performance kernels essential for accelerating Machine Learning models. Your work will directly impact the performance of models like LLMs and CNNs.
What You'll Do
- Implement high-performance kernels in low-level languages; Assembly or ISA coding experience is advantageous.
- Develop, test, and tune kernels for machine learning models.
- Create and automate reference implementations and unit tests for accuracy verification.
- Analyze scalability and performance, collect metrics, and troubleshoot bottlenecks.
- Package and share final implementations with partner teams.
What We're Looking For
- Ability to implement high-performance kernels in low-level languages.
- Proficiency in Python and/or C++.
- Solid background in Machine Learning model architecture, such as LLMs or CNNs.
- Experience with ML frameworks like PyTorch and packages like Numpy.
- General understanding of computer architecture, including CPU, GPU, and custom ASICs.
- Current enrollment in a graduate program (Master's or Ph.D) in a relevant discipline.
Nice to Have
- Previous internship or project experience in high-performance computing or ML kernel development.
- Familiarity with additional ML frameworks like TensorFlow.
- Interest in hardware-software co-design.
Technical Stack
- Languages: Python, C++, Assembly/ISA
- ML Frameworks: PyTorch, TensorFlow
- Tools: Numpy
Team & Environment
You will join the Kernels team at d-Matrix. Our culture is built on respect, collaboration, humility, and direct communication. We are an inclusive team where differing perspectives lead to better solutions, and we seek individuals passionate about tackling challenges and driven by execution.
Work Mode
This role is based in Toronto, Canada, and follows a local work model.
d-Matrix is proud to be an equal opportunity workplace and affirmative action employer, committed to fostering an inclusive environment regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status.
