Cohere Machine Learning Engineer Interview Experience
Cohere · Staff
Interview process
The system design interview was data collection, SFT and RL stages. It went well for me. It was focused on LLM post training techniques.
The ML coding was worst for me although I practiced the same question but using PyTorch and doing without PyTorch and without any documentation was challenging for me.
Interview rounds · 3
- 1
Recruiter screen
- 2
Technical round
CodingSystem DesignTechnical- Q1. Decode tokens from LLM using top K sampling without using PyTorch
- Q2. Design knowledge distillation of models. Design LLM post training pipeline.
- 3
Take-home assignment
Coding- Q1. Present a paper from a list provided by them
Tips from the candidate
Brush up numpy knowledge. Every round would be on LLM or related to it. They focus heavily on LLM. The paper presentation is unique in the process for this type of role. Talk to different PhD candidates on how to present a paper well.
Company culture
I liked that the team was focused on post training. You need to work with the frontier model team which is cool and has lot of scope for learning. The remote culture attracted me.