Senior Llm Researcher/Engineer

Our client is looking for a LLM Researcher/Engineer to fine-tune and train our own LLM models.




-Train and Fine-tune foundational LLM models (e.g. PEFT, Lora, QLora, latest research techniques)


-Build and maintain LLM applications and infrastructure to meet business needs


-Design LLM inference infrastructure to scalably deploy LLMs within infrastructural constraints


-Research and utilize best of class tools within LLM ecosystem (e.g. Vector databases, LlamaIndex, etc)


-Keep up with latest research around LLMs (e.g. sparse models, hardware-specific LLMs)


-Research and keep up with latest use-cases of LLMs (e.g. RAG, Agents, etc)


-Collaborate closely with LLM research teams to participate in foundation model research, specifically for training productivity-related LLMs.



(Apply now at https://my.hiredly.com/jobs/jobs-malaysia-hiredly-x-job-senior-llm-researcher-engineer)
; Requirements:-


-Experience with LLMs, including popular foundation models like Llama2, MPT


-Experience with Training and Fine-tuning foundational LLM models


-Experience with quantization techniques, including llama.cpp, GPTQ, etc


-Experience with LLM related development, e.g. Llamaindex, Langchain, Vector DBs, Prompt Engineering etc


-(Plus but not required) Experience running LLMs in production (e.g. Triton Inference Server, etc)