Working Student - LLM Quantization & Inference Performance

Job Summary

Tensordyne is seeking a motivated working student to dive into quantization research for large language models. The role involves evaluating how low‑precision computation affects performance on coding and reasoning benchmarks, implementing post‑training quantization methods, and building reproducible tooling for automated evaluations. The student will collaborate closely with quantization, compiler, and runtime engineers, and directly influence model optimization for Tensordyne’s custom silicon. Key responsibilities include measuring runtime latency, throughput, and memory usage across different deployment scenarios, and experimenting with 16‑bit, 8‑bit, and 4‑bit quantization configurations on models such as Qwen or LLaMA. The position requires strong Python and PyTorch skills, an experimental mindset, and the ability to communicate findings to engineering teams.

Key Responsibilities

• Tensordyne is seeking a motivated working student to dive into quantization research for large language models. The role involves evaluating how low‑precision computation affects performance on coding and reasoning benchmarks, implementing post‑training quantization methods, and building reproducible tooling for automated evaluations. The student will collaborate closely with quantization, compiler, and runtime engineers, and directly influence model optimization for Tensordyne’s custom silicon. Key responsibilities include measuring runtime latency, throughput, and memory usage across different deployment scenarios, and experimenting with 16‑bit, 8‑bit, and 4‑bit quantization configurations on models such as Qwen or LLaMA. The position requires strong Python and PyTorch skills, an experimental mindset, and the ability to communicate findings to engineering teams.

About the Role

This role is ideal for someone who enjoys combining strategy, content, data and execution. You will work with cross-functional teams and contribute directly to the company’s digital growth in Kolkata and surrounding areas.

Job Requirements

• Python
• PyTorch
• Quantization
• LLM evaluation

Required Skills