AI Software Engineer (Platform Software)
About the Job• FuriosaAI is looking for passionate AI Software Engineers to join our Platform Team. You will participate in the research and development of models optimized for our NPU accelerator. • Our team builds the production-grade, streamlined AI software that makes up our SDK. This includes the runtime, LLM serving framework, and PyTorch models/extensions. • Your work on these critical parts of the SDK will directly enable AI developers to efficiently deploy optimized AI models on FuriosaAI NPUs.Responsibilities• Develop and optimize DNN model implementations in PyTorch for FuriosaAI's Tensor Contraction Processor (TCP) architecture• Analyze the features, implementations, CUDA and Triton kernels of existing AI model inference frameworks such as vLLM, TensorRT-LLM, and DeepSpeed-MII• Research and implement generative AI models, parallelism strategies, and inference techniques to improve performance and efficiency• Collaborate closely with the compiler team to optimize and enable models.Minimum Qualifications• BS degree in Computer Science, Engineering, or a related field, or equivalent industry experience• Proficiency in Python programming skill• Experience in developing AI models in DNN frameworks (e.g., PyTorch)• Solid understanding of machine learning, deep learning, natural language processing (NLP), and/or generative AI models• Strong communication skills with the ability to collaborate effectively across cross-functional teamsPreferred Qualifications• Hands-on experience with PyTorch 2.0 technologies (e.g., TorchDynamo) or DNN compiler technologies, such as Triton and MLIR• Proficiency in C++/CUDA or Rust programming skills• Hands-on experience deploying and optimizing large-scale ML models in production• Hands-on experience in model training and fine-turning of pre-trained models• Experience in LLM inference frameworks: vLLM, TensorRT-LLM, and DeepSpeed-MII• Strong background in model quantizations and model evaluations• Strong background in machine learning, generative AI, and model evaluation techniques• Proven track record of contributing to open-source projectsContact• [email protected] Apply tot his job