Quicky Prime
Type de contrat : Stage
Overview: Build a cost‑optimized LLM platform around an LLM gateway with model routing, semantic caching and usage/cost tracking to generate summaries, action items, sentiment and quality scores from conversations. Objectives:
• Self‑host and benchmark open‑source models
• Implement routing, caching and cost tracking
• Build the conversation analysis pipeline
Key features:
• LLM gateway with model routing by task and cost
• Semantic cache to reuse similar answers
• Per‑request cost and usage tracking
• Conversation summaries and action items
• Sentiment analysis and quality scoring
Tech stack: vLLM/Ollama, Qdrant, Redis, FastAPI Required application documents: Attach your CV (PDF). Optionally include a short cover letter, your GitHub/portfolio link and your university internship agreement. Selection process: 1) Email with correct project code 2) Profile review 3) Technical interview 4) Final answer.
Source : Hi Talents (hi-talents.com)
Talnivo calcule votre score de compatibilité CV ↔ offre et vous aide à l'améliorer avant de postuler.
Créer un compte gratuitVoir toutes les offres sur Talnivo