Implementing Multi-Modal RAG Systems
Large language models (LLMs) have evolved and permeated our lives so much and so quickly that many we have become dependent on them in all sorts of scenarios.

Large language models (LLMs) have evolved and permeated our lives so much and so quickly that many we have become dependent on them in all sorts of scenarios.

This post is divided into three parts; they are: • Setting up the translation pipeline • Translation with alternatives • Quality estimation Text translation is a fundamental task in natural language processing, and it inspired the invention of the original transformer model.
Language models — often known for the acronym LLM for Large Language Models, their large-scale version — fuel powerful AI applications like conversational chatbots, AI assistants, and other intelligent text and content generation apps.

Let’s face it: keeping up with new research, tools, and industry shifts in machine learning can be down-right overwhelming.

This post is divided into three parts; they are: • Interpolation and Extrapolation in Sinusoidal Encodings and RoPE • Interpolation in Learned Encodings • YaRN for Larger Context Window Sinusoidal encodings excel at extrapolation due to their use of continuous functions: $$ begin{aligned} PE(p, 2i) &= sinleft(frac{p}{10000^{2i/d}}right) \ PE(p, 2i+1) &= cosleft(frac{p}{10000^{2i/d}}right) end{aligned} $$ You…

Language models (LMs), at their core, are text-in and text-out systems.
The large language model (LLM) has become a cornerstone of many AI applications.