In a blog post shared on Thursday, Google announced the release of Gemini 1.5, its next-generation AI model that promises significant improvements in performance and efficiency. Among the improvements is the ability to process and understand massive amounts of information, up to 1 million tokens at a time.
The RIGHT way to use Google Gemini – Updated for 2024!
Building on the success of Gemini 1.0, the latest iteration uses a new Mixture-of-Experts (MoE) architecture that divides the AI model into smaller, specialized networks. According to Google, this allows for more efficient processing and training while maintaining high performance. This allows Gemini 1.5 to process multimodal input, including text, images, audio, and video, with better accuracy and understanding.
One of the striking features of the new model is the extended context window. While the previous model could only handle 32,000 tokens, Gemini can handle 1.5 to 1 million tokens. This allows it to process, analyze and reason with a larger volume of text, code, video and audio, even if they are added in a single prompt.
The extended context window offers new functionalities:
