Microsoft Corp. today expanded its Phi line of open-source language models with two new algorithms optimized for multimodal processing and hardware efficiency. The first addition is the text-only ...

AnyGPT is an innovative multimodal large language model (LLM) is capable of understanding and generating content across various data types, including speech, text, images, and music. This model is ...

Meta has unveiled Muse Spark, its most powerful AI model yet, designed for multimodal reasoning and multi-agent task execution across text, images, and tools. Built by Meta Superintelligence Labs ...

French AI startup Mistral has dropped its first multimodal model, Pixtral 12B, capable of processing both images and text. The 12-billion-parameter model, built on Mistral’s existing text-based model ...

Microsoft has introduced a new AI model that, it says, can process speech, vision, and text locally on-device using less compute capacity than previous models. Innovation in generative artificial ...

A study on visual language models explores how shared semantic frameworks improve image–text understanding across ...

Snapchat has introduced AI-powered Sponsored Snaps that let users interact with brand agents directly in chat, while Nvidia unveiled its Nemotron 3 Nano Omni model combining vision, audio, and ...

So, as announced by Microsoft, GPT-4 is "multimodal" – capable of processing other media as well as just text. But while Microsoft speaks of potential video and audio use cases, OpenAI has limited GPT ...