Apple releases AI tool for image editing through text input: Details here

Researchers at Apple have published a new paper detailing their MLLM-Guided Image Editing (MGIE) AI Model, which can edit an image using text prompts. Apple worked alongside University of California, Santa Barbara researchers to come up with a new model that is capable of handling a wide range of editing scenarios, from simple colour adjustments to more complex object manipulations.

The MGIE model consists of a Multimodal Large Language Model that expands users request and provides “concise expressive instructions” that the diffusion model can use to edit the input image. According to the research paper, this way of editing allows the MGIE model to address “ambiguous human commands to achieve reasonable editing”.