MIT researchers advance automated interpretability in AI models
MAIA is a multimodal agent that can iteratively design experiments to better understand various components of AI systems.
Computer vision
Researchers leverage shadows to model 3D scenes, including objects blocked from view
This technique could lead to safer autonomous vehicles, more efficient AR/VR headsets, or faster warehouse robots.
Understanding the visual knowledge of language models
LLMs trained primarily on text can generate complex visual concepts through code with self-correction. Researchers used these illustrations to train an image-free computer vision system to recognize real photos.
Researchers use large language models to help robots navigate
The method uses language-based inputs instead of costly visual data to direct a robot through a multistep navigation task.
New algorithm discovers language just by watching videos
DenseAV, developed at MIT, learns to parse and understand the meaning of language just by watching videos of people talking, with potential applications in multimedia search, language learning, and robotics.
New computer vision method helps speed up screening of electronic materials
The technique characterizes a material’s electronic properties 85 times faster than conventional methods.
Looking for a specific action in a video? This AI-based method can find it for you
A new approach could streamline virtual training processes or aid clinicians in reviewing diagnostic videos.
Controlled diffusion model can change material properties in images
“Alchemist” system adjusts the material attributes of specific objects within images to potentially modify video game models to fit different environments, fine-tune VFX, and diversify robotic training.
School of Engineering welcomes new faculty
Fifteen new faculty members join six of the school’s academic departments.
Creating bespoke programming languages for efficient visual AI systems
Associate Professor Jonathan Ragan-Kelley optimizes how computer graphics and images are processed for the hardware of today and tomorrow.