Design a multimodal RAG assistant

Design an assistant that answers questions using retrieval over inputs of several kinds (text documents, images, tables or diagrams). Cover ingesting and embedding each kind, the index, retrieval and ranking, how results reach the model, grounding answers in sources, and how you evaluate it.