Advancements in AI: PaLM-E, 'GPT 4' and Multi-Modality

Key insights

• 🤖
  The release of Palm-E and the upcoming GPT-4 raises the question of what tasks are left before achieving AGI, and whether multi-modality, logical reasoning, speed of learning, transfer learning, and long-term memory are still barriers to overcome.
• 🤯
  The multi-modality capabilities of PaLM-E and Microsoft's Visual Chaturbate are major milestones in AI, allowing for image prediction and natural language processing based on images and videos.
• 🤖
  The key question remains: if models like GPT-4 can already read so well, what exactly is left before AGI?
• 🤖
  The struggles of GPT models with mathematics and lack of internal calendar highlight the limitations of current AI technology.
• 🤯
  The fact that we cannot fully control the outputs of large language models is a worrying challenge for AI safety and interpretability.
• 🤯
  Large language models like PaLM-E are already computationally universal and can process arbitrarily long inputs, raising concerns about the accelerating progress of AI capabilities.
• 💻
  The potential for a 1,000 time increase in computation used to train the largest models over the next five years could result in a capability jump significantly larger than previous jumps, potentially leading to human level performance across most tasks.
• 🤯
  The highest human rater on reading comprehension tests may not be the ultimate benchmark for AGI, as progress stalls when test examples of sufficient quality get so rare in the data set that language models simply cannot perform well on them.