We're excited to introduce EgoLife, a cutting-edge project that’s working towards bringing AI seamlessly into our daily lives through first-person perspective data.
In this ongoing research, we’ve invited 6 volunteers to live together for a full week, each wearing Meta Aria smart glasses that capture everything they see, hear, and do. This results in 300+ hours of real-life, multimodal data—a valuable resource for building an AI system that doesn’t just understand the present moment, but also remembers, reason, and assists based on long-term experiences.
Key features of EgoLife include:
- Tracking memories and details from daily activities (e.g., “Where did I buy that yogurt?”)
- Recalling events from days past (e.g., “What did I eat for lunch this week?”)
- Task management (e.g., “What else should I buy?”)
Understanding social interactions (e.g., “Who was missing from the party?”)
- Providing insights into habits (e.g., “What is my favorite vegetable?”)
The EgoButler system, powered by EgoGPT and EgoRAG, enables long-term memory retrieval, temporal reasoning, and context-aware question answering, allowing the AI to assist in ways never seen before.
This is just the beginning. We’re working on scaling the technology and enhancing its capabilities to create the AI companion of the future.
We're excited to introduce EgoLife, a cutting-edge project that’s working towards bringing AI seamlessly into our daily lives through first-person perspective data.
In this ongoing research, we’ve invited 6 volunteers to live together for a full week, each wearing Meta Aria smart glasses that capture everything they see, hear, and do. This results in 300+ hours of real-life, multimodal data—a valuable resource for building an AI system that doesn’t just understand the present moment, but also remembers, reason, and assists based on long-term experiences.
Key features of EgoLife include:
- Tracking memories and details from daily activities (e.g., “Where did I buy that yogurt?”)
- Recalling events from days past (e.g., “What did I eat for lunch this week?”)
- Task management (e.g., “What else should I buy?”) Understanding social interactions (e.g., “Who was missing from the party?”)
- Providing insights into habits (e.g., “What is my favorite vegetable?”)
The EgoButler system, powered by EgoGPT and EgoRAG, enables long-term memory retrieval, temporal reasoning, and context-aware question answering, allowing the AI to assist in ways never seen before.
This is just the beginning. We’re working on scaling the technology and enhancing its capabilities to create the AI companion of the future.
Want to learn more or join the project? Checkout https://egolife-ai.github.io/
#AI #FirstPersonAI #LifeAssistant #Multimodal #EgoLife