Facebook makes AI see the world through your eyes
Facebook makes AI see the world through your eyes

Facebook has announced a research project that will collect 2,200 hours of ego images from around the world to train the next generation of artificial intelligence models.

The project is called Ego4D and could be important to the company's Reality Labs division, which is working on multiple projects that could benefit from AI models trained on videos captured from a human perspective. .

These include smart glasses, like Ray-Ban Stories published by Facebook last month, and VR, which has invested heavily in VR since acquiring Oculus for $2 billion in 2014.

Snapshots can teach AI to understand or recognize certain things in the real or virtual world. You can see these things in first person through data glasses or Oculus headphones.

The company announced that it will make its Ego4D dataset available to researchers in November. She added: “This publication represents a challenge to open data and research and drives internal and external progress at our university. It also enables other researchers to think of solutions to these new problems. The more logical the wider.

This data set can be made available in an AI model and used to train technologies such as robotics to understand the world faster. Traditionally, robots learn by doing things in the world. And they have the opportunity to learn the video from their own experience.

Facebook and a coalition of 13 partner universities rely on more than 700 participants from 9 countries to capture first-person photos. Use standard equipment such as GoPro cameras and Vuzix data glasses.

Facebook's academic partners include Carnegie Mellon University in the US, the University of Bristol in the UK, the National University of Singapore, the University of Tokyo in Japan, and the International Institute of Technology in India.

Facebook wants the system to see, hear, and remember everything you do

This video was filmed in the US, UK, Italy, India, Japan, Singapore and Saudi Arabia. The company hopes to expand the project to other countries, including Colombia and Rwanda.

The company is steadily increasing its efforts in the hardware field. Last month, he launched $299 worth of Ray-Ban Stories, his first pair of smart glasses.

In July, the company announced the creation of a product team to develop Metaverse. It is a concept to create a digital world in which many people can live at the same time.

But last month, Facebook was bombarded with reports. These stories come from extensive internal research conducted by Frances Harkin, the company's former product manager.

In published research, slides show that Instagram is detrimental to the mental health of teens.

For privacy reasons, participants were instructed to avoid capturing personally identifiable features when collecting footage inside.

This includes faces, conversations, tattoos, and jewelry. Facebook said it removed personally identifiable information from the video and blacked out pedestrians' faces and license plates. Audio has also been removed from many videos.

Previous Post Next Post