Japanese electronics giant NEC has developed a generative AI technology that can analyze video footage and explain what it sees in text.
NEC's newly developed AI uses its ability to recognize faces or objects in the video and describe them in words.
Then the information is fine-tuned into coherent text by using generative AI.
Possible applications include producing accident reports by studying vehicle dash cam footage, or creating work logs by analyzing construction site videos.
For example, if you ask the new AI to analyze dash cam footage that shows a motorcycle falling over, it will produce something of a word salad to describe what has happened.
Then generative AI cleans up the wording to produce a clearer description.
Here's the result.
"It is believed that the motorcycle crashed into the black car without noticing that it had stopped."
Generative AI programs usually excel at analyzing text and images, but are said to be less competent when it comes to dealing with video footage.
NEC`s new AI technology aims to offset that shortcoming.
NEC's newly developed AI uses its ability to recognize faces or objects in the video and describe them in words.
Then the information is fine-tuned into coherent text by using generative AI.
Possible applications include producing accident reports by studying vehicle dash cam footage, or creating work logs by analyzing construction site videos.
For example, if you ask the new AI to analyze dash cam footage that shows a motorcycle falling over, it will produce something of a word salad to describe what has happened.
Then generative AI cleans up the wording to produce a clearer description.
Here's the result.
"It is believed that the motorcycle crashed into the black car without noticing that it had stopped."
Generative AI programs usually excel at analyzing text and images, but are said to be less competent when it comes to dealing with video footage.
NEC`s new AI technology aims to offset that shortcoming.
Similar Readings (5 items)
NEC to roll out homegrown generative AI services
NEC is working on Japanese-language generative AI
Meta unveils AI tool capable of creating videos from texts, photos
Japanese firms and universities team up to fight fake information
Japanese firms offering AI-based home health services
Summary
Japanese tech company NEC has unveiled an advanced AI capable of analyzing video footage and converting its content into text. The AI, which can identify objects or faces in the video, generates a description that is then refined for coherence by a generative AI. Potential uses include generating
Statistics
173
Words1
Read CountDetails
ID: fa6a353a-ff13-4c47-a88f-20d251cc29fc
Category ID: nhk
URL: https://www3.nhk.or.jp/nhkworld/en/news/20231204_13/
Date: Dec. 4, 2023
Created: 2023/12/04 19:00
Updated: 2025/12/08 20:38
Last Read: 2023/12/04 21:51