E-Tools

NEC develops technology for video-to-text generative AI NHK

Japanese electronics giant NEC has developed a generative AI technology that can analyze video footage and explain what it sees in text.

NEC's newly developed AI uses its ability to recognize faces or objects in the video and describe them in words.

Then the information is fine-tuned into coherent text by using generative AI.

Possible applications include producing accident reports by studying vehicle dash cam footage, or creating work logs by analyzing construction site videos.

For example, if you ask the new AI to analyze dash cam footage that shows a motorcycle falling over, it will produce something of a word salad to describe what has happened.

Then generative AI cleans up the wording to produce a clearer description.

Here's the result.
"It is believed that the motorcycle crashed into the black car without noticing that it had stopped."

Generative AI programs usually excel at analyzing text and images, but are said to be less competent when it comes to dealing with video footage.

NEC`s new AI technology aims to offset that shortcoming.
Summary
Japanese tech company NEC has unveiled an advanced AI capable of analyzing video footage and converting its content into text. The AI, which can identify objects or faces in the video, generates a description that is then refined for coherence by a generative AI. Potential uses include generating
Statistics

173

Words

1

Read Count
Details

ID: fa6a353a-ff13-4c47-a88f-20d251cc29fc

Category ID: nhk

URL: https://www3.nhk.or.jp/nhkworld/en/news/20231204_13/

Date: Dec. 4, 2023

Created: 2023/12/04 19:00

Updated: 2025/12/08 20:38

Last Read: 2023/12/04 21:51