tailieunhanh - Báo cáo khoa học: "Project for production of closed-caption TV programs for the hearing impaired"

We describe an on-going project whose primary aim is to establish the technology of producing closed captions for TV news programs efficiently using natural language processing and speech recognition techniques for the benefit of the hearing impaired in Japan. The project is supported by the Telecommunications Advancement Organisation of Japan with the help of the ministry of Posts and Telecommunications. | Project for production of closed-caption TV programs for the hearing impaired Takahiro Wakao Telecommunications Advancement Organization of Japan Uehara Shibuya-ku Tokyo 151-0064 Japan wakao@. Eiji Sawamura TAO Terumasa Ehara NHK Science and Technical Research Lab I TAO Ichiro Maruyama TAO Katsuhiko Shirai Waseda University Department of Information and Computer Science TAO Abstract We describe an on-going project whose primary aim is to establish the technology of producing closed captions for TV news programs efficiently using natural language processing and speech recognition techniques for the benefit of the hearing impaired in Japan. The project is supported by the Telecommunications Advancement Organisation of Japan with the help of the ministry of Posts and Telecommunications. We propose natural language and speech processing techniques should be used for efficient closed caption production of TV programs. They enable US to summarise TV news texts into captions automatically and synchronise TV news texts with speech and video automatically. Then the captions are superimposed on the screen. We propose a combination of shallow methods for the summarisation. For all the sentences in the original text an importance measure is computed based on key words in the text to determine which sentences are important. If some parts of the sentences are judged unimportant they are shortened or deleted. We also propose keyword pair model for the synchronisation between text and speech. Introduction The closed captions for TV programs are not provided widely in Japan. Only 10 percent of the TV programs are shown with captions in contrast to 70 in the United States and more than 30 in Britain. Reasons why the availability is low are firstly the characters used in the Japanese language are complex and many. Secondly at the moment the closed captions are produced manually and it is a time-consuming and costly task. Thus we think the natural language and speech