tailieunhanh - Báo cáo khoa học: "Diagram Understanding Using Integration of Layout Information and Textual Information"

Pattern information and natural language information used together can complement and reinforce each other to enable more effective communication than can either medium alone (Feiner 91) (Nakamura 93). One of the good examples is a pictorial book of flora ( P B F ) . In the PBF, readable explanations which combine texts, pictures, and diagrams are achieved, as shown in Figure 1 and 2. Taking advantage of this, we propose here a new method for analyzing the PBF diagrams by using natural language information. . | Diagram Understanding Using Integration of Layout Information and Textual Information Yasuhiko Watanabe Ryukoku University Seta Otsu Shiga Japan watanabe@rins. ryukoku . Makoto Nagao Kyoto University Yoshida Sakyo-ku Kyoto Japan nagao@ 1 Introduction Pattern information and natural language information used together can complement and reinforce each other to enable more effective communication than can either medium alone Feiner 91 Nakamura 93 . One of the good examples is a pictorial book of flora PBF . In the PBF readable explanations which combine texts pictures and diagrams are achieved as shown in Figure 1 and 2. Taking advantage of this we propose here a new method for analyzing the PBF diagrams by using natural language information. In the PBF many kinds of information about plants are generally stored in the following media picture explanation text and diagram. Pictures and explanation texts describe the shape botany and environment of each plant as shown in Figure 1. On the contrary as shown in Figure 2 diagrams describe very clearly the following kinds of information correspondence between each part of the plant and its name part-whole relationship and synonymous words As a result diagrams are quite important in order to understand the explanation of each plant. For example pictures and explanation texts cannot convey the information which is necessary to answer the following questions which part of plant is takuyou stipules what shape is hishinkei lanceolate shape Consequently we have to investigate thè method for understanding diagrams. It is certain that diagrams are effective means of communication. However it is also true that we feel difficulties when we try to understand diagrams without the explanation by natural language. From this we conclude that natural language information is important to understand diagrams. Consequently we propose a new framework for the in- 3 7 y spiraea cantoniensis iff 3 Kg-r So PISJF Sề 2-5cm