Figure 1 - uploaded by Guilherme Lima
Content may be subject to copyright.
Source publication
![Figure 2: The RCC8 relations [32].](profile/Guilherme-Lima-23/publication/337438956/figure/fig2/AS:827879306838016@1574393216952/The-RCC8-relations-32_Q320.jpg)
In this chapter, we give an introduction to symbolic artificial intelligence (AI) and discuss its relation and application to multimedia. We begin by defining what symbolic AI is, what distinguishes it from non-symbolic approaches, such as machine learning, and how it can used in the construction of advanced multimedia applications. We then introdu...
Contexts in source publication
Context 1
... basic idea of symbolic AI is to describe the world, its entities, and their relationships using a formal language-a language that can be conveniently manipulated by computers-and to develop efficient algorithms to query and deduce things from these formal descriptions. To illustrate the kind of applications enabled by the combination of symbolic AI and multimedia consider Figure 1. Suppose we are given this picture and suppose the only thing we know about it is what we can infer from the image. ...
Context 2
... truly understand what is being depicted in Figure 1 we need more than basic facts. We need (1) general knowledge about the world, (2) specific knowledge about the persons named, and (3) the capacity to combine general and specific knowledge with the facts extracted from the image in order to infer new facts. ...
Context 3
... we are also told that Charlotte Corday, who signed the letter, was a declared political enemy of Marat-she blamed him for a number of killings in Paris and other cities and believed that he was a grave threat to the French Republic. Under the light of these new facts, we can conclude that Figure 1 looks like the scene of a political murder. ...
Context 4
... combining this conclusion with the additional fact that Charlotte Corday is known to have murdered Jean-Paul Marat with a knife while he was in his bathtub, holding a letter from her, we can infer that Figure 1 must be a graphical representation of this incident, that is, of the politically motivated assassination of Jean-Paul Marat by Charlotte Corday. ...
Context 5
... derivation of this last fact from the visual patterns of Figure 1 has only been possible because we have had access not only to basic facts extracted from the image, but also to facts about the world (common sense knowledge) and about the depicted objects and persons (domain knowledge), and because we could combine all of these facts and make inferences. ...
Context 6
... of the main goals of symbolic AI is to enable the representation and manipulation of pieces of knowledge by computers in ways that resemble or emulate the kind of manipulations performed by humans-manipulations similar to the considerations that enabled us to determine the true meaning of Figure 1. The combination of this capacity with multimedia opens up many possibilities. ...
Context 7
... HyQL query specifies a complex Hyperknowledge-graph pattern, possibly involving path navigation, level shifts, aggregation, filters, and specific features or fragments of the underlying data. The complete syntax of HyQL is presented in Figure 10. We will not discuss this syntax and its accompanying semantics in detail, though. ...
Context 8
... can be combined with other filters and also test node attributes. For instance, the query This HSL snippet declares three nodes: "picture" (lines 1-5), which is a data node whose URI points to the picture of Figure 1, and "Knife" (line 6) and "Person" (line 7) which are concept nodes. The anchor elements (lines 2-3 and 4-5) of the "picture" node specify rectangular regions in the picture, which correspond roughly to the regions labeled "Jean-Paul Marat" and "Knife" in Figure 1. ...
Context 9
... instance, the query This HSL snippet declares three nodes: "picture" (lines 1-5), which is a data node whose URI points to the picture of Figure 1, and "Knife" (line 6) and "Person" (line 7) which are concept nodes. The anchor elements (lines 2-3 and 4-5) of the "picture" node specify rectangular regions in the picture, which correspond roughly to the regions labeled "Jean-Paul Marat" and "Knife" in Figure 1. The idea here is that we can use anchors to describe parts of nodes, in this case regions of picture, and then use links to connect regions to their semantic descriptions. ...
Context 10
... the case of importation, these statements are converted to Hyperknowledge entities before being stored in the underlying database. Figure 11 depicts the overall architecture of the HKBase. The HKBase architecture consists of three layers. ...
Context 11
... also has facilities for importing and manipulating OWL and RDF files. Figure 12 shows a screenshot of KES. The main canvas shows a graph-based representation of the contents of a Hyperknowledge base. ...
Context 12
... Hyperknowledge entities, KES permits the direct manipulation of multimedia content. For instance, the screenshot of Figure 12 shows that the user has run the query: "Select Goal where Goal by Neymar". (The Hyperknowledge base, in this case, contains facts about the soccer domain [23].) ...
Context 13
... basic idea of symbolic AI is to describe the world, its entities, and their relationships using a formal language-a language that can be conveniently manipulated by computers-and to develop efficient algorithms to query and deduce things from these formal descriptions. To illustrate the kind of applications enabled by the combination of symbolic AI and multimedia consider Figure 1. Suppose we are given this picture and suppose the only thing we know about it is what we can infer from the image. ...
Context 14
... truly understand what is being depicted in Figure 1 we need more than basic facts. We need (1) general knowledge about the world, (2) specific knowledge about the persons named, and (3) the capacity to combine general and specific knowledge with the facts extracted from the image in order to infer new facts. ...
Context 15
... we are also told that Charlotte Corday, who signed the letter, was a declared political enemy of Marat-she blamed him for a number of killings in Paris and other cities and believed that he was a grave threat to the French Republic. Under the light of these new facts, we can conclude that Figure 1 looks like the scene of a political murder. ...
Context 16
... combining this conclusion with the additional fact that Charlotte Corday is known to have murdered Jean-Paul Marat with a knife while he was in his bathtub, holding a letter from her, we can infer that Figure 1 must be a graphical representation of this incident, that is, of the politically motivated assassination of Jean-Paul Marat by Charlotte Corday. ...
Context 17
... derivation of this last fact from the visual patterns of Figure 1 has only been possible because we have had access not only to basic facts extracted from the image, but also to facts about the world (common sense knowledge) and about the depicted objects and persons (domain knowledge), and because we could combine all of these facts and make inferences. ...
Context 18
... of the main goals of symbolic AI is to enable the representation and manipulation of pieces of knowledge by computers in ways that resemble or emulate the kind of manipulations performed by humans-manipulations similar to the considerations that enabled us to determine the true meaning of Figure 1. The combination of this capacity with multimedia opens up many possibilities. ...
Context 19
... HyQL query specifies a complex Hyperknowledge-graph pattern, possibly involving path navigation, level shifts, aggregation, filters, and specific features or fragments of the underlying data. The complete syntax of HyQL is presented in Figure 10. We will not discuss this syntax and its accompanying semantics in detail, though. ...
Context 20
... can be combined with other filters and also test node attributes. For instance, the query This HSL snippet declares three nodes: "picture" (lines 1-5), which is a data node whose URI points to the picture of Figure 1, and "Knife" (line 6) and "Person" (line 7) which are concept nodes. The anchor elements (lines 2-3 and 4-5) of the "picture" node specify rectangular regions in the picture, which correspond roughly to the regions labeled "Jean-Paul Marat" and "Knife" in Figure 1. ...
Context 21
... instance, the query This HSL snippet declares three nodes: "picture" (lines 1-5), which is a data node whose URI points to the picture of Figure 1, and "Knife" (line 6) and "Person" (line 7) which are concept nodes. The anchor elements (lines 2-3 and 4-5) of the "picture" node specify rectangular regions in the picture, which correspond roughly to the regions labeled "Jean-Paul Marat" and "Knife" in Figure 1. The idea here is that we can use anchors to describe parts of nodes, in this case regions of picture, and then use links to connect regions to their semantic descriptions. ...
Context 22
... the case of importation, these statements are converted to Hyperknowledge entities before being stored in the underlying database. Figure 11 depicts the overall architecture of the HKBase. The HKBase architecture consists of three layers. ...
Context 23
... also has facilities for importing and manipulating OWL and RDF files. Figure 12 shows a screenshot of KES. The main canvas shows a graph-based representation of the contents of a Hyperknowledge base. ...
Context 24
... Hyperknowledge entities, KES permits the direct manipulation of multimedia content. For instance, the screenshot of Figure 12 shows that the user has run the query: "Select Goal where Goal by Neymar". (The Hyperknowledge base, in this case, contains facts about the soccer domain [23].) ...
