The article examines the use of an image in the analysis of the semiotic space of interacting sign systems that are of different types: verbal, nonverbal and mixed sign systems, i.e. the systems that include both verbal and nonverbal elements. The sign systems constituting the semiotic space are defined as secondary semiotic modeling systems that have additional superstructure. The latter is considered to be complicated sense structure consisting of five levels: objective, evaluative, hedonistic, conceptual and archetypal levels, each level forming with the appropriate sense components. Moreover, the sign systems can be divided into initial and new ones. The semiotic space develops around an initial sign system, as new sign systems created on the basis of the initial one are included into it (the semiotic space). An image is defined as an integrated sense phenomenon that includes the sense components of different types (objective, evaluative, hedonistic, conceptual and archetypal). The author suggests using images and their sense components to analyze the semiotic space of interacting verbal, nonverbal and mixed sign systems. The article demonstrates the stages and results of the analysis of the “tree” image and its sense components in the initial verbal sign system and in the new mixed sign systems that create the semiotic space. It has been shown in the article that the use of images as the analysis units helps investigate the transposition processes, the processes of sense creation and development in the semiotic space.
Keywords: Semiotic spacesign systemsecondary (semiotic) modeling systemimagesense componentstransposition
The study of sign systems is playing an essential part in modern society due to rapid development and spread of multimedia for mass communication. As a result of active use of multimedia means to create the digital mass media content ( Zhumash, 2019), promote brands ( Shumakova, 2019) and design efficient advertisements ( Selemeneva, 2019), the new media and multimedia genres ( Davletshina, 2017) that have their own peculiarities and values for modern society have been developing, e.g. the web-documentary has appeared ( Antonova, 2016). Modern society tend to visualize more information than earlier ( Kozhemyakin, 2018; Salmin, 2016; Savinova & Harunzheva, 2016; Yegorova, 2018) and develop virtual communication ( Glukhov, 2018) using visual means. Researchers examine the opportunities of the semiotic approach to analyze different types of esthetic communication that are by their very nature visual: the semiotic analysis of design to develop the systems of graphic signs ( Khomenko, 2018), perception of signs and symbols in theatre ( Alesenkova, 2017), role of signs in fine art ( Balkind & Karpova, 2017) and films ( Yevgrafova, 2018). Ilyin and Fomin ( 2016) suggest developing general semiotics as an interdisciplinary approach that will integrate all the social and humanitarian studies and applications of signs.
When speaking about sign systems and multimedia it is crucial to draw attention to several points: firstly, pictorial representation of information often dominates; secondly, interaction of various sign systems takes place; and lastly, this interaction leads to the creation of semiotic space. Thus, they raise an important issue regarding the role of images in the semiotic space formed as a result of the interaction of various sign systems.
This section considers the explication of some methodological issues based on the ideas of semiotics, linguistics and systems theory that contribute to the investigation of the role of images in the semiotic space of interacting sign systems. The research methodology includes the following.
Natural language is a primary sign system, since it serves as “an interpretant” for all sign systems functioning in the society ( Benveniste, 1976). Other sign systems either are built upon the primary system of natural language (for example, fiction) or exist in parallel with it (for example, music and painting) ( Ivanov, 1978), with natural language being used to describe any sign systems. This issue allows developing universal metalanguage to describe sign systems of various types (verbal, nonverbal, and mixed, that is, including both verbal and nonverbal elements).
Lotman’s theory of semiosphere, or semiotic space, as a semiotic continuum that is full of semiotic entities of different types ( Lotman, 2019) forms the basis for this research on the semiotic space as unity of various interacting sign systems. The sign systems interaction during their transposition is of special interest. Transposition is defined as transfer of multiple elements from one sign system into another one. For example, translation into foreign languages is transposition from one verbal system into other verbal sign systems; film adaptation of fiction is transposition from a verbal system into a mixed sign system. In recent research works, film adaptation has become one of the widely discussed problems. The Russian researchers have focused on the features of the screen versions of the Russian and English dramatic texts ( Levina, 2017; Vysochanskaya & Germanovich, 2017), Russian and English prose fiction ( Levina, 2019; Rybina, 2019), English epic texts ( Dmitruk, 2019). Examining the differences between the original text and its screen versions, Dmitruk ( 2019) concludes that fiction texts have multilayered structure that is not shown exactly in films; a film reveals only one or several “layers” but not all of them.
To describe the connection between sign systems during their transposition we use the terms “initial (sign) system” and “new (sign) system”. Consider, for instance, the transposition from a novel into a film: the novel is an initial system of the verbal type, and a film is a new system of the mixed type.
The notions of a secondary modeling system and additional superstructure ( Ivanov, 2002) allowed us to define the sign systems as the secondary modeling systems with additional superstructures organized according to some laws. We suggest that the additional superstructure is a combination of objective, conceptual, evaluative, hedonistic and archetypal sense components that constitute the sense levels respectively – more details about each type of sense components and sense levels in ( Ronzhina, 2016).
The ideas above provide a methodological basis for the research of the semiotic space of interacting sign systems.
The research focuses on the development of the metalanguage units that will be efficient enough to reveal and describe the interaction of verbal, nonverbal and mixed sign systems within the semiotic space. To achieve this, we introduce such terms as “image”, “sense component”, “functor”.
We completely agree with Slovikova ( 2016) when she defines “image” as an integrated sense combination that includes a system of sense components. However, unlike her idea that “image” is a textual category, that is, a category of verbal sign systems, we think that “image” is a semiotic category that belongs to verbal, nonverbal and mixed sign systems. Moreover, we suggest that an image as an integrated sense combination could include dozens of sense components of different types: objective, evaluative, hedonistic, conceptual and archetypal. Firstly, these sense components could be actualized with verbal and/or nonverbal means in the sign systems within the semiotic space. Secondly, they could be implicit and constitute the potential of an image. Take, for example, the sense components of the “tree” image.
The sense components of each type constitute the respective sense levels (objective, evaluative, hedonistic, conceptual and archetypal) the combination of which forms the “additional superstructure” of a sign system. Virtually analogous levels of sense can be found in the work of Slovikova ( 2016) who discusses the levels of objects, ideas, evaluations, emotions, and generic existential sense connected with the historic memory of the humanity. These ideas were based on Myshkina’s contradictory-synergy theory ( Myshkina, 1998).
Some images actualized by verbal and/or nonverbal means in sign systems are called “functors”. This term is used in logics ( Carnap, 1947), logic grammar ( Curry, 1961), linguistics ( Stepanov, 2012), contradictory-synergy linguistics ( Myshkina, 1998); it is also used in our works on linguistic semiotics ( for example, Ronzhina, 2016). In this writer’s view, a functor is a verbal or nonverbal or verbal-nonverbal unit which actualizes an image that includes several sense components and influences the sense development and sense levels formation in sign systems within semiotic space. Images that function as functors are a kind of central units of the whole semiotic space that ensure its unity.
Purpose of the Study
The main purpose of the research is to investigate if the unit “image” is applicable to the research of the semiotic space of interacting sign systems. The research aims to answer the following questions. First, what is the potential of the initial sign system for the whole semiotic space? Second, how can the analysis of images reveal this potential? Third, how can images be used in the study of the sense creation and development? And lastly, what is the role of images in the interaction of sign systems within the semiotic space?
To study the role of the image and its sense components in the interaction of various sign systems within the semiotic space, it is sufficient to go through the following three stages of the functor-semiotic analysis ( Ronzhina, 2016): 1) to carry out the definition analysis of the units that actualize the image in order to reveal the sense components of different types; 2) to examine the actualization of the sense components of the image in the initial sign system; 3) to examine the actualization of the sense components of the image in the new sign systems.
The following sign systems of different types have been analyzed in order to achieve the research purpose: “The Legend of Sleepy Hollow”, a gothic story by American author Irving ( 2017); “The Legend of Sleepy Hollow” [“Легенда о Сонной Лощине”], a Russian translation by A. Bobovitch ( Irving, 2014); “Sleepy Hollow”, a film based on the original story and directed by T. Burton.
The first story is an initial verbal sign system around which the semiotic space
Analysis of the “tree” image in the semiotic space called
The first stage of the analysis
The first stage was to identify the sense components of the “tree” image. Three objective sense components were found with the help of monolingual English and Russian dictionaries (Merriam-Webster, n.d.; Ushakov, 2017) as the initial and new sign systems that constitute the semiotic space are in these languages. They are as follows:
The second and third stages of the analysis
Two verbal sign systems were analyzed during these stages: the initial system, that is, a gothic story “The Legend of Sleepy Hollow” ( Irving, 2017), and a new system, that is, its Russian translation ( Irving, 2014). The contextual analysis of the verbal means of both systems identified the actualized sense components of the “tree” image (Table
The sense components of the “tree” image are shown in the left side part of the Table; their verbal actualizations in the initial and new verbal sign systems are given in the right side part of the Table. The data given demonstrate that only one objective and four archetypal sense components (from thirty-nine archetypal sense components revealed at the first stage) are actualized in the systems. They are as follows:
The third stage of the analysis
The analysis of verbal and nonverbal means that actualize the sense components of the “tree” image in a new mixed sign system (that is, the film “Sleepy Hollow” directed by Tim Burton) is carried out during the third stage too. To be exact, the analysis of only two parts of the film (that begin at 46:18 and 01:30:25) is given in the article because of their significance for the “tree” image actualization. Compared to the verbal systems, the mixed system actualizes more sense components and uses verbal and nonverbal means for their actualization (Table
Discussion of the results
In the verbal sign systems, the archetypal sense components
verbal means: the words of the main character, ‘This is… a gateway, between two worlds…’;
nonverbal means (the object description): the pathway through the tree, that is surrounded by dead heads;
nonverbal means (the process description): the roots of the tree are twining the skeleton in the tomb behind the tree, while the Headless Horseman is appearing in front of the tree moving through it.
It is essential that the archetypal sense components
In the mixed system, nonverbal means actualize such archetypal sense components as
There are some differences in the way the archetypal sense components
The given examples show that the verbal and nonverbal means of the “tree” image actualization are functor units that connect the sense components and, thus, enable the sense creation and development in the initial and new systems.
The “tree” image, as has been seen, includes a number of the sense components of different types. These components constitute its internal implicit sense potential which is actualized partially in the initial verbal sign system or more completely in the new mixed sign system when it joins the semiotic space The
The following conclusions may be drawn from these Findings. The use of images as units to analyze sign systems within semiotic space allows 1) defining the sense potential of an initial verbal system (in particular identifying the hidden archetypal level of sense), 2) revealing and describing how this potential is fulfilled in initial and new sign systems of various types, 3) demonstrating the sense creation and development processes (in other words, the sense dynamics) in sign systems of various types, 4) investigating the interaction of sign systems of various types within a semiotic space.
Thus, the results of the survey suggest that images are the units of great importance to particular sign systems and to semiotic space that includes these systems. An image plays the role of a linking element between the sign systems interacting within the semiotic space. To put it another way, it functions as a hyperlink in a computer document that will take you to another document if you click on it, so it can be referred to as a hyperimage that will take you to another image or sign system.
- Alesenkova, V. N. (2017). Inversiya vospriyatiya znaka i simvola v kontekste neverbal’nogo yazyka teatra [Inversion of sign and symbol perception in the context of non-verbal theatrical language]. Philological Sciences. Issues of Theory and Practice, 2(68), 55–57. http://www.gramota.net/materials/2/2017/2-1/15.html
- Antonova, A. V. (2016). Social’naya sushhnost’ veb-dokumentalistiki v ramkax teorii novyh media [The social nature of the web-documentary in the framework of the new media]. Proceedings of Saratov University. New Series. Sociology. Political Science, 16(2), 186–190. https://doi.org/10.18500/1818-9601-2016-16-2-186-190
- Balkind, E. L., & Karpova, I. D. (2017). Izobrazitel’noe iskusstvo: semioticheskie osnovy kommunikativnyh processov [Fine art: semiotics foundations of communicative processes]. Scientific Proceedings of Belgorod State University. Series: Philosophy, Sociology, Law, 3(252), 48–53.
- Benveniste, E. (1976). Problèmes de linguistique générale [Problems in General Linguistics]. Paris: S.P.A.D.E.M.
- Carnap, R. (1947). Meaning and necessity. A study in semantics and modal logic. The University of Chicago Press.
- Cirlot, J. E. (2015). A dictionary of symbols. Routledge.
- Curry, H. B. (1961). Some logical aspects of grammatical structure. In Structure of language and its mathematical aspects. Proceedings of Symposia in Applied Mathematics, 12, 56–68.
- Davletshina, S. R. (2017). “Novye media” i tendencii razvitiya mul’timedijnyh zhanrov [“New Media” and trends of development of multimedia genres]. Actual Issues of Modern Philology and Journalism, 2(25), 86–91.
- Dmitruk, T. I. (2019). Tekst i ekranizaciya: varianty ih sootnosheniya (na materiale romana T. Me`lori “Smert` Artura” i ego kinoadaptacij) [Text and screen version: options for their correlation (on the material of T. Malory’s novel “The Death of Arthur” and its film adaptations)]. Sign: Problematic Field of Media Education. Research Journal, 1(31), 96–101.
- Glukhov, A. P. (2018). Osobennosti kul’tury virtual’noj kommunikacii pokoleniya z: menedzhment rezhimov kommunikacii [Features of culture of virtual communications of generation Z: management of communication regimes]. Sign: Problematic Field of Media Education. Research Journal, 4(30), 157–166.
- Ilyin, M. V., & Fomin, I. V. (2016). I smysl, i mera. Semiotika v prostranstve sovremennoj nauki [Meaning and measure. Semiotics in the space of modern science]. Political Science, 3, 30–46.
- Irving, W. (2014). The legend of Sleepy Hollow. Sleepy Hollow, 57–106.
- Irving, W. (2017). The legend of Sleepy Hollow. The Legend of Sleepy Hollow and Other Stories, 327–360.
- Ivanov, V. V. (1978). Chyot i nechet: Asimmetriya mozga i znakovyh sistem [Odd and even: Asymmetry of brain and sign systems]. Sov. Radio Publ.
- Ivanov, V. V. (2002). Simvolicheskaya funkciya yazyka v aspektax semiogeneza i semiozisa [The symbolic function of a language in the aspects of semiogenesis and semiosis] (Doctoral dissertation). Retrieved from https://search.rsl.ru/ru/record/01002607221 (Order No. 71 03-10/175-5).
- Khomenko, O. V. (2018). Semiotika dizajna: dizajn kak sredstvo kommunikacii [Semiotics of design: design as a communication tool]. Sign: Problematic Field of Media Education. Research Journal, 1(27), 184–193.
- Kozhemyakin, E. A. (2018). Vizual’noe i social’noe: perspektivy’ kriticheskogo diskurs-analiza i social’noj semiotiki [Visual and social: perspectives for critical discourse analysis and social semiotics]. Sign: Problematic Field of Media Education. Research Journal, 1(27), 86–92.
- Krauze, C. (2018). The big encyclopedia. Symbols and signs. AST Publ.
- Levina, L. A. (2017). Tragedii V. Shekspira v sovremennoj kinoadaptacii (“Romeo i Dzhul’etta”, “Gamlet”, “Makbet”) [The tragedies of W. Shakespeare in modern film adaptation (“Romeo and Juliet”, “Hamlet”, “Macbeth”)]. Philological Sciences. Issues of Theory and Practice, 11(77), 35–40.
- Levina, L. A. (2019). Hudozhestvennyj tekst i istoricheskij kontekst v sovremennoj kinoadaptacii russkoj klassicheskoj literatury (“Boris Godunov” A. S. Pushkina, “Palata №6” A. P. Chehova) [Fiction text and historical context in modern screen versions of the Russian classical literature (“Boris Godunov” by A. S. Pushkin, “Ward №6” by A. P. Chekhov)]. Philological Sciences. Issues of Theory and Practice, 12(6), 30–34. https://doi.org/10.30853/filnauki.2019.6.6
- Lotman, J. (2019). Culture, memory and history. Essays in cultural semiotics. Palgrave Macmillan. https://doi.org/10.1007/978-3-030-14710-5
- Merriam-Webster. (n.d.). Tree. In Merriam-Webster.com dictionary. Retrieved January 10, 2020, from https://www.merriam-webster.com/dictionary
- Myshkina, N. L. (1998). Vnutrennyaya zhizn’ teksta: mexanizmy, formy, harakteristiki [The Inner Life of a Text: mechanisms, forms, characteristics]. Perm National University.
- Ronzhina, Ya. N. (2016). Smysloorganizuyushhaya funkciya funktorov v hudozhestvennom tekste [The sense organising function of functors in prose fiction]. Perm: Perm National Research Polytechnic University.
- Rybina, P. Yu. (2019). Effekty kinoadaptacii: antikvarnyj fil’m, “Missis Dellouej” i Marlen Gorris [The effects of film adaptation: heritage film, “Mrs. Dalloway”, and Marleen Gorris]. Bulletin of Moscow University. Series 9. Philology, 1, 172–186.
- Salmin, L. Yu. (2016). Vizual'nye kommunikacii. Novaya real'nost' [Visual communications. A new reality]. Architecton: News of Higher Education, 56, 61–70.
- Savinova, S. V., & Harunzheva, A. A. (2016). Podhody k opredeleniyu svojstv i funkcij vizual'nyh kommunikacij i ih klassifikaciya [Approaches to the definition of the properties and functions of visual communication and its classification]. Nauchno-Metodicheskij Ehlektronnyj Zhurnal «Koncept» [Scientific Methodical Electronic Journal «Concept»], 18, 139–146. http://e-koncept.ru/2016/56217.htm
- Selemeneva, O. A. (2019). Semioticheski geterogenny’e reklamny’e teksty v aspekte kommunikativno-pragmaticheskogo analiza (na materiale mezhdunarodnyh specializirovannyh glyancevyh zhurnalov) [Semiotically heterogeneous advertising texts in the aspect of communicative-pragmatic analysis (based on the international specialized magazines)]. Sign: Problematic Field of Media Education. Research Journal, 4(34), 127–137. https://doi.org/10.24411/2070-0695-2019-10414
- Shumakova, E. A. (2019). Vliyanie trendov v dizajne na vizual’ny’j kontent brendov v social’nyh setyah [Influence of design trends on the visual content in social networks]. Sign: Problematic Field of Media Education. Research Journal, 3(33), 166–174. https://doi.org/10.24411/2070-0695-2019-10322
- Sleepy Hollow. (2012). [Video]. Directed by T. Burton.
- Slovikova, E. L. (2016). Kategoriya obraznosti kak universal’naya obshhediskursivnaya kategoriya [The Category of Imagery as a Universal General-Discourse Category]. The complex-system research of the language space dynamics, 26–36.
- Stepanov, Yu. S. (2012). Imena. Predikaty. Predlozheniya (Semiologicheskaya Grammatika) [Names. Predicates. Sentences (Semiological Grammar)]. URSS.
- Tresidder, J. (2005). The complete dictionary of symbols. Chronicle books.
- Ushakov, D. N. (2017). Bol’shoj tolkovyj slovar’ russkogo yazyka [The big monolingual dictionary of the Russian language]. Dom Slavyanskoy Knigi, Hit-Kniga Publ.
- Vysochanskaya, A. M., & Germanovich, A. A. (2017). K probleme kinoadaptacii dramaturgicheskoj pritchi (p’esy G. Gorina v ekranizacii M. Zaxarova) [The problem of the dramatic parable adaptation (plays by G. Gorin in the adaptation of M. Zacharov)]. Bulletin of Buryatia State University, 3, 31–40.
- Yegorova, L. G. (2018). Infografika v regional’nyh pechatnyh izdaniyah (na materiale gazety “Krymskie izvestija”) [The infographics in the regional printed media (on the material of “Krymskie izvestija” newspaper)]. Sign: Problematic Field of Media Education. Research Journal, 4(30), 112–118.
- Yevgrafova, Yu. A. (2018). Znak kak sredstvo konstruirovaniya real’nosti i manipulyacii soznaniem v semioticheski oslozhnyonnyh ekrannyh tekstah (na primere tekstov kino i televideniya) [Sign as the means of constructing reality and mind control in semiotically expanded screen texts (based on the texts of cinema and television)]. Bulletin of Moscow Region State University, 3, 240–255.
- Zhumash, Zh. M. (2019). Ispol’zovanie novyh media dlya povysheniya loyal’nosti auditoria [The use of the new media to improve the customers’ loyalty]. Media Environment. https://doi.org/10.24411/2070-0717-2019-10105
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
About this article
03 August 2020
Print ISBN (optional)
Sociolinguistics, linguistics, semantics, discourse analysis, translation, interpretation
Cite this article as:
Ronzhina, Y. N. (2020). Images As Units Of The Semiotic Space Analysis. In & N. L. Amiryanovna (Ed.), Word, Utterance, Text: Cognitive, Pragmatic and Cultural Aspects, vol 86. European Proceedings of Social and Behavioural Sciences (pp. 1179-1188). European Publisher. https://doi.org/10.15405/epsbs.2020.08.136