Information theory

Date:

2018-04-02 16:27:09

Views:

659

Rating:

1Like 0Dislike

Share:

Table of contents:

 

Basic concepts of this theory are introduced in the forties of the twentieth century, K. Shannon. Information theory of – the science of the processes of transmission, storage and retrieval of data in natural, technical and social systems. In many applied scientific fields such as computer science, linguistics, cryptography, control theory, image processing, genetics, psychology, Economics, production organization, uses the methods of this science.

In modern conditions the theory of information is very tightly linked to coding theory, addressing the most common problems of conformity between signal and message, and the theory of signal processing in which we study the quantization and reconstruction of signals, spectral and correlation analysis thereof.

Information Theory considers the basic notion of the “information” for the most part, quantitative part, without considering its value, and sometimes the meaning. In this approach, a page of text will contain approximately the same amount of data that is determined only by the number of characters and symbols, and does not depend on the fact that, strictly speaking, there is printed, even though completely meaningless and chaotic a collection of some of the characters.

This approach is valid, but only for modeling communication systems, as they must accurately transmit information via communication channels, which can be any set of characters and symbols. Then, when it is necessary to consider the value and meaning of data, the quantitative approach is unacceptable. Such circumstances impose significant limitations on areas of possible applications of this theory.

The Basics of information theory involve consideration of various issues, including those directly related to the transmission and reception of data. The main scheme of communication, which is seen in the doctrine, as follows. Information theory and coding Believes that the data are generated by a message source, which is a word or set of words, written letters of a certain alphabet. The source of the message can be text in any natural or artificial languages, human speech, a database and a mathematical model that produces a sequence of letters. The transmitter converts the message into a signal corresponding to the physical nature of the communication channel-the medium for signal transmission. While passing itself can be influenced by interference introduces distortions in the values of the information parameters. The receiver recovers the original message from the received distortion signal. In the restored message comes to the addressee-a person or a technical device.

The message Source has a statistical character, i.e. the appearance of each message is determined by a certain probability. Information theory Shannon believes that if the probability of the message is equal to one, i.e. his appearance significantly and uncertainty is not, I think that it conveys no information.

One of the important problems of information theory considers the harmonization of the communication channel and information source properties message. The throughput is the unit in 1 bit per second.

One of the problems of communication systems is interference in the path of the useful signal. Shannon's theorem unfortunately does not give us a specific method of dealing with such. The easiest method of elimination, which consists in repeated repetition of messages is not very efficient, as it requires large amount of time to transfer information. Greater efficiency makes the use of codes that detect and correct transmission errors of information.

 


Article in other languages:

AR: https://www.tostpost.com/ar/cars/7586-what-is-the-exam-in-the-traffic-police.html

BE: https://www.tostpost.com/be/a-tamab-l/13550-shto-zh-uya-lyae-saboy-ekzamen-u-d-bdr.html

DE: https://www.tostpost.com/de/autos/13553-was-ist-eine-pr-fung-in-der-verkehrspolizei.html

ES: https://www.tostpost.com/es/coches/13560-que-es-un-examen-en-el-gbdd.html

HI: https://www.tostpost.com/hi/cars/7592-what-is-the-exam-in-the-traffic-police.html

JA: https://www.tostpost.com/ja/cars/7588-what-is-the-exam-in-the-traffic-police.html

KK: https://www.tostpost.com/kk/avtomobil-der/13553-b-l-b-ld-red-emtihan-gibdd.html

PL: https://www.tostpost.com/pl/samochody/13540-co-to-jest-egzamin-do-policji.html

PT: https://www.tostpost.com/pt/carros/13534-o-que-um-exame-de-pol-cia-de-tr-nsito.html

TR: https://www.tostpost.com/tr/arabalar/13556-nedir-bu-s-nav-traf-k-polisi.html

UK: https://www.tostpost.com/uk/avtomob-l/13550-scho-zh-yavlya-soboyu-spit-v-gibdd.html

ZH: https://www.tostpost.com/zh/cars/8252-what-is-the-exam-in-the-traffic-police.html






Alin Trodden - author of the article, editor
"Hi, I'm Alin Trodden. I write texts, read books, and look for impressions. And I'm not bad at telling you about it. I am always happy to participate in interesting projects."

Comments (0)

This article has no comment, be the first!

Add comment

Related News

Introduction to an essay about war in literature. Essay-argument about the war

Introduction to an essay about war in literature. Essay-argument about the war

War – one of the most complicated of topics on which students write essays. It is not enough to summarize the events necessary to give their own rating. The introduction to the essay on war in literature – an important...

Guantanamo: prison or hell?

Guantanamo: prison or hell?

Is in the South-East of Cuba city, founded by the French and Catalans. In 2020 it will be 200 years old. It is a typical Cuban town of medium size. it has “fans” of a modern building, beautiful Church, several samples ...

The formula of oxygen. Periodic table of elements - oxygen

The formula of oxygen. Periodic table of elements - oxygen

the Chemical element oxygen is in the second period of the VI-th main group legacy short version of the periodic table. Under the new standards numbering — is the 16th group. The decision was made by IUPAC in 1988. The formu...

Text types and their characteristics

Text types and their characteristics

Each text consists of connected sentences, or paragraphs, which are combined in a single unit a specific theme and main idea. All the sentence have a semantic relationship, which builds the hierarchy of the parts in meaning, impor...

The perfect and the imperfect form of the verb

The perfect and the imperfect form of the verb

 the verb aspect in the Russian language, is a consistent grammatical category, as is found in all forms of this part of speech. The same reason allows it to be regarded as predicative categories, as it can be realized not on...

Where the Arctic, Antarctic and Antarctica: the main differences and interesting facts

Where the Arctic, Antarctic and Antarctica: the main differences and interesting facts

Where is the Arctic and Antarctic? And what is the difference between these areas of Land from each other? This question puzzles many people, even if they conscientiously studied geography in school. Answer it will help our articl...