Pattern Recognition and Classification Theory

Pattern Recognition and Classification TheoryAssignment 2 of Pattern recognition should contain the disciplineification theory. The topics should come homeIntroduction to Pattern Recognition, including a) The concept of pattern recognition and its applications. b) Basic timbers of a typical pattern recognition task. c) Popular techniques utilise in these steps. d) motley application beas of pattern recognition research.Bayesian classification rule, prior, posterior, loss function, risk, and minimum error rate classification.Discriminant functions, Normal densities and application of Bayesian rule to normal densities with 3 different cases of variances and covariance matrices discussed in book.As the name indicates, the pattern recognition is the classification of a pattern to one of the pre-specified classes. The process of understanding or recognizing the patterns by victorious the raw entropy from a sensor, convert that raw data into roughly meta data by pre-processing th at raw data, producing segments of the data through some sort of partitioning process and the pass those segment through some feature extractor which lead the purification of the raw data to be understood by the Classifier. ground on the feature extracted will classify it to a certain class which is already defined by the determination boundary. The decision boundary is obtained from a serial of training data and the cost related to it.In short, the process of identifying object or pattern into some sort of classes based on some features which are been described by the decision rule. A simple example for it the identification of the sea thick and salmon search passing through a conveyer belt. Certain features same the height, width and lightness can be used to develop a decision boundary and put any fish into its respected class (sea bass or salmon).It is the abridgment of in what way the machines observe the environment, come to know about the different patterns and make a r ational decision about the class of the patterns.A typical pattern recognition system consists of the following componentsPhysical EnvironmentData Acquisition/SensingPre-ProcessingFeature ExtractionFeaturesClassificationPost-Processing ending MakingThe above mentioned components are given in the Figure 1.Figure 1 Components of a Pattern Recognition System.How to overcome the insufficiency of vector blank?Numerous amount of training data.Anonymous distributions of classes.Unidentified problem complexity.Generalization problems.Evaluation problems.Given below are few of the pattern recognition dominance research areasAdaptive signal processingMachine learning imitation neural networksRobotics and visionCognitive sciencesMathematical statisticsNonlinear optimizationExploratory data analysisFuzzy and genetic systemsDetection and estimation theory egg languagesStructural modelingBiological cyberneticsComputational neurosciencePattern recognition has outnumbered amount of applications, some of which are as followsImage processingComputer visionSpeech recognitionMultimodal interfacesAutomated target recognitionOptical character recognition unstable analysisMan and machine diagnosticsFingerprint identificationIndustrial inspectionFinancial forecastMedical diagnosisECG signal analysisGiven below are the fundamental steps involved in pattern recognitionSensing The pattern recognition systems require a sensor at the input in order to take raw data from the environment into the system.Segmentation It is do after the pre-processing step. In some systems this is the pre-processing step used for converting the raw data into some sorted data for the feature extraction.Feature Extraction Some specific parameters of the pattern are measured in this step like length in the fish example.Classification The patterns are then classified through some sort of classifiers like Bayesian Classifier. Classification is done for putting the pattern into a specific class or category e.g. sea bass or salmon.Post Processing This step is done for just improvement of the performance.Figure 2 Steps involved in Pattern Recognition.Classification techniques Bayes classifier, HMM, Kth Nearest Neighbor (KNN), Artificial Neural Network (ANN), view as Vector Machines (SVM), Training (parameter finding) testing (decoding) etc.Data representation techniquesThe compacting technique is used for improving the characteristics features of data using various transformation methods like the Fourier modify method, WT etc.Dimensionality reductionReduce the data dimensions by removing the mutu completelyy correlated features which results in the reduction of the common information to produce a set of nearly real informative parameters.e.g. Principle Component Analysis, Linear Discriminant Analysis etc. metamorphoseationsVarious transformation techniques are also used like Fourier Transforms, Fast Fourier Transform etc.The following are the potential research areas in the field of patt ern recognitionAdaptive signal processingMachine learningArtificial neural networksRobotics and visionCognitive sciencesMathematical statisticsNonlinear optimizationExploratory data analysisFuzzy and genetic systemsDetection and estimation theoryFormal languagesStructural modelingBiological cyberneticsComputational neuroscienceThe hazard of a state of nature that show how likely is that, that particular state of nature would occur. For example, in the fish example it is given that the prior of the salmon is 0.85. This mean that salmon is 85% more likely to appear than the sea bass. If number of classes are c, thenIt is the probability of a specific state of nature given that observables have occurred. Mathematically,Notice that,It shows the cost related to each wrong action or decision we take. Mathematically,The zero-one is the most commonly used loss function. It assigns zero on no loss in case of correct decision while in case of untimely decision, it takes a uniform unit loss. Mathematically,The expected loss is also called as conditional risk. It is defined as the summation of the product of loss occurred from each decision to its posterior probability. MathematicallyOverall risk is given byFrom above equation we come to know that by selecting only those action (.) that minimize the for all values of x will minimize the overall risk which is directly associated with the error thus minimize the error rate.