Umělé neuronové sítě

Neuron

Jak je zobrazeno na obrázku

a1~jsou součástí vstupního vektoru

w1~wnaneuronuneuronuVáha dotyku

bistheoffset

fistransferfunkce, obvykle nelineární funkce.Následující výchozíishardlim()

stejný výstup neuronu

Mathematicalrepresentationt=f(WA'+b)

Wistheweight vector

A je vstupní vektor, A je transpozice vektoru

bistheoffset

fisthetransferfunction

Visible,anerveThefunctionoftheelementistoobtainascalarresultthroughanonlineartransferfunctionafterobtainingtheinnerproductoftheinputvectorandtheweightvector.

Theroleofasingleneuron:divideann-dimensionalvectorspacewithahyperplaneintotwoparts(calledthejudgmentboundary),givenaninputvector,theneuroncanjudgethatthisvectorislocatedinthehyperplane.Whichsideoftheplane.

Rovnicehyperroviny:Wp+b=0

Vektor hmotnosti

odsazení

ponthehyperplaneVector

Basicfeatures

Artificialneuralnetworkisanonlinear,adaptiveinformationprocessingsystemcomposedofalargenumberofinterconnectedprocessingunits.Itisproposedonthebasisoftheresultsofmodernneuroscienceresearch,andattemptstoprocessinformationbysimulatingtheprocessingandmemoryinformationofthebrain'sneuralnetwork.Artificialneuralnetworkhasfourbasiccharacteristics:

(1)Non-linearityNon-linearrelationshipisauniversalcharacteristicofnature.Thewisdomofthebrainisanon-linearphenomenon.Artificialneuronsareintwodifferentstatesofactivationorinhibition.Thisbehaviorismathematicallyexpressedasanonlinearrelationship.Anetworkcomposedofthresholdneuronshasbetterperformance,andcanimprovefaulttoleranceandstoragecapacity.

(2)Non-limitationAneuralnetworkisusuallycomposedofmultipleneuronsconnectedextensively.Theoverallbehaviorofasystemnotonlydependsonthecharacteristicsofasingleneuron,butalsomaybemainlydeterminedbytheinteractionandinterconnectionbetweentheunits.Simulatethenon-limitationofthebrainthroughalargenumberofconnectionsbetweenunits.Associativememoryisatypicalexampleofnon-limitation.

(3)VeryqualitativeArtificialneuralnetworkhastheabilityofself-adaptation,self-organization,andself-learning.Notonlycantheinformationprocessedbytheneuralnetworkhavevariouschanges,butwhileprocessingtheinformation,thenonlineardynamicsystemitselfisalsoconstantlychanging.Iterativeprocessisoftenusedtodescribetheevolutionprocessofthedynamicsystem.

(4)Non-convexityTheevolutiondirectionofasystemwilldependonaspecificstatefunctionundercertainconditions.Forexample,theenergyfunction,itsextremevaluecorrespondstotherelativelystablestateofthesystem.Non-convexitymeansthatthisfunctionhasmultipleextremevalues,sothesystemhasmultiplestableequilibriumstates,whichwillleadtothediversityofsystemevolution.

Inartificialneuralnetworks,neuronprocessingunitscanrepresentdifferentobjects,suchasfeatures,letters,concepts,orsomemeaningfulabstractpatterns.Therearethreetypesofprocessingunitsinthenetwork:inputunits,outputunitsandhiddenunits.Theinputunitacceptssignalsanddatafromtheexternalworld;theoutputunitrealizestheoutputofthesystem'sprocessingresults;thehiddenunitisaunitthatliesbetweentheinputandoutputunitsandcannotbeobservedfromtheoutsideofthesystem.Theconnectionweightbetweenneuronsreflectstheconnectionstrengthbetweenunits,andtherepresentationandprocessingofinformationisreflectedintheconnectionrelationshipofnetworkprocessingunits.Artificialneuralnetworkisakindofnon-programmed,adaptive,andbrain-styleinformationprocessing.Itsessenceistoobtainaparallelanddistributedinformationprocessingfunctionthroughnetworktransformationanddynamicbehavior,andtoimitatepeopleindifferentdegreesandlevels.Theinformationprocessingfunctionofthecranialnervoussystem.Itisaninterdisciplinarysubjectinvolvingneuroscience,thinkingscience,artificialintelligence,computerscienceandmanyotherfields.

Artificialneuralnetworkisaparalleldistributedsystem.Itadoptsacompletelydifferentmechanismfromtraditionalartificialintelligenceandinformationprocessingtechnology.Itovercomesthetraditionalartificialintelligencebasedonlogicalsymbolsinprocessingintuitiveandunstructuredinformation.Theshortcomingsofithavethecharacteristicsofself-adaptation,self-organizationandreal-timelearning.

Developmenthistory

In1943,psychologistW.S.McCullochandmathematicallogicianW.Pittsestablishedneuralnetworksandmathematicalmodels,calledMPmodels.TheyproposedaformalmathematicaldescriptionofneuronsandanetworkstructuremethodthroughtheMPmodel,andprovedthatasingleneuroncanperformlogicalfunctions,thusopeningtheeraofartificialneuralnetworkresearch.In1949,psychologistsproposedtheideaof​​variablesynapticconnectionstrength.Inthe1960s,artificialneuralnetworkswerefurtherdeveloped,andmorecompleteneuralnetworkmodelswereproposed,includingperceptronsandadaptivelinearcomponents.Aftercarefullyanalyzingthefunctionsandlimitationsoftheneuralnetworksystemrepresentedbytheperceptron,M.Minskyandotherspublishedthebook"Perceptron"in1969,pointingoutthattheperceptroncannotsolvetheproblemofhigher-orderpredicates.Theirargumentsgreatlyaffectedtheresearchofneuralnetworks,andtheachievementsofserialcomputersandartificialintelligenceatthattimeobscuredthenecessityandurgencyofdevelopingnewtypesofcomputersandnewwaysofartificialintelligence,makingtheresearchofartificialneuralnetworksatalowebb..Duringthisperiod,someartificialneuralnetworkresearchersarestillcommittedtothisresearch,andproposedadaptiveresonancetheory(ARTnetwork),self-organizingmap,cognitivemachinenetwork,andconductedresearchonneuralnetworkmathematicaltheory.Theaboveresearchhaslaidthefoundationfortheresearchanddevelopmentofneuralnetworks.In1982,J.J.Hopfield,aphysicistattheCaliforniaInstituteofTechnologyintheUnitedStates,proposedtheHopfieldneuralgridmodel,introducedtheconceptof"computationalenergy",andgaveajudgmentonnetworkstability.In1984,healsoproposedthecontinuous-timeHopfieldneuralnetworkmodel,whichmadepioneeringworkfortheresearchofneuralcomputers,andcreatedanewwayforneuralnetworkstobeusedforassociativememoryandoptimizedcalculations,whichstronglypromotedtheresearchofneuralnetworks.In1985,anotherscholarputforwardtheBoltzmannmodel,andusedstatisticalthermodynamicssimulatedannealingtechnologyinthestudytoensurethattheentiresystemtendstoagloballystablepoint.In1986,heconductedcognitivemicrostructureresearchandproposedthetheoryofparalleldistributedprocessing.In1986,Rumelhart,Hinton,WilliamsdevelopedtheBPalgorithm.RumelhartandMcClellandpublished"Paralleldistributionprocessing:explorationsinthemicrostructuresofcognition".Sofar,theBPalgorithmhasbeenusedtosolvealargenumberofpracticalproblems.In1988,Linskerproposedanewself-organizationtheoryforperceptronnetworks,andformedtheMaximumMutualInformationTheoryonthebasisofShanon'sinformationtheory,thusignitingthelightofNN-basedinformationapplicationtheory.In1988,BroomheadandLoweusedaradialbasisfunction(RBF)toproposeahierarchicalnetworkdesignmethod,thuslinkingthedesignofNNwithnumericalanalysisandlinearadaptivefiltering.Intheearly1990s,Vapniketal.proposedtheconceptofsupportvectormachines(SVM)andVC(Vapnik-Chervonenkis)dimensions.Theresearchofartificialneuralnetworkshasattractedtheattentionofvariousdevelopedcountries.TheUSCongresspassedaresolutiontodesignatethedecadebeginningonJanuary5,1990asthe"decadeofthebrain.""Year"becomesaglobalbehavior.InJapan's"RealWorldComputing(RWC)"project,theresearchofartificialintelligencehasbecomeanimportantcomponent.

Networkmodel

Theartificialneuralnetworkmodelmainlyconsidersthetopologicalstructureofthenetworkconnection,thecharacteristicsoftheneurons,andthelearningrules.Atpresent,therearenearly40neuralnetworkmodels,includingbackpropagationnetworks,perceptrons,self-organizingmaps,Hopfieldnetworks,Boltzmannmachines,adaptiveresonancetheory,etc.Accordingtothetopologicalstructureoftheconnection,theneuralnetworkmodelcanbedividedinto:

Forwardnetwork

Eachneuroninthenetworkacceptstheinputofthepreviouslevelandoutputstothenextlevel,thenetworkThereisnofeedbackinit,whichcanberepresentedbyadirectedacyclicgraph.Thiskindofnetworkrealizesthetransformationofthesignalfromtheinputspacetotheoutputspace,anditsinformationprocessingabilitycomesfromthemultiplerecombinationofsimplenon-linearfunctions.Thenetworkstructureissimpleandeasytoimplement.Thebackhaulnetworkisatypicalforwardnetwork.

Feedbacknetwork

Thereisfeedbackbetweenneuronsinthenetwork,whichcanberepresentedbyanundirectedcompletegraph.Theinformationprocessingofthiskindofneuralnetworkisthetransformationofstate,whichcanbeprocessedbydynamicsystemtheory.Thestabilityofthesystemiscloselyrelatedtotheassociativememoryfunction.HopfieldnetworkandBoltzmannmachinebelongtothistype.

Typesoflearning

Learningisanimportantcontentofneuralnetworkresearch,anditsadaptabilityisachievedthroughlearning.Accordingtochangesintheenvironment,theweightsareadjustedtoimprovethebehaviorofthesystem.TheHebblearningrulesproposedbyHebblaythefoundationfortheneuralnetworklearningalgorithm.Hebb'srulebelievesthatthelearningprocessultimatelyoccursatthesynapsesbetweenneurons,andthestrengthofsynapseschangeswiththeactivityofneuronsbeforeandaftersynapses.Onthisbasis,peoplehaveproposedvariouslearningrulesandalgorithmstomeettheneedsofdifferentnetworkmodels.Theeffectivelearningalgorithmenablestheneuralnetworktoconstructaninternalrepresentationoftheobjectiveworldthroughtheadjustmentofconnectionweights,andformauniqueinformationprocessingmethod.Informationstorageandprocessingarereflectedinthenetworkconnection.

Klasifikace

Accordingtodifferentlearningenvironments,neuralnetworklearningmethodscanbedividedintosupervisedlearningandunsupervisedlearning.Insupervisedlearning,thedataoftrainingsamplesisaddedtotheinputofthenetwork,andthecorrespondingexpectedoutputiscomparedwiththeoutputofthenetworktoobtainanerrorsignaltocontroltheadjustmentoftheweightconnectionstrength.Aftermultipletrainings,itconvergestooneDeterminedweight.Whenthesamplesituationchanges,theweightcanbemodifiedafterlearningtoadapttothenewenvironment.Neuralnetworkmodelsthatusesupervisedlearningincludebackpropagationnetworksandperceptrons.Inunsupervisedlearning,nostandardsamplesaregiveninadvance,andthenetworkisdirectlyplacedintheenvironment,andthelearningphaseandtheworkingphaseareintegrated.Atthistime,thechangeofthelearninglawobeystheevolutionequationoftheconnectionweight.ThesimplestexampleofunsupervisedlearningistheHebblearningrules.Competitivelearningrulesareamorecomplexexampleofunsupervisedlearning,whichadjustsweightsbasedonestablishedclusters.Self-organizingmapping,adaptiveresonancetheorynetwork,etc.arealltypicalmodelsrelatedtocompetitivelearning.

Analysismethod

Tostudythenonlineardynamicpropertiesofneuralnetworks,mainlyusingdynamicsystemtheory,nonlinearprogrammingtheoryandstatisticaltheorytoanalyzetheevolutionandattractionofneuralnetworksThenatureofthechild,explorethecooperativebehaviorandcollectivecomputingfunctionofneuralnetworks,andunderstandthemechanismofneuralinformationprocessing.Inordertoexplorethepossibilityofneuralnetworkprocessinginformationintermsofintegrityandambiguity,theconceptsandmethodsofchaostheorywillplayarole.Chaosisamathematicalconceptthatisquitedifficulttodefineprecisely.Generallyspeaking,"chaos"referstothenon-deterministicbehaviorinthedynamicsystemdescribedbythedeterministicequation,ordeterministicrandomness."Determinism"isbecauseitisproducedbyinternalreasonsratherthanexternalnoiseorinterference,while"randomness"referstoitsirregularandunpredictablebehavior,whichcanonlybedescribedbystatisticalmethods.Themaincharacteristicofachaoticdynamicsystemisitsstate'ssensitivedependenceoninitialconditions,andchaosreflectsitsinherentrandomness.Chaostheoryreferstothebasictheories,concepts,andmethodsthatdescribethenonlineardynamicsystemwithchaoticbehavior.Itunderstandsthecomplexbehaviorofthedynamicsystemasitsinherentexistenceintheexchangeofmatter,energy,andinformationwiththeoutsideworld.Structuralbehavior,notforeignandaccidentalbehavior,thechaoticstateisasteadystate.Thestationarystateofachaoticdynamicsystemincludes:static,stationaryquantity,periodicity,quasi-simultaneityandchaoticsolution.Thechaotictrajectoryistheresultofthecombinationofoverallstabilityandlocalinstability,andiscalledasingularattractor.Asingularattractorhasthefollowingcharacteristics:(1)asingularattractorisanattractor,butitisneitherafixedpointnoraperiodicsolution;(2)asingularattractorisindivisible,thatis,itcannotbedividedintotwoAndtwoormoreattractors;(3)Itisverysensitivetotheinitialvalue,anddifferentinitialvalues​​willleadtoverydifferentbehaviors.

Funkce a výhody

Charakteristiky a výhody umělých neuronových sítí se projevují hlavně ve třech aspektech:

First,ithasaself-learningfunction.Forexample,whenimplementingimagerecognition,onlyinputmanydifferentimagetemplatesandcorrespondingrecognitionresultsintotheartificialneuralnetwork,andthenetworkwillslowlylearntorecognizesimilarimagesthroughitsself-learningfunction.Theself-learningfunctionisparticularlyimportantforprediction.Itisexpectedthattheartificialneuralnetworkcomputerinthefuturewillprovidehumanbeingswitheconomicforecasts,marketforecasts,andprofitforecasts,anditsapplicationprospectsareverypromising.

Second,ithasLenovostoragefunction.Thiskindofassociationcanberealizedwiththefeedbacknetworkofartificialneuralnetwork.

Thirdly,ithastheabilitytofindoptimalsolutionsatahighspeed.Findinganoptimizedsolutiontoacomplexproblemoftenrequiresalotofcalculations.Usingafeedbackartificialneuralnetworkdesignedforacertainproblemandusingthecomputer'shigh-speedcomputingcapabilities,itmaybepossibletoquicklyfindanoptimizedsolution.

Směr výzkumu

Výzkum neuronové sítě lze rozdělit do dvou aspektů: teoretický výzkum a aplikovaný výzkum.

Theoreticalresearchcanbedividedintothefollowingtwocategories:

1.Usingneurophysiologicalandcognitivescientificresearchonhumanthinkingandintelligencemechanisms.

2.Usetheresearchresultsofneuralbasictheories,usemathematicalmethodstoexploreneuralnetworkmodelswithmorecompletefunctionsandsuperiorperformance,andin-depthstudyofnetworkalgorithmsandperformance,suchas:stability,convergence,andfaulttolerance,Robustness,etc.;developnewnetworkmathematicaltheories,suchasneuralnetworkdynamics,nonlinearneuralfields,etc.

Applicationresearchcanbedividedintothefollowingtwocategories:

1.Researchonsoftwaresimulationandhardwarerealizationofneuralnetworks.

2.Researchontheapplicationofneuralnetworksinvariousfields.Thesefieldsmainlyinclude

:rozpoznávání vzorů, zpracování signálů, znalostní inženýrství, expertní systémy, optimalizované kombinace, řízení robotů atd. S neustálým vývojem samotné teorie neuronové sítě, souvisejících teorií a souvisejících technologií se aplikace neuronových sítí jistě dostane do hloubky.

Developmenttrend

Theuniquenonlinearadaptiveinformationprocessingcapabilitiesofartificialneuralnetworksovercometheintuitionoftraditionalartificialintelligencemethods,suchaspattern,speechrecognition,andunstructuredinformationprocessing.Theshortcomingsof,makeitsuccessfullyappliedinthefieldsofneuralexpertsystem,patternrecognition,intelligentcontrol,combinationoptimization,predictionandsoon.Thecombinationofartificialneuralnetworkandothertraditionalmethodswillpromotethecontinuousdevelopmentofartificialintelligenceandinformationprocessingtechnology.Inrecentyears,artificialneuralnetworksaredevelopingmoredeeplyontheroadofsimulatinghumancognition,combiningwithfuzzysystems,geneticalgorithms,evolutionarymechanisms,etc.,toformcomputationalintelligence,becominganimportantdirectionofartificialintelligence,andwillbedevelopedinpracticalapplications..Theapplicationofinformationgeometrytotheresearchofartificialneuralnetworkshasopenedupanewwayforthetheoreticalresearchofartificialneuralnetworks.Theresearchofneuralcomputershasdevelopedrapidly,andproductshaveenteredthemarket.Thephotoelectriccombinedneuralcomputerprovidesgoodconditionsforthedevelopmentofartificialneuralnetworks.

Neuralnetworkshavebeenwellappliedinmanyfields,buttherearestillmanyaspectsthatneedtobestudied.Amongthem,thecombinationofneuralnetworkswiththeadvantagesofdistributedstorage,parallelprocessing,self-learning,self-organization,andnonlinearmapping,andothertechnologies,andtheresultinghybridmethodsandhybridsystems,havebecomeamajorresearchhotspot.Sinceothermethodsalsohavetheirownadvantages,combiningneuralnetworkswithothermethodscanlearnfromeachother'sstrengths,andthenobtainbetterapplicationeffects.Thecurrentworkinthisareaincludesthefusionofneuralnetworksandfuzzylogic,expertsystems,geneticalgorithms,waveletanalysis,chaos,roughsettheory,fractaltheory,evidencetheoryandgreysystems.

Následující analyzuje především spojení neuronových sítí a analýzy vln, chaosu, teorie hrubého nastavení a teorie fraktálů.

Kombinaceavlnové analýzy

In1981,theFrenchgeologistMorletwasseekingForgeologicaldata,throughcreativeresearchonthesimilaritiesanddifferences,characteristicsandfunctionstructureofFouriertransformandwindowedFouriertransform,theconceptof"waveletanalysis"wasfirstproposedandtheMorletwaveletnamedafterhimwasestablished.Since1986,duetothefoundationworkofYMeyer,S.MallatandIDaubechies,waveletanalysishasrapidlydevelopedintoanemergingdiscipline."WaveletsandOperators"byMeyerand"TenLecturesonWavelets"byDaubechiesarethemostauthoritativeworksinthefieldofwaveletresearch.

WavelettransformisabreakthroughinFourieranalysismethod.Itnotonlyhasgoodlocalizationpropertiesinboththetimedomainandthefrequencydomain,butalsohasgoodresolutionforlow-frequencysignalsinthefrequencydomainandforhigh-frequencysignalsinthetimedomain,sothatitcangatheranydetailsoftheobject.Waveletanalysisisequivalenttoamathematicalmicroscope,withfunctionsofzoomingin,zoomingout,andpanning.Itcanstudythedynamiccharacteristicsofthesignalbycheckingthechangesunderdifferentmagnifications.Therefore,waveletanalysishasbecomeapowerfultoolinmanyfieldssuchasgeophysics,signalprocessing,imageprocessing,andtheoreticalphysics.

Waveletneuralnetworkcombinesthegoodtime-frequencylocalizationcharacteristicsofwavelettransformwiththeself-learningfunctionofneuralnetwork,soithasstrongapproximationabilityandfaulttolerance.Inthecombinationmethod,thewaveletfunctioncanbeusedasthebasisfunctiontoconstructtheneuralnetworktoformthewaveletnetwork,orthewavelettransformcanbeusedastheinputpre-processingtoolofthefeedforwardneuralnetwork,thatis,theprocessstatesignalisprocessedwiththemulti-resolutioncharacteristicsofthewavelettransform.Realizethesignal-to-noiseseparation,andextractthestatecharacteristicsthathavethegreatestimpactontheprocessingerror,astheinputoftheneuralnetwork.

Waveletneuralnetworkhasapplicationsinmotorfaultdiagnosis,high-voltagepowergridfaultsignalprocessingandprotectionresearch,bearingandothermechanicalfaultdiagnosis,andmanyotheraspects.Waveletneuralnetworkisusedforintelligentcontrolofinductionservomotors.Thesystemhasgoodtrackingcontrolperformanceandgoodrobustness.Ituseswaveletpacketneuralnetworkforintelligentdiagnosisofcardiovasculardiseases,waveletlayerperformsadaptivefeatureextractionintimeandfrequencydomain,andforwardneuralnetworkisusedforclassification.Thecorrectclassificationratereached94%.

Whilewaveletneuralnetworkisusedinmanyaspects,itstillhassomeshortcomings.Startingfromtherequirementsofextractionaccuracyandreal-timewavelettransform,itisnecessarytoconstructsomespecialwaveletbasesadaptedtotheapplicationrequirementsaccordingtotheactualsituationinordertoachievebetterresultsintheapplication.Inaddition,thereal-timerequirementsintheapplicationalsoneedtocombinethedevelopmentofDSPanddevelopspecialprocessingchipstomeetthisrequirement.

Chaosneurální síť

ThefirstdefinitionofchaoswasfirstproposedbyLi-Yorkeinthe1970s.Becauseofitswideapplicationvalue,ithasreceivedwidespreadattentionfromallaspectssinceitsappearance.Chaosisanirregularmovementthatappearsinacertainsystem.Chaosisarelativelycommonphenomenonthatexistsinnonlinearsystems.Chaoticmovementhasthecharacteristicsofergodicityandrandomness,whichcanbeadjustedwithinacertainrange.Ittraversesallstateswithoutrepeatingitsownlaws.Thechaostheorydeterminesthechaosofnonlineardynamics.Thepurposeistorevealthesimplelawsthatmaybehiddenbehindseeminglyrandomphenomena,inordertodiscoverthecommonlawsthatalargeclassofcomplexproblemsgenerallyfollow.

In1990,Kaihara,T.Takabe,andM.Toyodaetal.firstproposedachaoticneuralnetworkmodelbasedonthechaoticcharacteristicsofbiologicalneurons,andintroducedchaosintotheneuralnetwork,makingtheartificialneuralnetworkhavechaoticbehavior.Itisclosertotheactualhumanbrainneuralnetwork,sothechaoticneuralnetworkisconsideredtobeoneoftheintelligentinformationprocessingsystemsthatcanrealizeitsreal-worldcalculations,andithasbecomeoneofthemainresearchdirectionsofneuralnetworks.

ComparedwiththeconventionaldiscreteHopfieldneuralnetwork,thechaoticneuralnetworkhasrichernonlineardynamiccharacteristics,mainlyasfollows:theintroductionofchaoticdynamicbehaviorintotheneuralnetwork;thesynchronizationofthechaoticneuralnetworkCharacteristics;attractorsofchaoticneuralnetworks.

Intheactualapplicationofneuralnetwork,whentheinputofthenetworkchangesgreatly,theinherentfaulttoleranceoftheapplicationnetworkisofteninsufficient,andamnesiaoftenoccurs.Thedynamicmemoryofchaoticneuralnetworkbelongstothedeterministicdynamicmotion.Thememoryoccursonthetrajectoryofthechaoticattractor.Throughcontinuousmotion(recallprocess),thememorypatternisassociatedonebyone,especiallyforthosestatespacedistributionsthatarecloseorpartiallyoverlapped.Thememorymodelofthechaoticneuralnetworkcanalwaysbereproducedandidentifiedthroughdynamicassociativememorywithoutconfusion.Thisistheuniqueperformanceofthechaoticneuralnetwork,whichwillgreatlyimprovethememoryabilityoftheHopfieldneuralnetwork.Theattractiondomainofthechaoticattractorexists,whichformstheinherentfault-tolerantfunctionofthechaoticneuralnetwork.Thiswillplayanimportantroleincomplexpatternrecognition,imageprocessingandotherengineeringapplications.

Anotherreasonfortheattentionofchaoticneuralnetworksisthatchaosexistsintherealneuronsandneuralnetworksoforganismsandplaysacertainrole.Theelectrophysiologicalexperimentsofzoologyhaveconfirmedthis.

Becauseofitscomplexdynamiccharacteristics,chaoticneuralnetworkshavereceivedgreatattentioninthefieldsofdynamicassociativememory,systemoptimization,informationprocessing,andartificialintelligence.Aimingatthechaoticneuralnetworkwithassociativememoryfunction,butitssearchprocessisunstable,acontrolmethodisproposedtocontrolthechaoticphenomenoninthechaoticneuralnetwork.Theapplicationofchaoticneuralnetworkincombinatorialoptimizationproblemisstudied.

Inordertobetterapplythedynamiccharacteristicsofthechaoticneuralnetworkandeffectivelycontrolthechaoticphenomenonthatexists,itisstillnecessarytofurtherimproveandadjustthestructureofthechaoticneuralnetwork,aswellasthechaoticneuralnetwork.Furtherresearchonnetworkalgorithms.

BasedonRoughSetTheory

TheRoughSetstheorywasfirstproposedbyProfessorZ.PawlakoftheWarsawUniversityofTechnologyin1982.ItisaAnalyzethemathematicaltheoryofdata,andstudythemethodsofexpression,learning,andinductionofincompletedataandinaccurateknowledge.Roughsettheoryisanewmathematicaltoolfordealingwithfuzzyanduncertainknowledge.Itsmainideaistoderivethedecision-makingorclassificationrulesoftheproblemthroughknowledgereductionunderthepremiseofkeepingtheclassificationabilityunchanged.Atpresent,roughsettheoryhasbeensuccessfullyappliedinthefieldsofmachinelearning,decisionanalysis,processcontrol,patternrecognitionanddatamining.

Thecommonpointofroughsetandneuralnetworkisthattheycanworkwellinthenaturalenvironment.However,theroughsettheorymethodsimulatestheabstractlogicalthinkingofhumanbeings,whiletheneuralnetworkmethodsimulatesvisualintuitivethinking.Thetwohavedifferentcharacteristics.Theroughsettheorymethodtakesasinputvariousqualitative,quantitativeormixedinformationthatisclosertohowpeopledescribethings.Themappingrelationshipbetweeninputspaceandoutputspaceissimplifiedthroughasimpledecisiontable,whichtakesintoaccountthedifferencesinknowledgeexpressionTheimportanceofattributesdetermineswhichknowledgeisredundantandwhichknowledgeisuseful.Neuralnetworkusestheideaof​​non-linearmappingandparallelprocessingmethodstoexpresstheimplicitfunctioncodingofinputandoutputrelatedknowledgewiththestructureofneuralnetworkitself.

Therearetwobigdifferencesbetweentheroughsettheorymethodandtheneuralnetworkmethodinprocessinginformation:oneisthatneuralnetworkprocessinginformationgenerallycannotsimplifythedimensionoftheinputinformationspace.Whenthespatialdimensionislarge,thenetworkisnotonlycomplexinstructure,butalsolongintrainingtime;whiletheroughsetmethodcannotonlyremoveredundantinputinformationbydiscoveringtherelationshipbetweendata,butalsosimplifytheexpressionspacedimensionofinputinformation.Thesecondisthattheroughsetmethodismoresensitivetonoiseintheprocessingofactualproblems,sotheresultsoflearninginferencewithnoise-freetrainingsamplesarenoteffectiveinnoisyenvironments.Theneuralnetworkmethodhasabetterabilitytosuppressnoiseinterference.

Sothetwoarecombined,andtheroughsetmethodisusedtopreprocesstheinformationfirst,thatis,theroughsetnetworkisusedasthefrontsystem,andthentheinformationstructureaftertheroughsetmethodispreprocessedtoformaneuralnetworkInformationprocessingsystem.Throughthecombinationofthetwo,notonlythenumberofattributesexpressedbytheinformationcanbereduced,andthecomplexityoftheneuralnetworkconstitutingthesystem,butalsohasstrongfaulttoleranceandanti-interferencecapabilities,providingapowerfultoolforhandlinguncertainandincompleteinformationway.

Atpresent,thecombinationofroughsetandneuralnetworkhasbeenappliedinspeechrecognition,expertsystem,datamining,faultdiagnosisandotherfields.Neuralnetworkandroughsetareusedforautomaticrecognitionofsoundsourcelocation,andneuralnetworkSumandroughsetsareusedintheknowledgeacquisitionofexpertsystemstoachievebetterresultsthantraditionalexpertsystems.Roughsetsareusedforprocessinguncertainandinaccuratedata,andneuralnetworksareusedforclassification.

Althoughthecombinationofroughsetandneuralnetworkhasbeenappliedinmanyfieldsofresearch,inordertomakethismethodplayagreaterrole,thefollowingissuesneedtobeconsidered:theroughsettheorymethodthatsimulateshumanabstractlogicalthinkingandTheneuralnetworkmethodofsimulatingvisualandintuitivethinkingismoreeffectivecombination;thedevelopmentoftheintegratedsoftwareandhardwareplatformofthetwoimprovesitspracticability.

Kombinace s fraktálovou teorií

SinceBenoitB.Mandelbrot,aprofessorintheDepartmentofMathematicsatHarvardUniversity,introducedtheconceptoffractalinthemid-1970s,fractalFractalgeometryhasdevelopedintoascientificmethodology—fractaltheory,andisknownasthecreationofanimportantstageofmathematicsinthe20thcentury.Ithasbeenwidelyusedinalmostallfieldsofnaturalsciencesandsocialsciences,andhasbecomeoneofthefrontierresearchtopicsinmanydisciplinesintheworldtoday.

Duetotherapiddevelopmentinmanydisciplines,fractalhasbecomeadisciplinethatdescribestheregularityofmanyirregularthingsinnature.Ithasbeenwidelyusedinvariousfieldssuchasbiology,geography,astronomy,andcomputergraphics.

Usingfractaltheorytoexplaintheirregular,unstableandhighlycomplexstructurephenomenainnaturecanreceivesignificantresults,andthecombinationofneuralnetworkandfractaltheorymakesfulluseofneuralnetworknon-Theadvantagesoflinearmapping,computingpower,andself-adaptationcanachievebetterresults.

Theapplicationareasoffractalneuralnetworksincludeimagerecognition,imagecoding,imagecompression,andfaultdiagnosisofmechanicalequipmentsystems.Thefractalimagecompression/decompressionmethodhastheadvantagesofhighcompressionrateandlowlossrate,butitscomputingpowerisnotstrong.Becausetheneuralnetworkhasthecharacteristicsofparalleloperation,theneuralnetworkisusedinthefractalimagecompression/decompression,whichimprovestheoriginalThecomputingpowerofthemethod.Combiningneuralnetworkandfractalfortherecognitionoffruitshape.Firstly,theirregularityofseveralfruitcontourdataisobtainedbyusingfractal,andthenthethree-layerneuralnetworkisusedtoidentifythedata,andthentheirregularityisevaluated.

Fractalneuralnetworkshaveachievedmanyapplications,buttherearestillsomeissuesworthyoffurtherstudy:thephysicalmeaningofthefractaldimension;thecomputersimulationandpracticalapplicationresearchoffractals.Withthecontinuousdeepeningofresearch,thefractalneuralnetworkwillsurelybecontinuouslyimprovedandachievebetterapplicationeffects.?

Applicationanalysis

Afterdecadesofdevelopment,neuralnetworktheoryhasachievedextensivesuccess.Thefollowingdescribestheapplicationstatusofneuralnetworksinsomefields.

ApplicationofArtificialNeuralNetworksintheInformationField

Indealingwithmanyproblems,thesourceofinformationisneithercomplete,butalsocontainsillusions.Decision-makingrulessometimescontradicteachotherandsometimeshavenorulestofollow.Thisbringsgreatdifficultiestotraditionalinformationprocessingmethods,butneuralnetworkscanhandletheseproblemswellandgivereasonablerecognitionandjudgment.

1.Zpracování informací

Theproblemstobesolvedbymoderninformationprocessingareverycomplex.Artificialneuralnetworkshavethefunctionofimitatingorreplacinghumanthinking,andcanrealizeautomaticdiagnosis,Problemsolving,tosolveproblemsthattraditionalmethodscannotoraredifficulttosolve.Theartificialneuralnetworksystemhashighfaulttolerance,robustnessandself-organization.Eveniftheconnectionlineisdamagedtoahighdegree,itcanstillbeinanoptimizedworkingstate.Thisiswidelyusedinmilitarysystemelectronicequipment.application.Theexistingintelligentinformationsystemsincludeintelligentinstruments,automatictrackingandmonitoringinstrumentsystems,automaticcontrolandguidancesystems,automaticfaultdiagnosisandalarmsystems,etc.

2.Rozpoznávání vzorů

Patternrecognitionistheprocessingandanalysisofvariousformsofinformationthatcharacterizethingsorphenomenatodescribe,identify,classifyandexplainthingsorphenomenatheprocessof.ThetechnologyisbasedonBayesianprobabilitytheoryandShennong'sinformationtheory,andtheinformationprocessingprocessisclosertothelogicalthinkingprocessofthehumanbrain.Therearetwobasicpatternrecognitionmethods,namelystatisticalpatternrecognitionmethodsandstructuralpatternrecognitionmethods.Artificialneuralnetworkisacommonmethodinpatternrecognition.Theartificialneuralnetworkpatternrecognitionmethoddevelopedinrecentyearshasgraduallyreplacedthetraditionalpatternrecognitionmethod.Afteryearsofresearchanddevelopment,patternrecognitionhasbecomethecurrentrelativelyadvancedtechnology,whichiswidelyusedintextrecognition,voicerecognition,fingerprintrecognition,remotesensingimagerecognition,facerecognition,handwrittencharacterrecognition,industrialfaultdetection,precisionguidance,etc.aspect.

ApplicationofArtificialNeuralNetworkinMedicine

Duetothecomplexityandunpredictabilityofthehumanbodyanddisease,themanifestationofbiologicalsignalsandinformation,thelawofchange(self-changeandChangesaftermedicalintervention),itsdetectionandsignalexpression,dataandinformationanalysis,decision-makingandmanyotheraspectsareverycomplexnon-linearconnections,suitablefortheapplicationofartificialneuralnetworks.Thecurrentresearchinvolvesalmosteveryaspectfrombasicmedicinetoclinicalmedicine,mainlyusedinthedetectionandautomaticanalysisofbiologicalsignals,medicalexpertsystems,etc.

1. Detekce a analýza biologických signálů

Mostmedicaltestingequipmentoutputsdataintheformofcontinuouswaveforms,whicharethebasisfordiagnosis.Artificialneuralnetworkisanadaptivedynamicsystemconnectedbyalargenumberofsimpleprocessingunits.Ithasthefunctionsofmassiveparallelism,distributedstorage,andself-organizationofadaptivelearning.Itcanbeusedtosolvebiomedicalsignalanalysisandprocessing.Problemsthataredifficultorimpossibletosolvebyconventionallaw.Theapplicationofneuralnetworkinthedetectionandprocessingofbiomedicalsignalsmainlyfocusesontheanalysisofbrainelectricalsignals,theextractionofauditoryevokedpotentialsignals,therecognitionofmyoelectricandgastrointestinalelectricalsignals,thecompressionofelectrocardiographicsignals,andtherecognitionofmedicalimages.Andprocessingetc.

2. Lékařský expertní systém

Thetraditionalexpertsystemistostoretheexpert’sexperienceandknowledgeinthecomputerintheformofrules,buildaknowledgebase,anduselogicalreasoningtoproceed.Medicaldiagnosis.However,inpracticalapplications,asthescaleofthedatabaseincreases,itwillleadtoan"explosion"ofknowledge,andtherewillalsobea"bottleneck"probleminthewayofacquiringknowledge,resultinginlowworkefficiency.Theneuralnetworkbasedonnonlinearparallelprocessinghaspointedoutanewdevelopmentdirectionfortheresearchofexpertsystem,solvedtheaboveproblemsofexpertsystem,andimprovedtheabilityofreasoning,self-organization,andself-learningofknowledge,sothatneuralnetworkisusedbymedicalexperts.Thesystemhasbeenwidelyusedanddeveloped.Intheresearchofanesthesiaandcriticalmedicineandotherrelatedfields,itinvolvestheanalysisandpredictionofmultiplephysiologicalvariables.Therearesomeundiscoveredornoevidenceofrelationshipsandphenomenainclinicaldata,signalprocessing,andautomaticdiscriminationanddetectionofinterferencesignals.,Thepredictionofvariousclinicalconditions,etc.,canbeappliedtoartificialneuralnetworktechnology.

Aplikace umělých neuronových sítí v ekonomické oblasti

1. Předpověď tržní ceny

Theanalysisofcommoditypricechangescanbeattributedtotheinfluenceofmarketsupplyanddemand.Comprehensiveanalysisofmanyfactors.Traditionalstatisticaleconomicsmethodsaredifficulttomakescientificpredictionsofpricechangesduetotheirinherentlimitations,whileartificialneuralnetworksareeasytodealwithincomplete,fuzzy,uncertainorunobviousdata,soartificialneuralnetworksareusedforPricepredictionhasanadvantagethattraditionalmethodscannotcompare.Startingfromthemechanismfordeterminingmarketprices,establishingamoreaccurateandreliablemodelbasedoncomplexandchangeablefactorssuchasthenumberofhouseholds,percapitadisposableincome,loaninterestrates,andurbanizationlevelsthataffectcommodityprices.Themodelcanscientificallypredictthetrendofcommoditypricesandobtainaccurateandobjectiveevaluationresults.

2.Posouzení rizika

Riskreferstotheeconomicorfinancialloss,naturaldamageornaturaldamagecausedbytheuncertaintyintheprocessofengaginginaparticularactivity.Possibilityofinjury.Thebestwaytopreventrisksistomakescientificpredictionsandassessmentsofrisksinadvance.Thepredictionideaof​​applyingartificialneuralnetworkistoconstructthestructureandalgorithmofthecreditriskmodelsuitablefortheactualsituationaccordingtothespecificrealisticrisksources,obtaintheriskevaluationcoefficient,andthendeterminethesolutiontotheactualproblem.Usingthismodelforempiricalanalysiscanmakeupfortheinsufficiencyofsubjectiveevaluationandachievesatisfactoryresults.

Theapplicationofartificialneuralnetworkinthecontrolfield

Theartificialneuralnetworkisoutstandingduetoitsuniquemodelstructureandinherentnonlinearsimulationcapabilities,aswellashighdegreeofself-adaptationandfaulttolerance.Characteristic,ithasbeenwidelyusedinthecontrolsystem.Basedontheframestructureofvariouscontrollers,anonlinearadaptivelearningmechanismisaddedtomakethecontrollerhavebetterperformance.Thebasiccontrolstructureincludessupervisorycontrol,directinversemodelcontrol,modelreferencecontrol,internalmodelcontrol,predictivecontrol,optimaldecisioncontrolandsoon.

ApplicationofArtificialNeuralNetworkintheTransportationField

Thisyear,peoplehavebegunin-depthresearchontheapplicationofneuralnetworkinthetransportationsystem.Transportationproblemsarehighlynon-linear,andtheavailabledataareusuallylargeandcomplex.Usingneuralnetworkstodealwithrelatedproblemshasitshugeadvantages.Thescopeofapplicationinvolvesthesimulationofcardriverbehavior,parameterestimation,roadmaintenance,vehicledetectionandclassification,trafficpatternanalysis,cargooperationmanagement,trafficflowprediction,transportationstrategyandeconomy,transportationenvironmentalprotection,airtransportation,automaticnavigationofshipsandGoodresultshavebeenachievedinareassuchasshipidentification,subwayoperationandtrafficcontrol.

Applicationofartificialneuralnetworkinthefieldofpsychology

Fromtheformationofneuralnetworkmodel,ithasaninseparableconnectionwithpsychology.Theneuralnetworkisabstractedfromtheinformationprocessingfunctionoftheneuron,andthetrainingoftheneuralnetworkreflectsthecognitiveprocessessuchasperception,memory,andlearning.Throughcontinuousresearch,peoplearechangingthestructuralmodelandlearningrulesofartificialneuralnetworks,discussingthecognitivefunctionsofneuralnetworksfromdifferentangles,andlayingasolidfoundationfortheirresearchinpsychology.Inrecentyears,theartificialneuralnetworkmodelhasbecomeanindispensabletoolforexploringthemechanismsofadvancedmentalprocessessuchassocialcognition,memory,andlearning.Theartificialneuralnetworkmodelcanalsostudythecognitivedeficitsofpatientswithbraininjuryandchallengethetraditionalcognitivepositioningmechanism.

Althoughartificialneuralnetworkshavemadesomeprogress,therearestillmanyshortcomings,suchas:theapplicationareaisnotwideenough,theresultsarenotaccurateenough;thetrainingspeedofexistingmodelalgorithmsisnothighenough;theintegrationofalgorithmsNothighenough;atthesametime,wehopetofindnewbreakthroughsintheoryandestablishnewgeneralmodelsandalgorithms.Furtherresearchonthebiologicalneuronsystemisneededtocontinuouslyenrichpeople'sunderstandingofhumanbrainnerves.