Skip to content

Commit

Permalink
some fix + load/save
Browse files Browse the repository at this point in the history
  • Loading branch information
@pasqLisena
pasqLisena committed Aug 10, 2020
1 parent 98385d2 commit b4c19fc
Show file tree
Hide file tree
Showing 31 changed files with 460 additions and 394 deletions.
Binary file added models/doc2topic/d2t
View file
Binary file not shown.
1 change: 1 addition & 0 deletions models/doc2topic/d2t.params
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"Ntopics": 35, "Ndocs": 30, "BS": 6144, "LR": 0.05, "L1doc": 2e-06, "L1word": 1.5e-08, "NS": 2}
1 change: 1 addition & 0 deletions models/doc2topic/d2t.vocab
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
{"0": "car", "1": "anyone", "2": "could", "3": "day", "4": "really", "5": "know", "6": "year", "7": "info", "8": "please", "9": "mail", "10": "thanks", "11": "clock", "12": "summary", "13": "number", "14": "speed", "15": "add", "16": "two", "17": "question", "18": "well", "19": "mac", "20": "way", "21": "new", "22": "bit", "23": "doe", "24": "make", "25": "like", "26": "got", "27": "much", "28": "look", "29": "people", "30": "get", "31": "email", "32": "time", "33": "point", "34": "chip", "35": "system", "36": "thing", "37": "shuttle", "38": "error", "39": "code", "40": "see", "41": "power", "42": "weapon", "43": "mass", "44": "destruction", "45": "control", "46": "say", "47": "nuclear", "48": "course", "49": "mean", "50": "sure", "51": "file", "52": "scsi", "53": "problem", "54": "list", "55": "quadra", "56": "mode", "57": "data", "58": "may", "59": "think", "60": "reference", "61": "design", "62": "board", "63": "also", "64": "want", "65": "moral", "66": "god", "67": "jew", "68": "come", "69": "image", "70": "parent", "71": "child", "72": "never", "73": "water", "74": "space", "75": "station", "76": "redesign", "77": "option", "78": "ssf", "79": "orbiter", "80": "used", "81": "team", "82": "capability", "83": "flight", "84": "environment", "85": "module", "86": "tiff", "87": "window", "88": "captain", "89": "catalog", "90": "plant"}
Binary file modified models/lda/lda.pkl
View file
Binary file not shown.
Binary file renamed models/mallet-dep/corpus.mallet → models/lda/mallet-dep/corpus.mallet
View file
Binary file not shown.
Binary file added models/lda/mallet-dep/corpus.mallet.infer
View file
Binary file not shown.
0 models/mallet-dep/corpus.txt → models/lda/mallet-dep/corpus.txt
View file
File renamed without changes.
30 changes: 30 additions & 0 deletions models/lda/mallet-dep/doctopics.txt
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
0 0 9.935848283155686E-5 9.92548334952159E-5 4.9283549678880255E-5 1.5070360861320527E-4 1.985699164353836E-4 9.801944483440206E-5 0.9983642733207122 4.926946386259363E-5 9.902440796398735E-5 4.9164988148782396E-5 9.930416424169824E-5 1.0060021386039695E-4 9.799894649016361E-5 4.9121246590007446E-5 1.497052924805566E-4 4.923520634179497E-5 4.937639191351706E-5 4.917405172784141E-5 4.9241153584598705E-5 4.932131619318495E-5
1 1 6.279286196168296E-5 6.272735735368374E-5 3.1146360570078985E-5 9.52421033724858E-5 0.9990290542451052 6.194661284715759E-5 6.268725843521209E-5 3.113745857507567E-5 6.258173235858984E-5 3.1071431710647605E-5 6.275853354182647E-5 6.357761473633714E-5 6.193365824415312E-5 3.1043787793551965E-5 9.461118464944326E-5 3.111580840778893E-5 3.120503527461978E-5 3.107715973761131E-5 3.1119566963533594E-5 3.117022836125218E-5
2 2 3.476647203513086E-5 3.473020415290618E-5 1.7244779739718224E-5 5.273261673416204E-5 0.17472067414993944 3.429792998662774E-5 3.47080026178251E-5 1.7239850979494993E-5 3.464957608211308E-5 1.7203293939984574E-5 0.8247764905810916 3.520096545591418E-5 3.429075742227869E-5 1.7187988355231424E-5 5.2383296485715905E-5 1.7227863949249584E-5 1.7277266114934434E-5 1.720646537194401E-5 1.7229944945705346E-5 1.725799459994978E-5
3 3 1.153517662136063E-4 1.1523143291469646E-4 5.721649866949533E-5 1.749616835209569E-4 2.305328133536558E-4 1.1379718935617991E-4 1.1515777038484104E-4 5.7200145523383214E-5 1.1496391683302498E-4 5.707885282877772E-5 1.1528870420722436E-4 0.9981026134344301 1.1377339148663747E-4 5.702807039009877E-5 1.7380267297793372E-4 5.71603737251672E-5 5.7324285296659603E-5 5.708937533096253E-5 5.7167278268613945E-5 5.7260344287953125E-5
4 4 8.518552669976481E-5 8.509666238685804E-5 4.225351492279481E-5 1.2920654492113232E-4 1.70244979957605E-4 8.403749531071868E-5 8.504226372778461E-5 4.22414383728599E-5 8.489910582516965E-5 4.2151865560808896E-5 0.9985976976750506 8.625013143905527E-5 8.401992094564522E-5 4.2114363501430335E-5 1.2835063324505806E-4 4.2212067504168096E-5 4.233311370925099E-5 4.215963626879401E-5 4.2217166404596224E-5 4.228589424583775E-5
5 5 2.672723581513221E-5 2.6699354348190292E-5 1.3257177611168806E-5 4.0538973329786436E-5 5.3414915678180904E-5 2.6367037236254434E-5 2.668228659213583E-5 0.999546563853054 2.6637370334994224E-5 1.322528479353289E-5 2.671262422164846E-5 2.7061259011551584E-5 2.636152322210418E-5 1.3213518400538727E-5 4.0270428260105905E-5 1.3244173348889968E-5 1.3282151989078223E-5 1.3227722878414378E-5 1.3245773145468333E-5 1.326733672899117E-5
6 6 1.3748154576018453E-4 1.3733812699440756E-4 6.819325735768318E-5 2.0852738964328117E-4 2.747596206686105E-4 1.356287294888999E-4 1.3725033259990842E-4 6.817376692524912E-5 1.3701928901185083E-4 6.802920470751158E-5 1.374063855576084E-4 1.3919971915009766E-4 1.3560036609232704E-4 6.796867985907428E-5 0.9978065536439835 6.812636506504463E-5 6.832172242242593E-5 6.804174591007067E-5 6.813459421780912E-5 6.824551458441023E-5
7 7 0.9996268409636464 2.264536153883346E-5 1.1244226211402557E-5 3.4383592033504184E-5 4.530446921390434E-5 2.2363502994720815E-5 2.2630885327106783E-5 1.1241012479726753E-5 2.2592789091944012E-5 1.1217175954814371E-5 2.265661653317212E-5 2.295231510173719E-5 2.235882622080582E-5 1.1207196154558308E-5 3.4155822473496116E-5 1.1233196498211381E-5 1.12654085145246E-5 1.1219243844280299E-5 1.1234553383903567E-5 1.1252842782912221E-5
8 8 2.74304597991662E-4 2.7401844739106046E-4 1.3605989037881856E-4 4.160559984256183E-4 5.482032288414356E-4 2.7060783985851094E-4 2.738432791097042E-4 1.360210028670151E-4 2.733822985599856E-4 1.3573257083926898E-4 2.74154637580331E-4 2.777327152592857E-4 2.705512489171481E-4 1.3561181103745483E-4 0.9956236132087655 1.359264261866646E-4 1.3631620520089438E-4 1.3575759317595627E-4 1.359428450771302E-4 1.3616415453652976E-4
9 9 4.068836491884091E-5 4.0645919403365535E-5 2.0182142447058575E-5 6.171474490241259E-5 8.131651160096559E-5 4.014001449001246E-5 4.0619936204373565E-5 2.0176374154136657E-5 4.055155767566947E-5 2.0133590228219488E-5 4.066612087341007E-5 4.1196867099959634E-5 4.01316201980825E-5 2.0115677590517766E-5 0.9993508383596502 2.0162345331757857E-5 2.0220162338416892E-5 2.013730186110391E-5 2.016478079150486E-5 2.0197608239932518E-5
10 10 7.01712059083524E-5 7.009800431835856E-5 3.480614854268737E-5 1.0643332758066507E-4 0.998914965294397 6.922552006110822E-5 7.005319366031762E-5 3.479620053737502E-5 6.993526796271399E-5 3.4722415324302684E-5 7.013284379930045E-5 7.104816941689597E-5 6.921104325456543E-5 3.469152316653138E-5 1.0572827407230501E-4 3.477200641245115E-5 3.487171769569804E-5 3.472881641109761E-5 3.477620660942955E-5 3.483282086875548E-5
11 11 1.564254637307555E-5 1.5626228294296098E-5 7.758977284190254E-6 2.3726088796246902E-5 3.126194198641383E-5 1.543173433801948E-5 1.5616239114441776E-5 7.756759677518062E-6 1.5589951149606866E-5 7.740311497638715E-6 1.5633994702029767E-5 1.583803884284733E-5 1.542850717219344E-5 7.733425026125984E-6 2.3568918457540937E-5 7.751366329688585E-6 7.773593942167492E-6 7.741738426187705E-6 7.752302636470837E-6 0.9997346273359533
12 12 2.5479858423407343E-4 2.545327820257079E-4 1.2638456552820885E-4 3.8646993210140725E-4 5.092200699661311E-4 2.513647054530429E-4 2.543700700973659E-4 1.2634844333767886E-4 0.9958048535415758 1.2608052193623117E-4 2.546592876244721E-4 2.5798292541090434E-4 2.5131213873762757E-4 1.2596834945804484E-4 3.839098131264813E-4 1.2626059207878165E-4 1.266226536035138E-4 1.261037649150541E-4 1.2627584340914926E-4 1.264814153804012E-4
13 13 8.390156603105537E-6 8.38140411274009E-6 4.161664791759561E-6 1.2725907651604429E-5 1.6767895886482947E-5 8.277083836961515E-6 8.3760462393277E-6 4.160475339171726E-6 8.361946224120365E-6 4.151653066778703E-6 8.385569762984938E-6 0.05386477241263898 8.275352889453422E-6 4.147959385899859E-6 1.2641606558696951E-5 4.157582521607047E-6 0.9460013899254185 4.152418425161023E-6 4.15808472632131E-6 4.164853920260113E-6
14 14 3.850228909672829E-5 0.9993661660610313 1.909781050769579E-5 5.839897854099411E-5 7.694759531976361E-5 3.7983400053652205E-5 3.843753687205191E-5 1.9092352129554583E-5 3.8372832136793436E-5 1.9051866868285383E-5 3.848124016370856E-5 3.8983470830690864E-5 3.797545676432872E-5 1.903491662817E-5 5.8012122227836325E-5 1.9079077037867006E-5 1.9133787693100607E-5 1.9055379085171514E-5 1.9081381646947503E-5 1.91124453653395E-5
15 15 5.342953662463505E-5 5.337379970258948E-5 2.6501987022324318E-5 8.104012608077532E-5 1.0677999824857842E-4 5.270947551186575E-5 5.3339680113735626E-5 2.6494412443730462E-5 5.324988950379046E-5 2.6438231141255004E-5 5.3400327069461294E-5 5.409727139264508E-5 0.9991197547766775 2.6414709332648616E-5 8.050328647883872E-5 2.6475990630010897E-5 2.6551912478455222E-5 2.6443105036422113E-5 2.6479188730647526E-5 2.6522295780084322E-5
16 16 3.6915589266155085E-5 3.687707945582959E-5 1.8310779569853318E-5 5.5992325546314964E-5 7.377654395317724E-5 3.6418083916777494E-5 3.6853505515128815E-5 1.8305546134381108E-5 3.6791467296456244E-5 1.8266729292281355E-5 3.6895407770870616E-5 3.7376941244701425E-5 0.03094430973443727 1.8250477580584678E-5 5.562141178776741E-5 0.9684658031672789 1.8345274116294958E-5 1.827009676883986E-5 1.8295027751202463E-5 1.8324811317222588E-5
17 17 5.773402646574446E-5 5.767379916197604E-5 2.863708946029325E-5 8.756903165387893E-5 1.1538260734331575E-4 5.695595444850731E-5 0.9990495317088041 2.8628904644391194E-5 5.7539906278960846E-5 2.856819715918904E-5 5.770246367598452E-5 5.845555652577896E-5 5.6944043518357804E-5 2.8542780342828755E-5 8.698894218007696E-5 2.8608998698204455E-5 2.8691037104006235E-5 2.8573463714176143E-5 2.8612454450180978E-5 2.8659034370020608E-5
18 18 9.172776416412668E-5 9.16320750834493E-5 4.54985794195275E-5 0.9985374530110188 1.8331977246224834E-4 9.049156411246075E-5 9.15734986143747E-5 4.5485575392115074E-5 9.141934620330165E-5 4.538912339965055E-5 9.167761723496387E-5 9.287413041009504E-5 9.047264003841617E-5 4.534874118694827E-5 1.3820794532519464E-4 4.545394884449563E-5 4.558429138251784E-5 4.5397490897006746E-5 4.545943933981905E-5 4.553344547040426E-5
19 19 5.11417441564416E-5 5.108839382650428E-5 2.536720184296196E-5 7.757007932795431E-5 0.014375164998064734 5.045251524800164E-5 5.105573519994449E-5 2.5359951599276312E-5 0.9848850165099894 2.5306175916777677E-5 5.1113785321460216E-5 5.178088727515965E-5 5.044196435142191E-5 2.5283661285473725E-5 7.705622659200098E-5 2.534231858683298E-5 2.5414989547397393E-5 2.531084111725345E-5 2.5345379748409095E-5 2.5386641002631153E-5
20 20 1.1918882282953152E-4 0.9980378849458719 5.9119746031597414E-5 1.807816020824493E-4 2.3820124779295578E-4 1.175825345886426E-4 1.1898837393114572E-4 5.9102848915076E-5 1.18788072042404E-4 5.8977521545046145E-5 1.1912366313104876E-4 1.2067838321109713E-4 1.1755794510770337E-4 5.892504988132364E-5 1.79584038258293E-4 5.906175414932788E-5 5.9231118068889724E-5 5.89883940673299E-5 5.9068888365236365E-5 5.916505012898367E-5
21 21 7.15728760998878E-5 7.149821230776505E-5 3.550140153517772E-5 1.0855933383529014E-4 1.430398252989517E-4 7.060830017308065E-5 7.145250655660399E-5 3.5491254818409133E-5 7.133222529259663E-5 3.541599574533396E-5 7.153374770751428E-5 7.24673569589326E-5 7.059353419225423E-5 3.5384486516555536E-5 1.0784019687954859E-4 3.546657741571802E-5 3.556828043235011E-5 0.9987856744200813 3.547086151165223E-5 3.552860664109341E-5
22 22 3.580881404868678E-5 3.577145881030623E-5 1.7761799655315727E-5 5.431360608077213E-5 7.15646315307823E-5 3.532622452761357E-5 3.5748591645627846E-5 1.7756723124739203E-5 3.5688413409806084E-5 1.771907005977833E-5 3.578923761969751E-5 3.625633412189081E-5 3.5318836920876605E-5 1.7703305594583875E-5 5.395381277740189E-5 1.7744376708438462E-5 1.779526001241085E-5 1.7722336575207013E-5 0.9993924817560625 1.7775410713470637E-5
23 23 1.2328993435851586E-4 1.231613200770816E-4 6.11539692606294E-5 1.8700203026462023E-4 2.463974012606289E-4 1.2162837610935608E-4 1.2308258830930145E-4 6.113649073926039E-5 1.2287539432811602E-4 6.1006851039349884E-5 1.2322253261095226E-4 1.2483074831494642E-4 1.2160294054065983E-4 0.9979081627158103 1.857632600362949E-4 6.109398196325872E-5 6.126917344539413E-5 6.101809766908289E-5 6.110136165700997E-5 6.120083220515996E-5
24 24 0.9982160345515397 1.0826092528252333E-4 5.375539408566892E-5 1.6437801099799596E-4 2.1658756686750318E-4 1.0691344108660566E-4 1.081917187002646E-4 5.374003016382401E-5 1.0800959161603017E-4 5.362607463089472E-5 1.0831473215591166E-4 1.0972838150669261E-4 1.0689108278287507E-4 5.357836409167443E-5 1.6328911059446824E-4 5.370266421630341E-5 5.385666055172532E-5 5.3635960612471096E-5 5.3709151094434575E-5 5.3796587422450036E-5
25 25 7.15728760998878E-5 7.149821230776505E-5 3.550140153517772E-5 0.9988588112292227 1.430398252989517E-4 7.060830017308065E-5 7.145250655660399E-5 3.5491254818409133E-5 7.133222529259663E-5 3.541599574533396E-5 7.153374770751428E-5 7.24673569589326E-5 7.059353419225423E-5 3.5384486516555536E-5 1.0784019687954859E-4 3.546657741571802E-5 3.556828043235011E-5 3.5422524693869855E-5 3.547086151165223E-5 3.552860664109341E-5
26 26 2.3107587514081734E-5 2.3083482012044877E-5 0.9996079756259078 3.50488123960316E-5 4.6180976107227735E-5 2.2796170342420697E-5 2.3068725728625764E-5 1.145849267753891E-5 2.302989244448506E-5 1.1434194986680628E-5 2.3094954757088784E-5 2.3396374214523986E-5 2.279140308682374E-5 1.1424022106936598E-5 3.48166361716723E-5 1.1450525480000149E-5 1.1483360703136806E-5 1.1436302883664644E-5 1.1451908617399579E-5 1.1470551861946742E-5
27 27 3.9537609593419686E-4 3.949636452930359E-4 1.9611347627810185E-4 0.9936959531948363 7.901670405263727E-4 3.9004767705606093E-4 3.947111619160848E-4 1.9605742474739467E-4 3.9404671556198147E-4 1.9564168571163814E-4 3.9515994657902443E-4 4.003173022850976E-4 3.899661082248233E-4 1.9546762541758315E-4 5.957205906816692E-4 1.959211041792483E-4 1.9648292234070665E-4 1.9567775231009476E-4 1.9594476997580944E-4 1.9626376014473604E-4
28 28 2.6529348001457864E-5 2.6501672968229238E-5 1.3159021785736185E-5 4.0238823742439586E-5 5.301943292215381E-5 0.9995629376389641 2.6484731581431708E-5 1.3155260783036637E-5 2.6440147883181928E-5 1.3127365101757991E-5 2.6514844591862225E-5 2.68608980981331E-5 2.6166343135707287E-5 1.3115685826855673E-5 3.9972266974021465E-5 1.3146113806703716E-5 1.3183811253949867E-5 1.3129785135117427E-5 1.3147701758426542E-5 1.3169105685693572E-5
29 29 7.951437645084657E-5 7.943142820009008E-5 3.9440524958940537E-5 1.2060473475713682E-4 1.5891107268640282E-4 0.04446117983162915 7.938065108308954E-5 3.9429252394516106E-5 7.924702378979877E-5 0.9542681923770077 7.947090649559756E-5 8.050810608181603E-5 7.84263698572735E-5 3.931063741899443E-5 1.1980580463535793E-4 3.9401836865137746E-5 3.951482452738265E-5 3.935289619236346E-5 3.94065963108304E-5 3.947074865751241E-5
2 changes: 2 additions & 0 deletions models/lda/mallet-dep/doctopics.txt.infer
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
#doc name topic proportion ...
0 0 0.0017372159270072703 0.00173540368840636 8.616895608878262E-4 0.0026349507528629413 0.003471860797641832 0.001713803752533262 0.001734294319002761 8.614432799090849E-4 0.0017313748537117124 8.596165926565625E-4 0.1094769473252425 0.0017589267548992103 0.0017134453528367941 8.588518010614173E-4 0.0026174958699339635 8.608443103087525E-4 0.8627887618211871 8.597750632113488E-4 8.609482938300987E-4 8.623498828682742E-4
Binary file added models/lda/mallet-dep/inferencer.mallet
View file
Binary file not shown.
Binary file added models/lda/mallet-dep/state.mallet.gz
View file
Binary file not shown.
20 changes: 20 additions & 0 deletions models/lda/mallet-dep/topickeys.txt
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
0 0,00358 scsi chip quadra mac range problem burst bit ide ibm fast controller loop version mode faster worked drive wide statement
1 0,00358 purchased germany moving speed motto tape sale portable dryer worse case reasonable social similar semitism rank population pompous pevasive order
2 0,00178 plant water nuclear cooling tower fossil boiler site fuel hot steam run cycle cool condenser cold closed apr cylinder walker
3 0,00543 voice input thermocouple circuit ken vendor unix voltage greatly amplify amplifier easily information spos mvp length hill game workstation visualization
4 0,00716 clock poll disk call oil leak gts ducati bike worth opinion line upgrade speed keywords floppy final experience add day
5 0,00353 god intricate handiwork earth environment show lie ultimate tapestry respect pantheism health half glory generation future facet environmentalism beauty important
6 0,00358 car policy ticket rate insurance house driving defensive accident single performance model door university umbrella twin turbo steve stealth state
7 0,00178 weapon mass destruction term individual rutledge needle modern foxvog doug make write understood topic today thousand switching sweeper support street
8 0,00357 terminal ncd tcp boot list file control access syntax sun parameter loaded entry edit configuration rod cerkoney add xhost worthless
9 0,00177 safety priority mph lot collision buying important car worry wall volvos unsafe seatbelt saftey personally mileage jim frost econoboxes depends
10 0,00358 error powerbook machine heard expected display warning launch bug tom store real bunch wondering info day waivered understanding till suchlike
11 0,00363 weitek transferred sts source site rocket research removed received place phase orbital nose nasda lightweight eva edition debris capability fault
12 0,00353 trial war camp deal chalk zyklon world unusual total step solution soem short recieved punishment prepared political partly painless originally
13 0,00177 window font mode size small trivial spacify normal monitor include fairly excuse enhanced alavi world reference answer message card
14 0,0054 board icon file stac autodoubler problem work technology sigma product lost licensing double diskdoubler design decompress compression win figure treatment
15 0,00178 tiff image program complexity application inability format file worried word unnecessary trapped success start specification sort simplicity significance save reasoning
16 0,00178 option power ssf module flight capability shuttle station redesign space orbiter team tank external tended human acrv add vehicle solar
17 0,00177 captain traded leaf yeah worn vaive troy torn thomas speaking sittler season sabre rotate rick playing pittsburgh penguin pen olcyzk
18 0,00178 catalog tool scien mailing free engineer copy personal application computing list data mail waste vip trick touch ton toll tists
19 0,00178 moral parent child code morality swear jew absolute yhwh multiple image god david christ unknowable torah required man live interpretation
Binary file removed models/mallet-dep/corpus.mallet.infer
View file
Binary file not shown.
Loading

0 comments on commit b4c19fc

Please sign in to comment.