語(yǔ)言從零基礎(chǔ)到web實(shí)戰(zhàn)-第30節(jié).爬蟲(chóng)存儲(chǔ)

代碼實(shí)首先創(chuàng)建一個(gè)channel對(duì)typetypeConcurrentEnginestruct{SchedulerSchedulerWorkerCountintItemChanchan}}創(chuàng)建一個(gè)ItemChan對(duì)應(yīng)的方persist文件夾---packagepackagefuncItemSaver()chaninterface{}{out:=make(chan gofunc(){return}實(shí)現(xiàn)具體方packagepackageimportfuncItemSaver()chaninterface{}{out:=make(chan funcItemSaver()chaninterface{}{out:=make(chan gofunc(){itemcount:=0for{item:=<-log.Printf("ItemSaver:gotitem#%d:%v",itemcount,item)}return}三、補(bǔ)全爬蟲(chóng)所有信varvarageRe varheightReeRe class="label">體重： ： class="label">星座：varvarmarriageRevareducationRevaroccupationRepile(`<td><spanclass="label">職業(yè)：varhokouRevarhouseRevarcarRe= pile(`<td><spanclass="label">是否購(gòu)車：profile:=model.Profile{}age,err:=strconv.Atoi(iferr==nilprofile.Age=}height,err:=strconv.Atoi(iferr==nilprofile.Height=}weight,err:=iferr==nil{}e= profile.Gender=extractString(contents,genderRe)profile.Car=extractString(contents,profile.Education=extractString(contents,educationRe)profile.Hukou=extractString(contents,hokouRe)profile.House=extractString(contents,houseRe)profile.Marriage=extractString(contents,marriageRe)profile.Occupation=extractString(contents,occupationRe)profile.Xingzuo=extractString(contents,xinzuoRe)reslt:=return}}3.2名字的傳funcfuncparseProfile(contents[]byte,urlstring,namestring){profile:=model.Profile{}profile.Name=na