七、機(jī)器學(xué)習(xí)3-答疑xgboost本課件包括示例代碼題庫視頻和聲音等

法 品法EDUCATIONTOCREATEABRIGHT本課件包括演示文稿、示例、代碼、題庫 和聲音 者在本課程使用，不得在課程范圍外向任何 散播任何其他人或者機(jī)構(gòu)不得盜版 、仿造其中的創(chuàng)意內(nèi)容，我們保留一切通過法課 咨

者的權(quán) 品EDUCATIONTOCREATEABRIGHT

品EDUCATIONTOCREATEABRIGHT多溫故，樂實(shí)踐，再發(fā)不懶散惰性， 早不請 ，不拖延作“四不原則”，不包就業(yè)和推薦就3

品EDUCATIONTOCREATEABRIGHT4 品 EDUCATIONTOCREATEABRIGHT5

品EDUCATIONTOCREATEABRIGHT6

品EDUCATIONTOCREATEABRIGHT伸縮性強(qiáng)、便捷的可并行構(gòu)建模型的GradientBoosting 7

品EDUCATIONTOCREATEABRIGHT安裝方式一：編 上的源碼，參 裝參考命令：pipinstallf:///xgboost-0.7-cp36-cp36m-8

品EDUCATIONTOCREATEABRIGHT9 品 EDUCATIONTOCREATEABRIGHT

品 EDUCATIONTOCREATEABRIGHT

品EDUCATIONTOCREATEABRIGHTiiii

ii

f1xi

t tiiii

f2xi

obj

l

? iiii

ftxi

品EDUCATIONTOCREATEABRIGHTtt

obj

iiiiii

fiiiiii

f2xi

ftxwqxi2i2

ii

wjj1ii

品EDUCATIONTOCREATEABRIGHT

fx

tii

lyi,

ft

ft

處進(jìn)行二 展開

品EDUCATIONTOCREATEABRIGHTin gfx1h xin

tlossly,?

f

gly,y?t1 ?it h2 ?i

品EDUCATIONTOCREATEABRIGHTgnitiloss fgniti

1hf2xf

n

1 loss

giwqxi

hiwqx

j2jj定義每個(gè)葉子節(jié)點(diǎn)jIji|qxi

品EDUCATIONTOCREATEABRIGHT 1

1 jlossj

w

hw2

T j1iI

i

2j iiI 2j i

2j 1

TGw1H22giw 2

jT

j

2j1iI 2

j

品EDUCATIONTOCREATEABRIGHT最終的目標(biāo)函數(shù):

Gjwj

H1j

2j1

jjw*j

Gj

loss*

TG2 TG2

j

品EDUCATIONTOCREATEABRIGHT

品EDUCATIONTOCREATEABRIGHT

品EDUCATIONTOCREATEABRIGHT

1 G2loss*

T2j1Hj對于一個(gè)葉子節(jié)點(diǎn) 1 G2

GG Gain

2HL HR

HLHR

品EDUCATIONTOCREATEABRIGHT

品EDUCATIONTOCREATEABRIGHT

品EDUCATIONTOCREATEABRIGHT

品1

Gain

,2H1 H23 1

}2H3

品EDUCATIONTOCREATEABRIGHT

1/3 2/3

品EDUCATIONTOCREATEABRIGHT

品EDUCATIONTOCREATEABRIGHT

品EDUCATIONTOCREATEABRIGHT參給定樹的深度，默認(rèn)為每個(gè)迭代產(chǎn)生的模型的權(quán)重/學(xué)習(xí)率，默認(rèn)為子模型的數(shù)量，默認(rèn)為給定損失函數(shù)，默認(rèn)為給定損失函數(shù)，默認(rèn)為給定模型的求解方式，默認(rèn)為:gbt