DANH GIA SANG LOG NHAN GAGH
HpG SINH TRUNG HOG CO SO
BANG BANG KIEM PIY
TS. Nguyen Oic Son
Trudng khoa Khoa Tdm ly • Gido due, Trudng Dgi hgc Su phgm Hd Ngi.
I
TOM TAT
Tie'n hdnh ddnh gid sdng Igc nhdn cdch hgc sinh Irung hgc ca sd bdng bdng
kiem PIY (Personality Inventory for Youth - hdng kiem ke nhdn cdch ddnh cho lhanh
thie'u nien) cho thdy, trong Idp hgc cd mol .so hgc sinh cd nhimg bieu hien cdn quan
ldm lien quan den khd khdn nhdn thilc vd hgc tap, khd ndng kiem chd xiic cdm vd
hdnh vi kem, cdc vdn de rdi logn chile ndng gia dinh vd quan he gia dinh khdng thudn
Igi, cdc xitc cdm lieu cue vd cpian he bgn hi; khdng thda mdn. Ddc biet cd irudng hop
rdt cdn dugc liep Inc chdn dodn ldm sdng sdu han de cd cdc chuang trinh can thiep
phil hgp. Phdt hien dugc nhiing hgc sinh cd cdc ddu hien ddc biet, nhd tdm ly hgc
Irudng hgc cd the dinh hudng cdc tdc dgng can thiep liep theo.
Ti khoa: Ddnh gid nhdn cdch hgc sinh: Bdng kiem ke nhdn edeh lhanh thie'u
nien: Thang do cdc van de gia dinh: Thang do hdnh vi bgt phdt: Ldm sdng.
Ngdy nhdn bdi: 17/12/2012; Ngdy duyel ddng bdi: 25/2/2013.
1. Dat van dd
Danh gii nhan each cua hpc sinh la vin dd dugc quan tam t i lau trong
Tam ly hoc, dac biet la trong Tim ly hpc tru&ng hoc vi Tam ly hoc lim sing.
Ket qui eiia cac dinh gia nhan each dupe s i dung mdt cich ra't httu Ich trong
tham vin. In lieu va giio due hpc sinh. Ngiy nay, cic muc tieu co bin cua viec
dinh gia nhan each dugc md rdng: khdng ehi ding liji p viee nhan bie't, phan
loai cac dac didm nhan each cia hpc sinh dd cd cp sd lya chpn cac bien phap va
hinh thic giio due mi con ed thd tidn hanh td chie cic hoiit ddng phong ngia
vi ngin chin mdt sd hanh vi tidu cue cd thd miy sinh d hpc sinh. V6i tu tudng
dd, trong dinh gia nhan each, cac nhi nghien ciu cd thd hudng Idi nhidu muc
ueu nhu danh gia sing loc, diinh gia chin doin, danh gii dip ung trj lieu...
bang cich s i dung nhidu edng cu khic nhau. Trong dd PIY Personality
Inventory for Youth (bing kidm ke nhin cich danh cho thanh thie'u nien) la
38
TAP CHI TAM LY HOC, Sd 3 (168), 3 - 2013
mdt edng cu mdi. Si dung cdng cu nay cd thd danh gia eac dac diem eo ban
eua nhan each thanh thie'u nien, t i dd sang Ipc duge eac di'u hieu, cie vin dd
cin quan tam d ting hpc sinh eu thd nhu cac vin dd vd nang lyc hpc tap, kha
nang kidm soat hay mil kidm soit hinh vi, cac hanh vi chdng dd'i xa hdi, cae
di'u hieu rd'i loiin chic nang lidn quan ddn gia dinh, cic va'n dd vd cim xue,
tieh biet xa hpi, thie'u hut ky nang xa hdi... Viec sang Ipc dd phat hien dupe
eie hoc sinh cd cic vin dd dd he't sic cin thiet eho edng vide eua nha tam ly
hpc tru&ng hpc hoac tam ly hpc lam sing. Ti ke't qua sing Ipc, sd hpc sinh cd
nhtmg va'n dd se dupe ehi y dd can thiep.
Trong pham vi bii bao, chung tdi chi trinh bay va phan tich kdt qua s i
dung bang kiem PIY dd dinh gii sing Ipc nhin each hpc sinh trdn mdt sd thang
do cua bing kidm cho tha'y ing dung cua thang do trong danh gia sang Ipc
nhin each.
2. Khach the va phirong phap nghien ciru
Khdch the nghien cieu: 33 hpc sinh Idp 6 trudng THCS Minh Khai, Ha
Ndi. Mdi hgc sinh dupe gin mpt ma sd (ID). Trie nghidm duoc tien hinh tren
mdt lop thudc khd'i 6 dupe ehpn ngiu nhidn.
Phuang phdp nghien citu: s i dung bang kidm ke nhan each lhanh
thie'u nidn dd danh gia sang loc, t i dd phit hien cic di'u hieu ein quan tam 0
hpc sinh.
Dinh gii ting hpc sinh bang bang kidm, didn giii ke't qua eho timg hoc
sinh eu thd. Sd lieu thd'ng ke duoc tdng hop lai ti tat ca trudmg hpp dugc danh gii.
Gidi thieu bdng kiem ke nhdn cdch - PIY
Bang kiem ke nhan each thanh thieu nien la mpt cpng cy do da chidu,
khach quan, dupe s i dung dd danh gia nhan each hpc sinh t i 9 den 18 tudi.
Bang kidm nay dugc phat tridn trdn co sd PIC-R (Personality Inventory for
Children revised: Bang kidm ke nhan each dinh cho tre em - ban ehinh sia)
Irong thdi gian 4 nam bdi cae tie gia David Lachar vi Christian Gruber tai
Truang Dai hpc Y thudc Dai hpc Texas - My. PIC - R da ed Ijch su 35 nam, vdi
sd lupt s i dung trong dinh gia lim sing hon 1 trieu lupt (3).
Tuy nhien, PIY la mdt bing kidm ddc lip vdi cae thudc tinh do ludng
dat cha't lupng rieng. PIY tap Irung vio viae dinh gii sy didu chinh hinh vi va
xic cam, ti'nh chat quan he gia dinh, sy tuong tac cua hgc sinh, su didu chinh
trong nha tru&ng vi khi nang hpc tap. Nhttng dinh gia vd kha nang didu chinh
tam Iy va cie thang lam sing, cac tidu thang lien quan den cic chieu ki'ch hinh
vi vi xic cam cd van dd ein cd cac danh gii bd sung.
Ciu true cua bing kidm:
TAP CHITAM L? HOC, Sd 3 (168), 3 - 2013
39
- Bing kidm bao gdm 270 item v6i 2 phuong in tri l&i: dung - sai, dupe
dien dirt phi hpp vdi trinh dd dpc hidu cia hpc sinh Idp 3 trd ldn.
- Bang kidm bao gdm 2 nhdm thang do:
-I- Thang do hieu lue vdi 4 tidu thang: Hieu luc (validity), Khdng dn djnh
(inconsistency), Ty ve (Defensivness), Che di'u - gii vd (Dissimulation).
-I- Thang lam sang vi eac tidu thang bao gdm:
Tieu thang
Thang ISm sang
Ky hieu
COG
veil kem v^ nhan thiic
Trf nh6 va k^t qua hpc tap kem
COGl
Kha nang khOng phD hop
C0G2
va'n di hoc tap
C0G3
Xa'c xuoc
ADHl
Bdc ddng, tang ddng
ADH2
Xung dpng
ADH3
Hanh vi chdng ddi xa hpi
DLQl
Mai kie'm soat
DLQ2
Khong tuan thCi
DLQ3
Xung dpt cha me con cai
FAMl
Kem di^u chinh ciia cha me
FAM2
Bai hoa trong hPn nhan
FAM3
Cam giac bi ghet bo
RLTl
Ao giac, hoang tuong
RLT2
Hpi chiing tam the
SOMl
ADH
B6c ddng {ha'p la'p, xung d6ng} va
khd ki^m soat
DLQ
Pham phap
FAM
R6i loan chiic nang gia ttinh
RLT
Tie'p nhan hien thac sai ISch
SOM
Nghi benh
40
TAP CHI TAM LY HOC, Sd 3 (168), 3-2013
Tang truang luc co va lo hai
S0M2
Am anh boi benh lilt
S0M3
So hai va cang thang, lo lang
DI.S1
Trtim cam
D1S2
DIS
Khong ihoai mai v6 tam ly
Mat ngu
D1S3
WDL
N€ Iranh xa hOi
Hudng nOi xiT hOi
WDLl
Tach biei
WDL2
Vi the' Irong nhom ban hiin che
SSKl
Xung dot vOi ban be
SSK2
SSK
Thid'ii hut ky nang xa h6i
3. Ket qua nghien ciiru
Trucfc khi tien hanli XLT ly di^m cua lirng iioc sinh Iheo cac ihang lam
sang va tieu thang de diln giai ket qua, thang do hieu luc v6i 4 tidu thang duoc
xii ly trudc. Ket qua cua thang do hieu luc xac nhan du" lieu thu dirac cua tiing
bang ki^m la co the sir dung dugc cho viec di6n giai ket qua.
3.1. Ke't qud thang do nhgn thitc: COGl vd COG2
Tieu thang
Diem chuan - T-score
Binh thiriyng
Cao
N
N
%
Tdng
(%)
%
COGl
30
90j9
3
9,1
C0G2
28
84,9
5
15,1
^
100
100
Ghi cllli • diem T-score Id diem chudn difgc chuyen lif diem tho ciia ket qua ddnh gid lifiig cd
nhdn. N - sd lugng hgc sinh. T-score > 65 duac coi la diem eao.
K6i qua ciia tieu thang do COGl cho thay: co 3 hgc sinh co ket qua hoc
tap kem do khong co d6ng co hoc tap, tri nh6 kem, thu6ng gap kho khan voi
mon toan. Trong khi cac hpc sinh con lai khong gap phai va'n de nay. Ket qua
cua tiing hoc sinh cu the da dugc ma hoa (ID7 vcfi T-score T = 66, IDS T-score
= 66 va ID29 v6i T-score = 68), cho phep nha tam ly hoc tru6ng hoc co thi xac
TAP CHI TAM LY HOC, Sd 3 (168), 3 - 2013
dinh duoc hoc sinh cu thd, tir dd sir dung cac phuong phap danh gia va chin
doin siu hon, dd dd ra phuong an hd tro.
Tidu thang do C0G2: trong sd 33 hoc sinh duge dinh gia ed 5 hoc sinh
(ID 1, 5, 17, 30, 31) cd didm T-score eao lire li eie hoe sinh do gap phai eac
vin dd lien quan den tu dinh gii ban than trong hoc lip thip; co xu hudng phii
nhan nang lire eiia ban thiin hoiie nhin bidt ket qua hoc tip eiia ban thin xiu ro
ret, tu phS phan cao.
Dinh gii chung tren tdng thd nghien ciru, sd luong hoc sinh cd vin dd vd
nhan thu-c li khOng cao 9% - 15%. Day li ty IS luong duong vdi phin bd eia
trie nghiem tren miu thiet kd (norm) cua bang kidm (3).
3.2. Thang do hdnh vi bpt phdt, thie'u kiem che
Diem chuan - T-score
Tieu thang
N
Tong
Cao
Binh thutmg
%
N
%
(%)
.ADHl
3)
94
2
6
100
ADH2
30
90,9
3
9,1
100
Gill chii: diem T-scoi e id diem chudn dicgc chuyen lit diem ihd cua kei qua ddnh gid tirng ca
nhdn T-scoi e > 65 dugc col Id diem cao. N - so lugng hgc sinh.
Tidu thang do ADHl ed hai trudng hgp co diem sd cao (ID28 vdi Tscore = 75 vi ID29 vdi T-score = 66). Nhiing tru&ng hgp cd diem sd cao cho
tha'y, hgc sinh cd xu hudng la ming, lin at, lim ra ve manh me trong giao tidp
vdi ngudi khic. Nhirng hgc sinh niy thudng duoc ngudi khac tiep nhan nhu
nhiing hgc sinh khd doin dinh, hay gSy phidn toil.
Ke't qua ciia tidu thang do ADH2 cho bidt su thieu kiem ehe, hanh vi
xung dgng, thieu kien tri, khdng ehu y ciia hgc sinh. Ke't qua nay la ciia ID24
vdl T-score = 70 va ID29 vdi T-score = 77 va ID8 vdi T-score = 66. Day la
didm rit cao cho thiy kha nang kiem che' ciia ciic hge sinh niy rit kem. Day la
yeu td riii ro trong cugc sdng eiia hgc sinh: cd thd din den ke't qua hgc tap thap
va cae hinh vi kem kidm soit xay ra thuong xuyen. Xet vd ty le thdng ke sd
lugng hgc sinh niy li khong nhidu nhimg cin cd sir quan tam ciia giio vien va
nha tam ly hgc truang hgc.
3.3. Tieu thang do hdnh vi tudn thii quy dinh
Ke't qui tidu thang DLQl cho thiy, hgc sinh khdng cd cic di'u hieu cin
quan tam. Viec tuan thil cic quy tic cila trudng hgc b hgc sinh la tdt. Tuy
nhien, kdt qua DLQ2 ed mdt trudng hcfp cin luu y vdi T-score = 83 diem. Diy
42
TAP CHi TAM L? HOC, Sd 3 (168), 3-2013
li diem sd rat eao. Nd eho thiy hgc sinh nay khdng cd kha nang bdc 10 cic xue
cam ciia ban than mgt each hgp ly, dac biet la cac xiic cam tieu cue, do vay hgc
sinh ed nhiing hanh vi khdng dugc kidm soat. Hgc sinh niy cung dd bdc lg su
giin do, khdng cd kha nang dap img tdt vdi cie quy tic tit ben ngoai. Hgc sinh
ed quan he khdng dn dinh vdi ban va quan he khdng thuan loi. Hoe sinh nay ed
masdID28.
Tieu thang
N
Diem chuan - T- score
Binh thirimg
Cao
N
%
Tdng
(%)
%
DLQl
33
too
0
0
DLQ2
32
97
1
,3
,
100
100
Ghi chu: diem T-score Id dietn chudn difffc chuyen tif diem tho cua ke'i qud ddnh gid fifng cd
nhdn. N- sd'lifgng hoc sinh. T-score > 65 difac cot Id diem cao.
3.4. Tieu thang do cdc vdn de gia dinh
Tieu thang
Diem chuan - T- score
Binh thudng
Cao
N
N
%
•Tdng
%
(%)
FAMl
31
94
2
6
100
FAM2
31
94
2
6
100
Ghi chu. diem T-score Id diem chudn dugc chuyen td diem Ihd cua kei qud ddnh gid ning cd
nhdn. T-score > 65 dugc coi Id diem cao. N - so'lugng hpc sinh.
Tidu thang FAMl cho thiy, 2 trudng hgp (ID28 vi ID29) ed didm eao
cin quan tim. Diem sd tuong fing la 71 vi 67. Didm sd cao eho thay ed xung
dgt trong gia dinh giQa phu huynh vi hgc sinh. Quan he trong gia dinh khdng
thuan Igi. Hge sinh cam thiy cha me khdng hidu minh va khdng dugc quan
tam. Phu huynh thudng xuyen tire gian vdi hgc sinh, kem chiu dung hoic
nghiem khic vdi hgc sinh mdt eich thii qui trong tuong tie. Vdi hai trudng
hdp niy, nhi tam ly hgc trudng hgc cin tie'p xue, tim hieu hoan canh gia dinh
cua hge sinh vi tim each tie'p can vdi phu huynh dd tim hieu siu hon eac xung
dot gia dinh, til dd lira chgn cic each tic ddng phu hgp.
Tieu thang FAM2 eho thiy, cha me kem didu ehinh hoac ving nhi
thudng xuyen. Khdng ed su thd'ng nhit trong giao due con gitta phu huynh. Bd
ed thd udng rugu nhidu, ddng thdi kem didu chinh xue cim. ID28 vi ID29 cd
T-score cao.
TAP CHI TAM LY HOC, Sd 3 (168), 3-2013
43
Rit dang luu y la hgc sinh vdi ID28 cd didm thang do vd rdi loan cic
chile nang gia dinh cao, didm thang do vd hinh vi khdng tuin thu cung eao.
Hgc sinh vdi ID29 cd didm thang do chile nang gia dinh eao vi thidu kha nang
kidm che eung cao. Cd thd hinh thanh gii thuyet vd mdi quan he gitta cic ydu
td nay: ydu td gia dinh vdi tu cich li yeu td tim ly xi hdi tie ddng den dac
didm hanh vi va xiic earn cia hge sinh. Cic trudng hgp eu thd niy ein duge het
sire quan tam.
3.5. Thang do tiep nhgn Men thifc
Tieu thang
Diem chuan - T- score
Cao
Binh thudng
N
N
%
Tong
%
(%)
RLTl
32
97
1
3
100
RLT2
32
97
1
3
100
Ghi chii: diem T-score Id die'm chudn dugc chuyen til diem tho ciia kel qud ddnh gid lirng ca
nhdn. T- score > 65 dugc coi Id diem cao. N - so tuong hgc sinh.
Thang do RTLl cd mgt trudng hgp cd diem sd cao (ID7 vdi T-score =
67). Ke't qui nay cho thay, hgc sinh cam nhin ban than khic biet vdi hge sinh
khic thdng thudng, hanh vi, suy nghT lin lgn, khdng binh thudng. Trudng hgp
nay cin quan tim tim hidu vi chin doan siu: hgc sinh ed di'u hieu cia viec tri
giie hien thuc sai leeh hay khdng hoac cd di'u hieu ciia hoang tudng hay khdng.
Thang do RLT2 ed 1 hgc sinh ed didm sd cao (ID28 vdi T-score = 79).
Hgc sinh ed xu hudng hidu sai hinh vi va ddng co eiia ngudi khic. Cd cic trai
nghiem lien quan de'n rdi nhidu xue cim. Trudng hdp nay cin dugc tidp tuc
dinh gia lim sang cin trgng.
3.6. Thang do su thodi mdi tdm ly
Tieu thang
Diem chuan - T- score
Binh thudng
Cao
N
N
%
Tdng
%
(%)
DISl
32
97
1
3
100
D1S2
31
94
2
6
too
Ghi chit: diem T-score Id diem chudn dugc chuyen til diem tho cita kei qua ddnh gid titng cd
nhdn T-score > 65 duoc coi Id diem cao. N - sd luong hoc sinh
Tieu thang DISl cd mdt trudng hgp cd didm sd cao (ID 28) thd hien su
lo hai, khdng thoai mil vd tim ly. So sinh vdi cic ke't qua cua hgc sinh niy (ID
44
TAP CHiTAM LY HOC, Sd 3 (168), 3 - 2013
28) theo cae thang do neu tren cd thd thiy hgc sinh nay cd nhidu van de vd
hanh vi, vd tuong tie vi xiie cam. Hge sinh ed hanh vi ilng K\X bd ngoai vdi ve
manh me bit cin, nhung thire ra dd li ke't qui ciia sir kem kidm chd, sir lo hai
ben trong vi cd thd cd ngudn gdc tir eie vin dd gia dinh.
Tidu thang DIS2 cd 2 trudng hgp cd didm cao (1D26 va ID32). Kdt qua
the hien su bi quan, tim trang tieu cue, tu dinh gii thi'p bin than vi cd inh
hudng tdi viec an udng. Cd di'u hieu ciia viSc in udng khdng ngon mieng.
3.7. Tieu thang do vi thd trong nhdm bgn vd xung dpt vdi bgn be
Tieu thang
N
Diem chuan - T- score
Binh thudng
Cao
N
%
Tdng
%
(%)
SSKl
6
18
27
82
100
SSK2
32
97
1
3
100
Ghi chii: diem T-score Id diem chudn dugc chuyen I if diem thd cda ket qud ddnh gid tiing cd
nhdn. T- score > 65 difoc coi Id diem cao. N - so'lugng hoc sinh.
Tiiix thang SSKl cho ket qua ra't dang Imi y: co tdi 27 hoc sinh co diem
cao. Diem T-score cao nha't = 91. Ket qua nay canh bao da'u hiSu ve cac xiic
cam tieu cue 6 hoc sinh. Hpc sinh co cam nhSn khfing dugc thau hieu, bi quan,
dau kho, tuyet vpng, thieu tir tin vao ban than. Tuy vay, kd't qua nay khong qua
dac biSt. No phan anh diing tam trang va cam nhan ciia liia tu6i hoc smh THCS,
Ilia tudi dang co khiing hoang ve tu nhan thiic, trong khi nhu cau dugc chia se,
thiia nhan va giao tie'p ra't Icm. K6't qua nay cho tha'y, moi tru5ng giao tiep trong
nhom ban ciia hpc sinh chua thuan loi. Dieu nay dat ra thach thiic d6'i vdi nha
tam ly hoc trudng hpc va giao vien trong nha trucfng trung hpc co scf dugc
nghien ciiu.
Tidu thang SSK2 hpc sinh co ma s6' 28 v6i didm T = 70. Diem cao ciia
thang nay cho tha'y hpc sinh co xung ddt v6i ban, kho ket ban va kha nang duy
trt quan h6 v6i ban kem, bi ban be tit chdi. Vi vay, hpc sinh nay khdng thoa
man v6i quan he ban be. He qua la hpc sinh nay co xu hu6ng du6i theo, tim
kiem cac quan h6 v6i ngu6i 16n.
3.8. Tieu thang do hgi chieng tdm the, tdng truang luc CG vd lo hdi
Tiin thang SOM I va S0M2 cho tha'y, ta't ca hpc sinh duoc danh gia
khdng CO cac d&u hieu dang quan tam vi nghi benh hay lo lang ve benh tat. 6
Ilia tu6i thieu niSn, dang trong th5i ky phat trien manh ve thi cha't, d tre co su
phat tridn khdng d6ng ddu, tuy nhien cac da'u hieu thd ch^lt it dugc hpc sinh
TAP CHI TAM Ly HOC, So 3 (168), 3 - 2013
45
quan tam va dl dang qua di nhanh chong (1). Do vay, viec hoc sinh khdng co
cac da'u hiSu lo ldng va nghi ng6 vd siic khoe cua ban than la cd thd giai thich dugc.
Tieu thang
Diem chuan - T-score
Cao
Binh thudng
N
N
%
Tdng
%
(%)
SOMl
33
100
0
0
too
S0M2
33
100
0
0
too
Ghi elm: diem T-score ia diem chudn dugc chuyen Id diem Iho ciia kei qud ddidi gid ldng cd
nhdn. T- score > 65 dugc coi Id diem cao. N - so lugng hoc sinh.
4. Ket luan
Ke't qui dinh gia sing lgc nhin each cho tha'y trong sd hoc sinh trung
hgc CO sd dugc dinh gii cd mdt sd hge sinh cd nhirng bidu hien cin quan tam
lien quan de'n nhan thirc vi hgc tap, kha ning kidm ehe xiic cim va hinh vi, cac
va'n dd gia dinh vi quan he gia dinh, cic xiic cam tieu cue vi quan he ban be. d
mgt hgc sinh ed thd ed vin de ein quan tim lien quan de'n mdt hoic mdt vii
mat nao dd ciia nhan eich. Tren ed sd ciia ket qui danh gia sang loc, nhi tim ly
hgc trudng hgc cd thd dinh hudng eho cic cdng viec tiep theo ddi vdi eie hgc
sinh dd. Die biet cin chu y den hge sinh vdi 1D28. Hgc sinh nay cd didm sd
eao trong phin ldn cie thang do, cho thiy mdt nhan cich phirc tap can chin
doin vi danh gii siu hon.
Co thd sir dung bing kiem ke nhin each PIY dd dinh gii nhan each vdi
muc dich sing Igc eie di'u hieu can quan tam phuc vu cho viec td chirc ngin
ngira hoac td ehirc cie hoat ddng can thiep phii hgp. Viee dinh gii nhin cich
sing lgc bing PIY eho phdp nhin bie't duge cac mat, cic chidu da dang cia
nhin each hgc sinh. De lim rd cac diu hieu da phat hien duoc, nha tam ly hoc
cin su dung nhidu phuong phip va ky thuat khic dd thu thip cic thdng tin bd
sung. Kdt qui danh gii khdng thd dem lai mgt ket luin chi'nh xic va ngay lap
tuc nhung iid cho phep lien kd't cic du lieu dd hinh thinh cic gia thuyet vd nhin
cich cu thd, tir dd nha tim ly hgc xic dinh duoc dinh hudng dd lim viec tidp
theo.
Taj lieu tham khao
1. Nguyen Van Dong, Tdm ly hgc phdt trien, NXB Chinh tri Qudc gia, 2004.
2. TiSn Trong Thuy, Khoa hgc chdn dodn tdm ly. NXB Giao due, 2000.
3. David Lachar and Christian Gruber, Personality Invenloiy for youth. Western
psychological service, Los Angeles, 2004.
46
TAP CHI'TAM L? HOC, Sd 3 (168), 3 - 2013