Beam Width la mot tham so quyet dinh chat luong cua qua trinh Beam Search – thuat toan giup mo hinh ngôn ngu chon tu tiep theo mot cach thong minh. Khi ban nghe den Beam Search, Beam Width chinh la “so luong duong” ma AI giu lai de xet duy tren moi buoc.
Beam Width La Gi?
Beam Width (do rong beam) la so luong ung vien cau duoc giu lai o moi buoc cua qua trinh Beam Search. Gia tri nay quyet dinh mo hinh se rong hay hep khi tim kiem cau tra loi tot nhat.
Vi du: Beam Width = 3 nghia la o moi buoc chon tu, AI giu lai 3 nhom tu co xac suat cao nhat de tiep tuc phat trien. Nhom nao kem se bi loai bo dần.
Beam Width Hoat Dong Nhu The Nao?
De hieu de hon, hay tuong tuong ban dang di trong mot me cung co nhieu ngach rẽ. Ban khong the thu tat ca cac duong (vi qua nhieu), nen ban quyet dinh giu lai 3 duong co tien do tot nhat o moi ngã rẽ. Do la Beam Width = 3.
Qua trinh hoat dong gom cac buoc sau:
Buoc 1: Mo hinh tinh xac suat cho tat ca tu co the di sau token hien tai.
Buoc 2: Chon ra K ung vien co xac suat cao nhat (K = Beam Width).
Buoc 3: Voi moi ung vien, lai tinh xac suat cho buoc ke tiep.
Buoc 4: Giu lai K nhom tot nhat, loai bo phan con lai.
Buoc 5: Lap lai cho den khi gap token ket thuc (EOS) hoac dat do dai toi da.
Beam Width Cao Hay Thap Tot Hon?
Day la cau hoi phu thuoc vao muc dich su dung. Khong co gia tri “dung” cho tat ca.
Beam Width cao (5-10): Mo hinh xet nhieu duong hon, kha nang tim cau tot tang. Tuy nhien, toc do sinh cham hon va ton bo nho hon. Phu hop cho dich may, bai bao khoa hoc – noi yeu cau chinh xac.
Beam Width thap (1-3): Sinh van ban nhanh hon, ton it tai nguyen. Phu hop cho chatbot, ung dung thoi gian thuc. Beam Width = 1 chinh la Greedy Decoding – chi chon tu co xac suat cao nhat, khong xet khuyen nang.
Beam Width Khac Gi Voi Greedy Decoding?
Greedy Decoding (Beam Width = 1) luon chon tu tot nhat tai moi buoc, khong bao gio nhin lai. Nhu nguoi chi nhin thay buoc chan phia truoc ma khong tinh den chuyen khuc phia sau.
Beam Search voi Beam Width > 1 giau cai nhin xa hon. No giu nhieu lua chon, de khi den cuoi cau se chon duong tong xac suat cao nhat. Dieu nay giup tranh tinh huong “chon tu dung o buoc nay nhung dan den cau sai o buoc sau”.
Vi Du Thuc Te Ve Beam Width
Gap mot vi dich don gian: Dich cau “Hom nay troi dep” sang tieng Anh.
Vo Beam Width = 3, o buoc dau tien AI xet 3 lua chon: “Today”, “This”, “The”. No giu ca 3. O buoc tiep theo, moi nhanh lai sinh 3 nhanh con. Nhanh “Today the” co the co xac suat cao hon “Today is” trong ngu canh nao do. Cu the cho den het cau.
Neu Beam Width = 1, AI chi chon “Today” va bo qua “This”, “The” ngay tu dau. Co the dung, cung co the sai – tuy thuoc bai canh.
Beam Width Anh Huong Den Chat Luong Nhu The Nao?
Nghien cuu cho thay Beam Width tang tu 1 len 3-5 thuong cai thien chat luong dau ra dang ke, dac biet trong dich may va tom tat van ban. Nhung khi tang qua 10, cai thien khong con dang ke – giong nhu quy luat giam loi.
Trong mot nghien cuu voi mo hinh Transformer, BLEU Score tang khoang 2-3 di khi Beam Width tang tu 1 len 4. Nhung tu 4 len 10, BLEU Score gan nhu khong doi. Vay nen Beam Width = 4-5 la gia tri pho bien nhat trong thuc te.
Cai Dat Beam Width Khi Dung API
Khi goi API cua cac mo hinh nhu GPT, Claude, Gemini, ban thuong khong can cau hinh Beam Width truc tiep. Cac mo hinh nay dung sampling (temperature, top-p, top-k) thay vi Beam Search.
Tuy nhien, neu ban chay mo hinh ngon ngu rieng (nhu LLaMA, Mistral) bang Hugging Face Transformers, Beam Width duoc cau hinh qua tham so num_beams:
model.generate(num_beams=4, max_length=100)
Day la cach ban noi voi mo hinh: “Giu lai 4 ung vien tot nhat o moi buoc”.
Beam Width Va Luoc Do Khac Biet
Beam Width khong phai la kich thuoc bo nho hay so luong parameter cua mo hinh. No chi la mot tham so duoc truyen vao qua trinh sinh van ban (inference). Mo hinh giu nguyen, chi cach sinh dau ra thay doi.
Dieu nay co nghia la ban co the thay doi Beam Width bat ky luc nao ma khong can huan luyen lai mo hinh. Chi can dieu chinh tham so khi goi ham generate.
Luu Y Khi Chon Beam Width
1. Bo nho: Beam Width = K nghia la mo hinh giu K ban sao cua trang thai tai moi buoc. Voi cau dai, bo nho tieu thu tang tuyen tinh theo K.
2. Toc do: Thoi gian sinh ty le thuan voi Beam Width. Tang tu 1 len 5 co the lam cham 3-4 lan.
3. Da dang: Beam Width cao co the lam van ban “an toan” qua – luon chon cach viet pho bien, mat di su sang tao. Voi viet sang tac, sampling thuong tot hon Beam Search.
4. Do dai cau: Cau ngan khong can Beam Width lon. Cau dai, phuc tap moi can Beam Width cao de dam bao tinh mach lac.
Ket Lai
Beam Width la tham so dieu khine su khep kin giua chat luong va toc do trong qua trinh sinh van ban cua AI. Gia tri 4-5 la diem ngot cho phan lon ung dung. Tang len thi tot hon mot chut nhung ton tai nguyen, giam xuong thi nhanh hon nhung co the mat chinh xac.
Khi ban can chat luong cao (dich may, bao cao), dung Beam Width lon. Khi can phan hoi nhanh (chatbot, ung dung thoi gian thuc), Beam Width nho hoac sampling la lua chon tot hon.
