Fungura moderi ya LLM na tokenizer | B4N1

Fungura moderi ya LLM na tokenizer

9 months ago · b4n1 Read time: 3 min

Kwinjiza DSPy hamwe na LLMs yo Kwipimisha Porogaramu Yikora: Iparadizo Nshya mubwishingizi bwiza

Intangiriro

Kwishyira hamwe kwururimi runini (LLMs) na Porogaramu Yimbitse ya Porogaramu (DSPy) byahinduye imiterere yo kugerageza software. Mugukoresha ubushobozi bwa LLMs na DSPy, abitezimbere barashobora gutangiza inzira yikizamini, bakazamura ubwizerwe nubushobozi mubikorwa bya software. Muri iki kiganiro, tuzasuzuma uburyo DSPy ishobora koroshya inzira yo kugerageza porogaramu zubatswe kuri LLMs, tunaganira ku nyungu n’ibibazo byiyi paradizo igaragara.

DSPy ni iki?

DSPy ni isomero rya Python ritanga urutonde rwibikoresho byo gutangiza software. Iyemerera abitezimbere gukora no gukora imanza zipimishije, gukurikirana ibisubizo byikizamini, no gusesengura amakuru yikizamini. DSPy yashizweho kugirango ikore nta nkomyi na LLMs, ituma hashyirwaho uburyo bukomeye bwo gukoresha ibizamini.

LLMs ni iki?

LLMs ni ubwoko bwubwenge bwubwenge (AI) bushobora gutunganya no kubyara imvugo imeze nkabantu. Bahuguwe kumubare munini wamakuru kandi barashobora kwiga kumenya imiterere, umubano, nibisobanuro. LLMs ifite porogaramu nyinshi mubuhanga bwa software, harimo gutunganya ururimi karemano, gusesengura inyandiko, no kubyara code.

Guhuza DSPy na LLMs

Kwishyira hamwe kwa DSPy hamwe na LLMs bituma habaho gukora ibizamini byikora byikora bishobora gukora ibintu bigoye, kwigana imikoreshereze yabakoresha, no gusesengura ibisubizo byikizamini. Uku kwishyira hamwe gutanga inyungu nyinshi, harimo:

  • ** Kunoza ikizamini cyibizamini **: DSPy irashobora kubyara ibibazo byikizamini gikubiyemo ibintu byinshi, byemeza ko porogaramu yapimwe neza. **
  • ** Kongera ubwizerwe **: DSPy irashobora gukurikirana ibisubizo byikizamini no kumenyesha abitegura gukora ibibazo cyangwa amakosa, kwemeza ko porogaramu yizewe kandi ihamye.

Kode y'intangarugero: Gutangiza Imanza Zikizamini hamwe na DSPy na LLMs

Dore urugero kode yo guhagarika yerekana uburyo wakoresha DSPy hamwe na LLM kugirango uhindure ibibazo byikizamini: `` python kwinjiza dspy kuva muri transformateur itumiza AutoModelForSeq2SeqLM, AutoTokenizer

icyitegererezo = AutoModelForSeq2SeqLM. kuva kuri_yateguwe ("t5-shingiro") tokenizer = AutoTokenizer. Kuva_yateguwe ("t5-shingiro")

Kora ikibazo cya DSPy

ikizamini_urubanza = dspy. Ikizamini ( izina = "Urubanza 1", ibisobanuro = "Gerageza imikorere yinjira", intambwe = [ dspy. Intambwe ("Fungura urupapuro rwinjira"), dspy. Intambwe ("Injiza ibyangombwa byemewe"), dspy. Intambwe ("Kanda buto yo kwinjira"), ] )

Kora ikibazo cyikizamini ukoresheje LLM

ikizamini_ibisubizo = dspy.ibikorwa_ibizamini (ikizamini

Gisesengura ibisubizo by'ibizamini

ibizamini_ibisubizo.isesengura () `` ` Iyi kodegisi yerekana uburyo bwo gukora ikibazo cya DSPy, gupakira moderi ya LLM na tokenizer, gukora ikizamini ukoresheje LLM, no gusesengura ibisubizo byikizamini.

Hejuru 5-10 Amabwiriza Yakoreshejwe Byinshi / Udukoryo

Dore top 5-10 zikoreshwa cyane / ibisobanuro kuri DSPy na LLMs:

  1. Dspy. Ikizamini (): Kurema urubanza rushya rwa DSPy.
  2. Dspy. Intambwe (): Ongeraho intambwe nshya murubanza rwa DSPy.
  3. Dspy.execute_test_case (): Irangiza urubanza rwa DSPy ukoresheje LLM. 4 .. 5 ..
  4. test_ibisubizo.analyze (): Gusesengura ibisubizo byurubanza rwa DSPy.
  5. dspy.monitor_test_ibisubizo (): Ikurikirana ibisubizo byurubanza rwa DSPy.
  6. dspy.alert_terambere (): Imenyesha uwatezimbere kubibazo cyangwa amakosa.
  7. dspy.generate_test_cases (): Itanga ibibazo bishya ukoresheje LLM.
  8. Dspy.optimize_test_cases (): Hindura imikorere yimanza zipimishije ukoresheje LLM.

Kubona amashusho

Dore amashusho ya DSPy na LLM ihuza ukoresheje Chart.js: json { "ubwoko": "akabari", "amakuru": { "ibirango": ["Urubanza 1", "Urubanza 2", "Urubanza 3"], "imibare": [ { "label": "Igihe cyo Gukora Ikizamini", "amakuru": [10, 20, 30], "backgroundColor": "rgba (255, 99, 132, 0.2)", "umupaka w'amabara": "rgba (255, 99, 132, 1)", "Ubugari bwumupaka": 1 }, { "label": "Ikigereranyo Cyatsinzwe Ikigereranyo", "amakuru": [5, 10, 15], "backgroundColor": "rgba (54, 162, 235, 0.2)", "umupaka Ibara": "rgba (54, 162, 235, 1)", "Ubugari bwumupaka": 1 } ] }, "amahitamo": { "umutwe": { "kwerekana": ukuri, "inyandiko": "DSPy na LLM Kwishyira hamwe" }, "umunzani": { "yAxes": [ { "amatiku": { "gutangiraAtZero": ukuri } } ] } } } ` Iyi visualisation yerekana igihe cyo gukora no gutsindwa byimanza eshatu zipimishije zakozwe ukoresheje DSPy na LLM.

Umwanzuro

Kwishyira hamwe kwa DSPy na LLMs byahinduye imiterere yikizamini cya software, bituma hashobora kubaho ibizamini byikora byikora bishobora gukora ibintu bigoye, kwigana imikoreshereze yabakoresha, no gusesengura ibisubizo byikizamini. Mugukoresha ubushobozi bwa DSPy na LLMs, abitezimbere barashobora koroshya inzira yikizamini, kongera ubwizerwe no gukora neza, no kuzamura ireme rusange ryibikorwa byabo. Mugihe iri koranabuhanga rikomeje gutera imbere, turashobora kwitegereza kubona nibindi byinshi bishya bya DSPy na LLMs mubuhanga bwa software.


Have Questions?

Let's Talk

Contact me on LinkedIn