Budata ụdị LLM na tokenizer | B4N1

Budata ụdị LLM na tokenizer

9 months ago · b4n1 Read time: 3 min

** Ijikọ DSPy na LLM maka Nnwale Software akpaaka: Ntụle Ọhụrụ na Nkwenye Ogo**

** Okwu mmalite**

Njikọ nke Ụdị Asụsụ buru ibu (LLM) na Mmemme Ngwanrọ miri emi (DSPy) agbanweela ala nyocha ngwanro. Site n'iji ike nke LLMs na DSPy eme ihe, ndị mmepe nwere ike ịmegharị usoro nyocha ahụ, na-eme ka ntụkwasị obi na arụmọrụ dị na injinịa ngwanrọ. N'isiokwu a, anyị ga-enyocha otú DSPy nwere ike isi mee ka usoro nyocha maka ngwa ndị e wuru na LLM, ma tụlee uru na ihe ịma aka nke usoro a na-apụta.

Gịnị bụ DSPy?

DSPy bụ ọba akwụkwọ Eke Ọgba nke na-enye otu ngwaọrụ maka akpaaka nnwale ngwanrọ. Ọ na-enye ndị mmepe ohere ịmepụta na mebie ikpe ule, nyochaa nsonaazụ ule, na nyochaa data ule. Emebere DSPy ka ya na LLMs rụọ ọrụ n'enweghị nsogbu, na-enye aka ịmepụta usoro nhazi akpaaka ọkaibe.

Gịnị bụ LLMs?

LLM bụ ụdị ọgụgụ isi mmadụ (AI) nwere ike hazie ma mepụta asụsụ dị ka mmadụ. A zụrụ ha na nnukwu data ederede ma nwee ike ịmụta ịmata ụkpụrụ, mmekọrịta, na gburugburu. LLM nwere ọtụtụ ngwa na injinịa ngwanrọ, gụnyere nhazi asụsụ eke, nyocha ederede, na ọgbọ koodu.

** Na-ejikọta DSPy na LLMs ***

Njikọ DSPy na LLM na-enyere aka ịmepụta ikpe nnwale akpaaka nke nwere ike ime ihe dị mgbagwoju anya, mee ka mmekọrịta ndị ọrụ na nyochaa nsonaazụ ule. Ngwakọta a na-enye ọtụtụ uru, gụnyere:

** Mkpuchi ule emelitere ***: DSPy nwere ike iwepụta ikpe ule na-ekpuchi ụdị ọnọdụ dị iche iche, na-ahụ na a nwalere ngwa ahụ nke ọma. ** Mmụba arụmọrụ ***: Nnwale akpaaka na DSPy na LLM na-ebelata oge na mbọ achọrọ iji mebie ikpe nnwale, na-ahapụ ndị mmepe ka ha lekwasị anya na ọrụ ndị ọzọ.

  • **Enwere ntụkwasị obi siri ike ***: DSPy nwere ike nyochaa nsonaazụ ule wee mee ka ndị mmepe mara okwu ma ọ bụ njehie ọ bụla, na-ahụ na ngwa ahụ nwere ntụkwasị obi ma kwụsie ike.

** Koodu Ọmụmaatụ: iji DSPy na LLM na-eme ka ikpe nnwale akpaaka ***

Nke a bụ ngọngọ koodu ịmaatụ nke na-egosi otu esi eji DSPy jiri LLM megharịa ikpe nnwale: "Python mbubata dspy site na ngbanwe na-ebubata AutoModelForSeq2SeqLM, AutoTokenizer

nlereanya = AutoModelForSeq2SeqLM.from_pretrained("t5-base") tokenizer = AutoTokenizer.from_pretrained("t5-base")

Mepụta ikpe ule DSPy

test_case = dspy.TestCase( aha = "Ile ule 1", nkọwa = "Nwale ọrụ nbanye", nzọụkwụ=[ dspy.Step("Mepee ibe nbanye"), dspy.Step("Tinye nzere bara uru"), dspy.Step("pịa bọtịnụ nbanye"), ] )

Jiri LLM mebie ikpe ahụ

test_results = dspy.execute_test_case (ule ule, ihe nlereanya, tokenizer)

Nyochaa nsonaazụ ule

test_results.analyze() `` Ihe ngọngọ koodu a na-egosi otu esi emepụta ikpe ule DSPy, na-ebu ihe nlereanya LLM na tokenizer, jiri LLM mee ihe nlele ahụ, wee nyochaa nsonaazụ ule.

** Iwu 5-10 Kachasị Eji mee ihe

Nke a bụ iwu/snippets 5-10 kacha eji maka DSPy na LLM:

  1. dspy.TestCase(): Na-emepụta ikpe ule DSPy ọhụrụ.
  2. dspy.Step(): Na-agbakwunye nzọụkwụ ọhụrụ na ikpe ule DSPy.
  3. dspy.execute_test_case(): Na-eji LLM na-eme ihe nlele DSPy.
  4. model = AutoModelForSeq2SeqLM.from_pretrained("t5-base"): Na-ebu ụdị LLM.
  5. tokenizer = AutoTokenizer.from_pretrained("t5-base"): Na-ebu ihe ngosi LLM.
  6. `test_results.analyze()': Na-enyocha rịzọlt nke ikpe ule DSPy.
  7. dspy.monitor_test_results(): Na-enyocha nsonaazụ nke ikpe ule DSPy.
  8. dspy.alert_developer(): Na-eme ka onye nrụpụta mara okwu ma ọ bụ mperi ọ bụla.
  9. dspy.generate_test_cases(): Na-eji LLM na-emepụta ikpe ọhụrụ.
  10. dspy.optimize_test_cases(): Na-ebuli mmezu nke ikpe ule site na iji LLM.

** Nlegharị anya ***

Nke a bụ nhụta nke ntinye DSPy na LLM site na iji Chart.js: Json { "ụdị": "ogwe", "data": { "labels": ["Nnwale 1", "Nnwale Ikpe 2", "Nnwale 3"], "datasets": [ { "label": "Oge Nlele Okwu", "data": [10, 20, 30], "backgroundColor": "rgba(255, 99, 132, 0.2)", "BorderColor": "rgba(255, 99, 132, 1)", "BorderWiidth": 1 }, { "label": "Nnwale Ọnụ Ọgụgụ Ọdịda nke Ikpe", "data": [5, 10, 15], "backgroundColor": "rgba(54, 162, 235, 0.2)", "borderColor": "rgba(54, 162, 235, 1)", "BorderWiidth": 1 } ] }, "Nhọrọ": { " aha": { "ngosi": eziokwu, "ederede": "DSPy na LLM Njikọta" }, "ọnụego": { "yAxes": [ { "akara aka": { "beginAtZero": eziokwu } } ] } } } `` Ọhụụ a na-egosi oge ogbugbu na ọnụego ọdịda nke ikpe ule atọ ejiri DSPy na LLM gbuo.

Mkpebi

Mwekota nke DSPy na LLM agbanweela odida nyocha ngwanrọ, na-enye aka ịmepụta ikpe nnwale akpaaka nke nwere ike mebe ọnọdụ dị mgbagwoju anya, mekọrịta mmekọrịta ndị ọrụ, na nyochaa nsonaazụ ule. Site n'iji ike nke DSPy na LLM eme ihe, ndị mmepe nwere ike ịhazi usoro nyocha, kwalite ntụkwasị obi na arụmọrụ, ma melite ogo ngwa ha niile. Ka teknụzụ a na-aga n'ihu na-etolite, anyị nwere ike ịtụ anya ịhụ ọbụna ngwa ọhụrụ nke DSPy na LLM na injinịa ngwanrọ.


Have Questions?

Let's Talk

Contact me on LinkedIn