Rodha iyo LLM modhi uye tokenizer | B4N1

Rodha iyo LLM modhi uye tokenizer

3 months ago · b4n1 Tiempo de lectura: 4 min

**Kuita Otomatiki Chiitiko Kuongorora neDevOps Agents uye LLMs **

Introduction

Mumazuva ano anomhanya-mhanya edhijitari, zvikwata zveDevOps zvinosangana nedambudziko riri kuramba richinetsa: kuziva nekugadzirisa zviitiko nekukurumidza sezvinobvira. Nzira dzekuferefeta dzemanyorero dzinogona kutora nguva uye dzinowanzokanganisa kukanganisa kwevanhu, zvichitungamira mukudzikira kwenguva refu uye kudzikira kugutsikana kwevatengi. Kugadzirisa nyaya iyi, tiri kuongorora mharadzano yeDevOps automation, AI-powered chiitiko kuongorora, uye basa reLarge Language Models (LLMs) mukusimudzira maturusi eDevOps seAWS DevOps Agent uye Copado Agentia.

**Mamiriro azvino eChiitiko Ongororo **

Kuongorora kwechiitiko chinhu chakakosha cheDevOps, chinosanganisira kuzivikanwa, kuongorora, uye kugadzirisa nyaya dzine chekuita nesoftware masisitimu. Nzira dzechinyakare dzinotsamira pamagadzirirwo emaoko, sekuongorora log, kutsvaga kukanganisa, uye kutaurirana nevanobata. Kunyange nzira idzi dzichishanda, dzinogona kunonoka uye dzinowanzoita zvikanganiso, zvinotungamira ku:

  1. **Kuwedzera kunonoka **: Nzira dzekuongorora nemaoko dzinogona kunonoka kugadzirisa chiitiko, zvichikonzera kuderera kwenguva refu uye kuderera kwekugutsikana kwevatengi.
  2. Kukanganisa kwevanhu: Maitiro emaoko anogona kukanganisa kukanganisa kwevanhu, izvo zvinogona kutungamirira kukuongorora kusina kururama uye kugadziriswa kwezviitiko.
  3. Scalability nyaya: Sezvo ukuru nekuoma kwemasisitimu zvichikura, nzira dzekuferefeta nemaoko dzinowedzera kuoma kuyera.

Basa reDevOps Agents mukuferefeta kweChiitiko

DevOps vamiririri, vakaita seAWS DevOps Agent uye Copado Agentia, vanoita basa rakakosha mukuita otomatiki kuongorora chiitiko. Aya maagent anogona:

  1. ** Unganidza uye ongorora matanda **: Vamiririri veDevOps vanogona kuunganidza uye kuongorora matanda kubva kwakasiyana-siyana, vachipa ruzivo rwakakosha muzvikonzero zvezviitiko.
  2. **Otomatiki kutsvaga kukanganisa **: MaAgents anogona kushandura kukanganisa kukanganisa, kuderedza nguva uye simba rinodiwa pakuferefeta kwemaoko.
  3. **Kurudzira kutaurirana **: Vamiririri vanogona kufambisa kutaurirana pakati pezvikwata, vanobatana, uye masisitimu, vachiona kuti ruzivo rwechiitiko rwunogovaniswa zvinobudirira.

**Basa reLLMs mukuferefeta Chiitiko **

Makuru Mutauro Models (LLMs) akasandura ndima yekugadzirwa kwemutauro wechisikigo (NLP), zvichiita kuti michina inzwisise uye kugadzira zvinyorwa zvakaita sevanhu. Muchirevo chekuferefeta kwechiitiko, maLLM anogona:

  1. Ongorora mishumo yezviitiko: MaLLM anogona kuongorora mishumo yezviitiko, achidoma ruzivo rwakakosha uye mapatani angaratidza honzeri yechiitiko.
  2. Gadzira pfupiso yezviitiko: MaLLM anogona kuburitsa pfupiso dzemishumo yezviitiko, kufambisa nhaurirano nekuita sarudzo.
  3. **Ipa mazano ekuziva mamiriro ezvinhu **: LLMs inogona kupa mazano ekuziva mamiriro ekugadzirisa chiitiko, tichitarisa maitiro chaiwo, nzvimbo, uye vanobatanidzwa.

**Kuita Otomatiki Chiitiko Kuongorora neDevOps Agents uye LLMs **

Kuti tiite otomatiki kuongorora chiitiko nevamiriri veDevOps uye maLLM, isu tichatevera nhanho-ne-nhanho maitiro:

  1. Batanidza vamiririri veDevOps: Batanidza vamiririri veDevOps, vakadai seAWS DevOps Agent neCopado Agentia, nehurongwa hwako hwekutarisira zviitiko.
  2. ** Unganidza uye ongorora matanda **: Gadzira vamiririri veDevOps kuti vaunganidze uye vaongorore matanda kubva kwakasiyana-siyana, vachipa ruzivo rwakakosha muzvikonzero zvezviitiko.
  3. Dzidzisa modhi yeLLM: Dzidzisa modhi yeLLM pane dataset yemishumo yezviitiko, matanda, uye mamwe mashoko akakodzera.
  4. Batanidza LLM nevamiririri veDevOps: Batanidza modhi yeLLM nevamiririri veDevOps, zvichiita kuti LLM iongorore mishumo yezviitiko uye kupa mazano ekugadzirisa chiitiko.
  5. **Nyora mhinduro **: Shandisa otomatiki yekuferefeta mhinduro, kuve nechokwadi kuti inogona scalable, yakavimbika, uye yakachengeteka.

Muenzaniso kodhi: Kubatanidza LLM neDevOps Agents

Heino muenzaniso kodhi snippet muPython, ichiratidza maitiro ekubatanidza iyo LLM modhi neDevOps mumiriri:

import matanda
kubva kune vanoshandura pinza AutoModelForSequenceClassification, AutoTokenizer
kubva ku aws_devops_agent import Agent


modhi = AutoModelForSequenceClassification.from_pretrained("distilbert-base-uncased")
tokenizer = AutoTokenizer.from_pretrained("distilbert-base-uncased")

# Tanga iyo DevOps mumiriri
mumiririri = Mumiririri ()

# Tsanangura basa rekuongorora zviitiko zvezviitiko uchishandisa iyo LLM modhi
def analyze_incident_report(report):
    # Preprocess iyo chiitiko chiitiko
    zvinopinda = tokenizer.encode_plus(report, 
                                    add_special_tokens=Chokwadi, 
                                    max_length=512, 
                                    return_attention_mask=Chokwadi, 
                                    return_tensors='pt')
    
    # Ongorora chiitiko chechiitiko uchishandisa iyo LLM modhi
    zvinobuda = modhi(zvekuisa['input_ids'], attention_mask=inputs['attention_mask'])
    
    # Bvisa iyo yakafanotaurwa kirasi label
    predicted_class = torch.argmax(outputs.logits)
    
    return predicted_class

# Tsanangura basa rekupa mazano ekugadzirisa chiitiko
def provide_suggestions(predicted_class):
    # Shandisa iyo yakafanotaurwa kirasi label kupa mazano ekugadzirisa chiitiko
    kana akafanotaurwa_kirasi == 0:
        dzoka "Tarisa iyo system logs yezvikanganiso"
    elif akafanotaura_class == 1:
        dzoka "Simbisa iyo network yekubatanidza"
    zvimwe:
        dzoka "Bata boka rekusimudzira kuti ubatsirwe"

# Batanidza iyo LLM modhi neiyo DevOps mumiriri
def chiitiko_kuongorora ():
    # Unganidza uye ongorora matanda kubva kuDevOps mumiriri
    logs = agent.get_logs()
    
    # Ongorora matanda uchishandisa iyo LLM modhi
    akafanotaura_class = analyze_incident_report(logs)
    
    # Ipa mazano ekugadzirisa chiitiko
    mazano = provide_suggestions(predicted_class)
    
    dzosa mazano

# Shandisa chiitiko chekuongorora mhinduro
chiitiko_kuferefeta()

Pamusoro 5-10 Inonyanya Kushandiswa Mirairo/Zvidimbu

Heano iwo epamusoro 5-10 anonyanya kushandiswa mirairo / snippets yeiyi tekinoroji:

  1. aws devops agent get-logs: Unganidza matanda kubva kumumiririri weDevOps.
  2. transformers.AutoModelForSequenceClassification.from_pretrained(): Isa modhi yeLLM.
  3. tokenizer.encode_plus(): Gadzirisa mushumo wechiitiko.
  4. muenzaniso(zvinopinza['input_ids'], attention_mask=inputs['attention_mask']): Ongorora nhoroondo yechiitiko uchishandisa modhi yeLLM.
  5. torch.argmax(outputs.logits): Bvisa chinyorwa chekirasi yakafanotaurwa.
  6. kupa_mazano(zvakafanotaurwa_kirasi): Ipa mazano ekugadzirisa chiitiko.
  7. agent.get_logs(): Unganidza matanda kubva kumumiririri weDevOps.
  8. ongorora_chiitiko_report(ripoti): Ongorora mushumo wechiitiko uchishandisa modhi yeLLM.
  9. chiitiko_kuferefeta(): Shandisai chiitiko chekuongorora mhinduro.
  10. torch.save(model.state_dict(), 'model.pth'): Sevha modhi yeLLM.

Kuona

Heino ratidziro ye otomatiki chiitiko chekuongorora mhinduro uchishandisa Chart.js:

{
  "type": "bha",
  "data": {
    "labels": ["Manual Investigation", "Automated Investigation"],
    "datasets": [
      {
        "label": "Nguva Yekugadzirisa",
        "data": [10, 2],
        "backgroundColor": ["rgba(255, 99, 132, 0.2)", "rgba(54, 162, 235, 0.2)"],
        "borderColor": ["rgba(255, 99, 132, 1)", "rgba(54, 162, 235, 1)"],
        "borderWidth": 1
      }
    ]
  },
  "sarudzo": {
    "zita": {
      "kuratidza": chokwadi,
      "text": "Nguva Yekugadzirisa Zviitiko"
    },
    "zvikero": {
      "yAxes": [
        {
          "zvikwekwe": {
            "beginAtZero": chokwadi
          }
        }
      ]
    }
  }
}

Kuona uku kunoenzanisa nguva yekugadzirisa zviitiko uchishandisa nzira dzekuongorora dzemanyorerwo maringe nemaitiro ekuferefeta nzira uchishandisa maDevOps agents uye maLLM.

Mhedziso

Kuita otomatiki yekuferefeta chiitiko nevamiriri veDevOps uye maLLM kunogona kuvandudza zvakanyanya kushanda uye kushanda kwekugadzirisa kwechiitiko. Nekubatanidza vamiririri veDevOps neLLMs, masangano anogona kushandura kuongororwa kwematanda, kupa mamiriro-anoziva mazano ekugadzirisa zviitiko, uye kuderedza nguva yekugadzirisa zviitiko. Takaongorora mharadzano yeDevOps otomatiki, AI-powered chiitiko kuongorora, uye basa reLLM mukusimudzira maturusi eDevOps seAWS DevOps Agent uye Copado Agentia. Nekutevera nhanho-ne-nhanho nzira yakatsanangurwa muchinyorwa chino, masangano anogona kuendesa inokatyamadza, yakavimbika, uye yakachengeteka otomatiki yekuferefeta chiitiko mhinduro.


¿Tienes preguntas?

Hablemos

Contáctame en LinkedIn