Ṣiṣeto Awọn Pipeline DevOps Agbara AI-Agbara pẹlu DSPy ati LangChain fun Iwadii Iṣẹlẹ Iwaju ati Ipinnu | B4N1

Ṣiṣeto Awọn Pipeline DevOps Agbara AI-Agbara pẹlu DSPy ati LangChain fun Iwadii Iṣẹlẹ Iwaju ati Ipinnu

6 months ago · b4n1 Read time: 4 min

Ifihan

Idiju igbagbogbo ti ndagba ti awọn ọna ṣiṣe sọfitiwia ode oni ti yori si ilosoke ninu igbohunsafẹfẹ ati biburu ti awọn iṣẹlẹ, ṣiṣe iwadii iṣẹlẹ isẹlẹ ati ipinnu ni abala pataki ti DevOps. Imọran atọwọda (AI) ati ẹkọ ẹrọ (ML) ti farahan bi awọn irinṣẹ agbara lati mu awọn opo gigun ti DevOps ṣiṣẹ, ṣiṣe adaṣe adaṣe AI ati orchestration lati ṣawari ati yanju awọn iṣẹlẹ ṣaaju ki wọn ni ipa lori iṣowo naa. Ninu àpilẹkọ yii, a yoo ṣawari bi o ṣe le ṣe imuse awọn opo gigun ti DevOps ti AI-agbara ni lilo DSPy ati LangChain, pẹlu idojukọ lori iwadii iṣẹlẹ ti n ṣiṣẹ ati ipinnu nipa lilo AIOps ati awọn awoṣe RAG, ati iṣọpọ pẹlu AWS DevOps Aṣoju fun iwadii iṣẹlẹ adaṣe.

Akopọ ti DSPy ati LangChain

DSPy jẹ ile-ikawe Python ti o pese ọna ti o rọrun ati lilo daradara lati kọ ati ran awọn opo gigun ti AI-agbara DevOps ṣiṣẹ. O gba awọn olupilẹṣẹ laaye lati ṣepọ ọpọlọpọ awọn awoṣe AI ati ML, pẹlu sisẹ ede abinibi (NLP), iran kọnputa, ati awọn atupale asọtẹlẹ, sinu awọn opo gigun ti DevOps wọn. LangChain, ni ida keji, jẹ ile-ikawe Python ti o fun laaye awọn olupilẹṣẹ lati kọ ati ran awọn awoṣe AI titobi nla lọ nipa lilo apọjuwọn ati faaji iwọn.

Ṣiṣe awọn Pipeline DevOps AI-Agbara pẹlu DSPy ati LangChain

Lati ṣe awọn opo gigun ti DevOps ti AI-agbara pẹlu DSPy ati LangChain, a nilo lati tẹle awọn igbesẹ wọnyi:

  1. ** Gbigba data ***: Gba data ti o yẹ lati awọn orisun oriṣiriṣi, gẹgẹbi awọn akọọlẹ, awọn metiriki, ati awọn faili iṣeto.
  2. ** Iṣagbekalẹ data ***: Ṣe ilana data ti a gba lati murasilẹ fun itupalẹ ati awoṣe.
  3. ** Ikẹkọ Awoṣe ***: Kọ AI ati awọn awoṣe ML ni lilo data ti a ti ṣe tẹlẹ lati ṣawari ati asọtẹlẹ awọn iṣẹlẹ.
  4. ** Gbigbe Awoṣe ***: Fi awọn awoṣe ikẹkọ sinu opo gigun ti DevOps nipa lilo DSPy ati LangChain.
  5. **Iwadii Iṣẹlẹ ***: Lo awọn awoṣe ti a fi ranṣẹ lati ṣe iwadii awọn iṣẹlẹ ati ṣe idanimọ awọn idi gbongbo.
  6. **Ipinnu Iṣẹlẹ ***: Lo awọn oye ti o gba lati inu iwadii iṣẹlẹ lati yanju awọn iṣẹlẹ ni imurasilẹ.

Apeere koodu: Ṣiṣe Awoṣe RAG Rọrun pẹlu DSPy ati LangChain

Eyi ni apẹẹrẹ koodu ti o rọrun ti o ṣe afihan bi o ṣe le ṣe awoṣe RAG kan (Itupalẹ Idi Gbongbo) nipa lilo DSPy ati LangChain: `` Python gbe wọle dspy lati gbe wọle langchain LLMChain

Ṣe igbasilẹ data ti a ti ṣe tẹlẹ

data = pd.read_csv ("data.csv")

Ṣetumo awoṣe RAG

rag_model = dspy.RAGModel ( input_features=["log_level", "aṣiṣe_ifiranṣẹ"], output_features=["root_cause"] )

Ṣe ikẹkọ awoṣe RAG

rag_model.train (data)

Mu awoṣe RAG ṣiṣẹ

llm_chain = LLMChain( awoṣe = "davinci: 002", max_length=2048 ) rag_model.deploy (llm_chain)

Lo awoṣe RAG ti a fi ranṣẹ lati ṣe iwadii awọn iṣẹlẹ

iṣẹlẹ_data = pd.DataFrame({ "log_level": ["Asise"], "error_message": ["Ohun kan ti ṣe aṣiṣe"] }) root_cause = rag_model.predict(incident_data) tite(root_fa)

Apeere koodu yii ṣe afihan bi o ṣe le ṣe imuse awoṣe RAG ti o rọrun nipa lilo DSPy ati LangChain. Awoṣe RAG gba ipele log ati ifiranṣẹ aṣiṣe bi awọn ẹya titẹ sii ati asọtẹlẹ idi root ti isẹlẹ naa.

## Top 5-10 Awọn aṣẹ ti a lo julọ / awọn snippets

Eyi ni oke 5-10 awọn aṣẹ ti a lo julọ/snippets fun DSPy ati LangChain:

1. `dspy.RAGModel(input_features, output_features)`: Setumo a RAG awoṣe pẹlu pàtó kan igbewọle ati o wu awọn ẹya ara ẹrọ.
2. `dspy.RAGModel.train(data)`: Irin a RAG awoṣe lilo awọn data pese.
3. `dspy.RAGModel.deploy(llm_chain)`: Mu awoṣe RAG ti ikẹkọ ṣiṣẹ nipa lilo LangChain LLMChain kan.
4. `llm_chain = LLMChain(awoṣe, max_length)`: Ṣẹda LangChain LLMChain kan pẹlu awoṣe pato ati ipari gigun.
5. `rag_model.predict(data)`: Lo awoṣe RAG ti a fi ranṣẹ lati ṣe asọtẹlẹ idi ti isẹlẹ kan.
6. `dspy.DataPreprocessor(input_data)`: Setumo a data preprocessing opo gigun ti epo nipa lilo DSPy.
7. `dspy.ModelTrainer (awoṣe, data)`: Kọ AI tabi ML awoṣe nipa lilo DSPy.
8. `dspy.ModelDeployer(awoṣe, llm_chain)`: Mu awoṣe ikẹkọ ṣiṣẹ nipa lilo DSPy ati LangChain.
9. `langchain.LLMChain.predict(input_data)`: Lo LangChain LLMChain kan lati ṣe asọtẹlẹ abajade ti awoṣe kan.
10. `dspy.RAGModel.evaluate(data)`: Iṣiro awọn iṣẹ ti a RAG awoṣe lilo DSPy.

## Wiwo

Eyi ni apẹẹrẹ ti iworan nipa lilo Chart.js:
`` json
{
  "type": "ọgọ",
  "data": {
    "labels": ["Irú Ìṣẹ̀lẹ̀ A", "Irú Ìṣẹ̀lẹ̀ B", "Irú ìṣẹ̀lẹ̀ C"],
    "awọn ipilẹ data": [
      {
        "label": "Idi ìdí A",
        "data": [10, 15, 7],
        "backgroundColor": "rgba(255, 99, 132, 0.2)",
        "borderColor": "rgba(255, 99, 132, 1)",
        "AalaWidth": 1
      },
      {
        "label": "Gbongbo Idi B",
        "data": [8, 12, 9],
        "backgroundColor": "rgba(54, 162, 235, 0.2)",
        "borderColor": "rgba(54, 162, 235, 1)",
        "AalaWidth": 1
      },
      {
        "label": "Gbongbo Idi C",
        "data": [14, 18, 11],
        "backgroundColor": "rgba(255, 206, 86, 0.2)",
        "borderColor": "rgba(255, 206, 86, 1)",
        "AalaWidth": 1
      }
    ]
  },
  "awọn aṣayan": {
    "akọle": {
      "ifihan": otitọ,
      "text": "Itupalẹ Idi Gbongbo"
    },
    "iwọn": {
      "yAxes": [
        {
          "awọn ami": {
            "beginAtZero": otitọ
          }
        }
      ]
    }
  }
}

Iwoye yii ṣe afihan pinpin awọn idi root fun awọn iru iṣẹlẹ iṣẹlẹ.

Ipari

Ninu àpilẹkọ yii, a ṣawari bi a ṣe le ṣe imuse awọn opo gigun ti DevOps ti AI-agbara ni lilo DSPy ati LangChain, pẹlu idojukọ lori iwadii iṣẹlẹ ti n ṣiṣẹ ati ipinnu nipa lilo AIOps ati awọn awoṣe RAG, ati iṣọpọ pẹlu AWS DevOps Aṣoju fun iwadii isẹlẹ adaṣe. A ṣe afihan apẹẹrẹ koodu ti o rọrun ti o ṣe imuse awoṣe RAG kan nipa lilo DSPy ati LangChain, ati pe o pese atokọ ti oke 5-10 awọn aṣẹ/snippets ti a lo julọ fun DSPy ati LangChain. A tun pẹlu apẹẹrẹ iworan kan nipa lilo Chart.js. Nipa titẹle awọn igbesẹ ti a ṣe alaye ninu nkan yii, awọn olupilẹṣẹ le kọ ati ran awọn opo gigun ti AI-agbara DevOps ti o ṣe awari ati yanju awọn iṣẹlẹ ni itara, imudarasi ṣiṣe gbogbogbo ati igbẹkẹle ti awọn eto sọfitiwia wọn.


Have Questions?

Let's Talk

Contact me on LinkedIn