Ukuthunyelwa Okuphumelelayo Kwemodeli ye-AI kumadivayisi e-Edge nge-Hardware-Software Co-Design | B4N1

Ukuthunyelwa Okuphumelelayo Kwemodeli ye-AI kumadivayisi e-Edge nge-Hardware-Software Co-Design

6 months ago · b4n1 Read time: 2 min

Isingeniso

Ukwanda kwamadivayisi asemaphethelweni, njengama-smartphones, amathuluzi ahlakaniphile asekhaya, nezimoto ezizimele, kudale isidingo esicindezelayo sokusebenza kahle kwemodeli ye-AI kulawa madivayisi. Izindlela zokusetshenziswa zemodeli ye-AI yendabuko zivame ukuncika kungqalasizinda esekelwe emafini, engathula ukubambezeleka, ukukhathazeka ngokuvikeleka, kanye nokusetshenziswa kwamandla okuphezulu. Ukuze kubhekwane nalezi zinselelo, i-hardware-software-design co-design iqhamuke njengendlela ethembisayo, evumela ukwenziwa kahle kokusebenza kwemodeli ye-AI, ukusetshenziswa kwamandla, nokubambezeleka kumadivayisi asemaphethelweni.

Ukuhlangana kwe-AI, i-Edge Computing, kanye ne-Co-Design

I-Edge computing ibhekisela ekucutshungulweni kwedatha emaphethelweni enethiwekhi, eduze nomthombo wedatha, esikhundleni sefu elimaphakathi noma isikhungo sedatha. Ngakolunye uhlangothi, amamodeli e-AI, adinga izinsiza ezibalulekile zokubala ukuze zicutshungulwe futhi zihlaziye inani elikhulu ledatha. Ukuphambana kwe-AI, i-edge computing, kanye ne-co-design kuhilela ukwenziwa ngcono ngokuhlanganyela kwezingxenyekazi zehadiwe ne-software ukuze kuzuzwe ukuthunyelwa kwemodeli ye-AI okusebenzayo kumadivayisi asemaphethelweni.

Izinzuzo ze-Hardware-Software Co-Design

I-Hardware-software co-design inikeza izinzuzo ezimbalwa, okuhlanganisa:

  • Ukusebenza okuthuthukisiwe: Ngokulungiselela ihadiwe nezingxenye zesofthiwe ndawonye, ukudizayina ngokubambisana kungaholela ekuthuthukisweni okuphawulekayo kokusebenza ekusetshenzisweni kwemodeli ye-AI.
  • Ukusetshenziswa kwamandla okwehlisiwe: Ukudizayina ndawonye kungasiza ekunciphiseni ukusetshenziswa kwamandla ngokuthuthukisa izingxenyekazi zehadiwe nesofthiwe ukuze kusebenze amandla aphansi.
  • Ukubambezeleka okuphansi: Ukudizayina ngokubambisana kungasiza ekunciphiseni ukubambezeleka ngokuthuthukisa izingxenyekazi zehadiwe nesofthiwe ukuze kucutshungulwe idatha ngokushesha nokuxhumana.
  • Ukuguquguquka okuthuthukisiwe: I-Co-design inganika amandla ukuthuthukiswa kwamamodeli e-AI avumelana nezimo nezimo angasatshalaliswa kalula kumadivayisi ahlukile.

Ukugxila Okusebenzayo: Isibonelo Sekhodi

Ake sicabangele isibonelo esilula se-hardware-software co-design yokuthunyelwa kwemodeli ye-AI kumadivayisi asemaphethelweni. Sizosebenzisa umtapo wezincwadi wePython odumile, i-TensorFlow, ukuze sikhiphe imodeli ye-AI eyisisekelo ku-Raspberry Pi, idivayisi esemaphethelweni edumile.

ngenisa i-tensorflow njenge-tf
kusuka ku-tensorflow.keras izendlalelo zokungenisa

# Chaza ukwakheka kwemodeli ye-AI
imodeli = tf.keras.Sequential([
    izendlalelo.Conv2D(32, (3, 3), activation='relu', input_shape=(28, 28, 1)),
    izendlalelo.I-MaxPooling2D((2, 2)),
    Izendlalelo.Flatisa(),
    izendlalelo.Kuminyene(64, ukwenza kusebenze='relu'),
    izendlalelo.Kuminyene(10, ukwenza kusebenze='i-softmax')
])

# Hlanganisa imodeli
imodeli.hlanganisa(optimizer='adam',
              loss='sparse_categorical_crossentropy',
              amamethrikhi=['ukunemba'])

# Layisha idathasethi ye-MNIST
(X_train, y_train), (X_test, y_test) = tf.keras.datasets.mnist.load_data()

#Lungisa kusengaphambili idatha
X_train = X_train.reshape(-1, 28, 28, 1).astype('float32') / 255.0
X_test = X_test.reshape(-1, 28, 28, 1).astype('float32') / 255.0

# Qeqesha imodeli
model.fit(X_train, y_train, epochs=5, batch_size=128)

# Linganisa imodeli
test_loss, test_acc = model.evaluate(X_test, y_test)
phrinta(f'Ukunemba kokuhlola: {test_acc:.2f}')

Lesi sibonelo sekhodi sibonisa ukuthunyelwa kwemodeli ye-AI eyisisekelo ku-Raspberry Pi kusetshenziswa i-TensorFlow. Imodeli iqeqeshwa kudathasethi ye-MNIST futhi ihlolwe kusethi yokuhlola. Ikhodi ibonisa ubulula nokuguquguquka kwe-hardware-software co-design yokusetshenziswa kwemodeli ye-AI kumadivayisi asemaphethelweni.

Imiyalo/Amazwibela Asetshenziswa Kakhulu 5-10

Nansi eminye yemiyalo evame ukusetshenziswa kakhulu namazwibela okwakhiwa ngokubambisana kwesoftware yehadiwe:

  • TensorFlow: tf.keras.Sequential(), tf.keras.layers.Conv2D(), tf.keras.layers.MaxPooling2D()
  • I-Raspberry Pi: sudo apt-get update, sudo apt-get install python3-pip, i-pip3 faka i-tensorflow
  • I-Co-Design: co-design.py -h, co-design.py -m <model_name>, co-design.py -d <device_name>

Ukubukwa

Nakhu ukubuka ngeso lengqondo izinzuzo ze-hardware-software-design usebenzisa i-Chart.js:

{
  "type": "bar",
  "idatha": {
    "labels": ["Traditional AI Model Deployment", "Hardware-Software Co-Design"],
    "idathasethi": [
      {
        "label": "Ukusebenza",
        "idatha": [10, 20],
        "backgroundColor": "rgba(255, 99, 132, 0.2)",
        "borderColor": "rgba(255, 99, 132, 1)",
        "BorderWidth": 1
      },
      {
        "label": "Ukusetshenziswa kwamandla",
        "idatha": [50, 30],
        "backgroundColor": "rgba(54, 162, 235, 0.2)",
        "borderColor": "rgba(54, 162, 235, 1)",
        "BorderWidth": 1
      },
      {
        "label": "Latency",
        "idatha": [100, 50],
        "backgroundColor": "rgba(255, 206, 86, 0.2)",
        "borderColor": "rgba(255, 206, 86, 1)",
        "BorderWidth": 1
      }
    ]
  },
  "izinketho": {
    "isihloko": {
      "Display": iqiniso,
      "text": "Izinzuzo ze-Hardware-Software Co-Design"
    },
    "izikali": {
      "yAxes": [
        {
          "imikhaza": {
            "beginAtZero": kuyiqiniso
          }
        }
      ]
    }
  }
}

Lokhu kuboniswa kuqhathanisa ukusebenza, ukusetshenziswa kwamandla, kanye nokubambezeleka kokusetshenziswa kwemodeli ye-AI yendabuko kuqhathaniswa ne-hardware-software co-design.

Isiphetho

I-Hardware-software-design co-design ivele njengendlela ethembisayo yokuthunyelwa kwemodeli ye-AI esebenzayo kumadivayisi asemaphethelweni. Ngokulungiselela ihadiwe nezingxenye zesofthiwe ndawonye, ​​ukudizayina ngokubambisana kungaholela ekuthuthukisweni okuphawulekayo kokusebenza, ukunciphisa ukusetshenziswa kwamandla, nokubambezeleka okuphansi. Lesi sihloko sinikeze umbono oningiliziwe wezinzuzo nezinhlelo zokusebenza ezisebenzayo ze-hardware-software co-design, okufaka isibonelo esilula sekhodi nokuboniswa kwezinzuzo. Njengoba isidingo se-Edge AI siqhubeka sikhula, i-hardware-software co-design cishe izodlala indima ebaluleke kakhulu ekuthuthukisweni kwamamodeli e-AI asebenzayo nasebenzayo.


Have Questions?

Let's Talk

Contact me on LinkedIn