Iyo Browser seBackdoor: Mutengi-Side LLM Chakavanzika Kubvisa Yakabviswa | B4N1

Iyo Browser seBackdoor: Mutengi-Side LLM Chakavanzika Kubvisa Yakabviswa

1 month ago · b4n1 Read time: 4 min

Iyo Browser seBackdoor: Mutengi-Side LLM Chakavanzika Kubvisa Yakabviswa

Kwenguva yakareba, takabata "AI kuchengetedzwa yambiro" sekutyisidzira kure kana kuda kuziva nezvedzidzo. Isu takanzwa nezve kukurumidza jekiseni, jailbreak, uye kuburitswa kwedata mumatoni akanyarara, kazhinji achiteverwa neshuga uye "tichasvika pazviri." Zvisinei, mienzanisiro yenguva pfupi yapfuura inopindirana yakaparadza nyengedzo iyoyo yakanaka. Iyi haisisiri yekusagadzikana kwepfungwa zvakare; imhenyu, browser-based, client-side exploit yekutora ruzivo rwakadzama kubva kuLarge Language Models (LLMs) [2]. Kana uri kuendesa LLM-powered applications, kunyanya chero chinhu chakatarisana newebhu, "dambudziko remangwana" rako rangove riripo, riri pachena, uye rinogona kunyadzisa.

Iyi haisi imwe generic "AI ine njodzi" musoro. Iyi iratidziro chaiyo, inobatika yekuti mutambi ane hutsinye, achishandisa browser yake chete, anogona kumanikidza LLM yako kuburitsa ruzivo rwakadzama. Chimbofunga izvozvo kwekanguva. Izvo hazvisi zvezvakaoma server-parutivi kurwiswa kana yakadzika modhi introspection. Iri nezve dhizaini yekudyidzana - iyo yekumberi dhoo rekushandisa kwako - iri kushandiswa nevashoma vakanyatsogadzirwa mavara. Ndiyo yakaenzana nedhijitari yemumwe munhu ari kugadzira chirevo chakakodzera kune yako yaunofungidzirwa kuti yakachengeteka chatbot, uye inoisa zvine hunyanzvi pamusoro pe data yakakosha, kazhinji zvishoma nezvishoma.

The Illusion of Model Security

Mabhizinesi mazhinji akadyara mari yakawanda mu "dzakachengeteka" LLMs, ingave yakanaka-tuning evaridzi mhando kana kuvimba nemabhizinesi-giredhi APIs ane anofungidzirwa magadhi. Iko kufungidzira kwakazara ndeyekuti kana iyo modhi pachayo yakasimba, iyo application yakavakirwa pamusoro payo ichagara nhaka iyo chengetedzo. Miratidziro ichangoburwa inofumura iyi sepfungwa isiriyo ine ngozi. Kusagadzikana hakusi muhungwaru hweiyo modhi kana data rayo rekudzidzisa; iri mu interface yatinovaka tichiitenderedza [1]. Ndiyo yemhando yepamusoro "robust vault, flimsy front door" dambudziko. Unogona kunge uine LLM yepamberi, yakaomeswa pasirese, asi kana yako yekuisa parser isina njere, kana yako yekubuda sefa isipo, unenge uchisiya ruzivo rwakakosha pachena kuti chero munhu awane.

Iyi "yekukurumidza jekiseni" tekiniki ine chekuita nekuti inosimudzira hunhu hweLLM: kugona kwayo kutevera mirairo uye mapatani akazara. Nekupinza prefix yakanyatsogadzirwa mune inoiswa nemushandisi, anorwisa anogona kushandura mamiriro emukati emodhi, achimanikidza kuti iburitse ruzivo rwayaisamboitirwa [3]. Iyo "imwe-bit" kana iterative chimiro chakakosha pano. Zvinoreva nzira, inodzorwa kuburitsa, kwete kungoita chaotic data dump. Fungidzira munhu anorwisa achibvunza achibvunzazve, "Ndiye munhu wekutanga wechakavanzika 'A'?" zvino "I'B' here?" zvichingoenda zvakadaro. Inononoka, hongu, asi zvakare inoshanda zvinoshamisa uye yakaoma kuona kana usiri kunyatsoitsvaga.

Browser Yako, Chombo Chavo

Icho chokwadi chekuti iyi ndeye *browser-based * exploit inoshandura mutambo zvachose. Zvinoreva kuti:

  • Low Barrier to Entry: Chero ani ane hunyanzvi hwekuvandudza webhu uye bhurawuza anogona kuyedza izvi. Hapana maturusi ehunyanzvi kana ruzivo rwakadzama rweAI runodiwa.
  • Client-Side Execution: Kurwiswa kunobva pamushini wemushandisi, zvichiita kuti zvinyanye kusiyanisa kubva kune zviri pamutemo mushandisi mupendero.
  • Kutyisidzira Kwekare: Kana application yako yeLLM iri mhenyu uye ichiwanikwa kuburikidza newebhu interface, yatove panjodzi kune iyi vector. Ichi hachisi chigamba chemangwana; idambudziko riripo.

Funga zvinorehwa: zvirevo zvekodhi kodhi, zvinyorwa zvemukati, data revatengi, makiyi eAPI, kana kunyengera kwemaitiro eLLM yako kuparadzira nhema kana kugadzira zvinokuvadza. Zvese izvi zvinogona kuburitswa kana kupesvedzerwa, zvishoma nekurwadziwa, kuburikidza nebhokisi remavara rakareruka.

Basa nderenyu

Iri harisi dambudziko kune vanopa modhi seOpenAI kana Google kugadzirisa mune yavo inotevera modhi yekuvandudza. Iri idambudziko re application chengetedzo, uye basa rekudzikisa rinowira pasi pamapfudzi evagadziri, zvikwata zvekuchengetedza, uye maCTO ari kuendesa masisitimu aya. Yako LLM ine simba, asi pakupedzisira isina njere, injini. Ichaita zvayaudzwa, kunyangwe iwo mirairo yakavanzwa mukati inoratidzika kunge isina mhosva mushandisi.

Saka, unoita sei ikozvino?

Irimwe Countermeasures:

  1. Aggressive Input Sanitization: Izvi zvinopfuura kudzivirira jekiseni reSQL kana XSS. Iwe unofanirwa kuongorora * hunhu hwese * huchipinda muLLM yako. Tarisa mapatani anoratidza jekiseni nekukurumidza, kutevedzana kwemaitiro asina kujairika, kana kuyedza kubuda mukuyerera kwekukurukurirana kunotarisirwa [4]. Izvi hazvisi zvekuvharisa "mashoko akaipa"; ndezvekuziva zvinokurudzira mhandu. Kupfuura basic regex uye heuristic ongororo, shandisa semantic ongororo kuti uone chinangwa chakaipa. Shandisa tokenization uye embedding ongororo kuona zvisingaite ekuisa mapatani. Funga kushandisa yechipiri, diki LLM kana mutemo-yakavakirwa sisitimu yakanyatso dzidziswa kuona nekukurumidza majekiseni. Tarisa mapatani senge mirairo yekutamba-yekutamba, zviri pachena zvikumbiro zvekubvisa data, kana kuedza kunzvenga mirairo yapfuura.
  2. Robust Output Seltering and Validation: Usambofa wakavimba neLLM zvabuda zvizere. Pamberi pechero chinyorwa-chakagadzirwa neLLM chinoratidzwa kumushandisi kana kushandiswa neimwe sisitimu, inofanirwa kupfuura nepayakaomesesa yekusimbisa layer. Rine mazwi akakosha here? Inoenderana here nemafomu anotarisirwa? Inoedza kuita kodhi here kana kuratidza mukati mehurongwa hwekukurudzira? Kana LLM yako ichifanirwa kupfupisa gwaro, asi inotanga kunyora mafaera nzira, une dambudziko.
  3. Layered Prompt Engineering: Nepo isiri mhinduro yakakwana, yakanyatsogadzirwa masisitimu yekurudziro uye mishoma-pfuti mienzaniso inogona kubatsira kusimbisa hunhu hunodiwa uye kuita kuti zviomere munhu anorwisa kupamba modhi. Nekudaro, nzwisisa kuti kukurumidza engineering chete haina kukwana; idziviriro yakadzama, kwete nhovo huru.
  4. Ropafadzo Yakaderera yekudyidzana kweLLM: Ko LLM yako inoda zvechokwadi kuwana chidimbu che data chaungango kurudzirwa kuburitsa? Shandisa zvidzoreso zvekupinda. Kana iyo LLM ichingofanirwa kupindura mibvunzo nezve zvinyorwa zveveruzhinji, ita shuwa kuti haina chirongwa chekuwana dhatabhesi remukati kana maAPI ane hanya.
  5. Kutarisisa uye Kuonekwa Kwekusagadzikana: Unoda kushingaira kutsvaga maitiro asina kujairika eLLM. Spikes mumhando dzakasiyana dzemibvunzo, zvinobuda zvinotsauka kubva pamaitiro akajairwa, kana kudzokorora kuedza kutora ruzivo kunofanirwa kukonzeresa chenjedzo ipapo.

Izvi hazvisi zveyakafara "AI chengetedzo" zvakare. Izvi ndezvekuchengetedza iyo yekudyidzana layer yeLLM maapplication ako achipokana neakananga, akaratidzwa, uye nekukasira kushandiswa kurwisa vector. Isu tanga tichivaka aya anoshamisa, ane simba masisitimu, kazhinji asina kukwana matanho ekuchengetedza painterface. Mienzaniso ichangoburwa yatiratidza kuti zviri nyore sei kushandisa mikaha iyi. Nguva yehurukuro dzedzidziso yapfuura. Chiito chekukurumidza chinodiwa kuchengetedza LLM zvikumbiro.

Zvinyorwa

[1] OWASP Yepamusoro gumi yeMakumbiro eMutauro Mukuru - https://owasp.org/www-project-top-10-for-large-language-model-applications/ [2] Lakera Gandalf: An Interactive Prompt Jekiseni Dambudziko - https://gandalf.lakera.ai/ [3] Kurumidza jekiseni kurwisa | Web Security Academy - https://portswigger.net/web-security/llm-attacks/prompt-injection [4] Chii chinonzi Prompt Jekiseni uye Sei Kuchidzivirira? - https://www.tenable.com/blog/what-is-prompt-injection-and-how-to-prevent-it


Have Questions?

Let's Talk

Contact me on LinkedIn