+− THE DAILY DIFFdev & AI news
SHIP IT

I-regex yehlise i-Cloudflare. Imizuzu engu-27.

Julayi 2, 2019, 13:42 UTC: umthetho omusha owodwa we-Cloudflare's Web Application Firewall uya ku-inthanethi emadolobheni angu-180+ ngemizuzwana embalwa.

Want to see our stories first on Google? Add us to your preferred sources — it helps us grow.

Julayi 2, 2019, 13:42 UTC: umthetho omusha owodwa we-Cloudflare's Web Application Firewall uya ku-inthanethi emadolobheni angu-180+ ngemizuzwana embalwa. Kungumthetho we-XSS ngemodi yokulingisa, ngakho awuvimbi lutho, kodwa usasebenza kuso sonke isicelo, futhi uphela ngo-.*(?:.*=.*). I-PCRE ibuyela emuva, yonke i-CPU core esebenza i-HTTP ishaya u-100 %, futhi yonke isayithi elisebenzisa i-Cloudflare libuyisa u-502 imizuzu engu-27; ukuhamba kwedatha kwehle ngo-82 %. Inkinobho yokucisha isemva kwe-Cloudflare Access, esemva kwe-Cloudflare. Ngemuva kwesigameko, kusukela ekubhaleni kwe-Cloudflare: i-CPU guard ekhiphe amasonto ngaphambili ekuhlelweni kabusha okuhloswe ukonga i-CPU, inqubo evumele noma yimuphi umthetho ukuthi weqe isiteji, injini engenasiqinisekiso sokuba nzima, izimbangela ezingu-11 kanye nezilungiso ezingu-7. Isinqumo ngesilungiso: SHIP IT.

Funda uhlelo olubhaliwe (isiNgisi) ↗

Lokho okuhlanganiswa yile vidiyo

  • 13:31–13:42 UTC: I-PR ihlangene, i-CI eluhlaza (ayikho i-CPU test), i-Quicksilver iphusha umthetho emadolobheni angu-180+; imithetho ye-WAF yeqa izigaba ze-DOG → PIG → Canary
  • 13:45–14:07: ikhasi lokuqala; i-CPU u-100 % emhlabeni wonke, ukuhamba kwedatha −82 %, u-502s yonke indawo; iphaneli yokulawula yangaphakathi isemva kwe-Cloudflare Access, eyehlile; amanye amakhredithi aphelelwe yisikhathi; indlela yokudlula engavamile ukufundwa
  • 14:07–14:09: ukuqedwa kwe-WAF emhlabeni wonke; ukuhamba kwedatha ne-CPU kujwayelekile ngemuva kwemizuzu engu-27; 14:52 I-WAF ibuyile ngaphandle komthetho
  • Jul 2 (15:50 UTC) no-Jul 12: I-Cloudflare ishicilela inothi losuku olufanayo kanye nokuhlola okuphelele ngemuva kwesigameko; i-CPU guard yengezwe kabusha, imithetho engu-3,868 ifundwe kabusha, ukusakazwa ngezigaba, ukudlulela kwinjini ye-regex yesikhathi esiqondile

Imibuzo nezimpendulo

Ingabe i-regular expression eyodwa ingawisa kanjani inethiwekhi yomhlaba wonke?

I-regex enokubuyela emuva okungapheli ingavikela yonke i-CPU core eyihlolayo. Ngokuvumelana ne-Cloudflare's postmortem, umthetho omusha we-firewall uphele ku-.*(?:.*=.*), i-PCRE yabuyela emuva ngazo zonke ezinye izingxenye, kanti i-CPU yafinyelela ku-100 % kuwo wonke ama-core asebenza i-HTTP. Amawebhusayithi angemuva kwe-Cloudflare abuyise amaphutha angu-502 imizuzu engu-27 futhi ukuhamba kwezimoto kwehle ngo-82 %.

blog.cloudflare.com · blog.cloudflare.com

Kungani umthetho we-firewall kumodi yokulingisa usadinga ukuphazamiseka?

Imodi yokulingisa imisa umthetho ekunqandeni ukuhamba kwezimoto, kodwa umthetho usahlolwa kuwo wonke isicelo. Umthetho ohlanganiswe ngo-13:31 UTC ngoJulayi 2, 2019 wawungumthetho wokubhala ngaphansi kwesayithi kumodi yokulingisa, ngakho awunqandanga lutho, kodwa usebenze kuwo wonke isicelo. I-Cloudflare's postmortem ithi izindleko zokuwuhlola ziye zakhungathekisa i-CPU.

blog.cloudflare.com

Ingabe umthetho owodwa wawafinyelela kanjani kuwo wonke ama-Cloudflare data center ngemizuzwana emibili?

Imithetho ye-firewall yeqa ukusebenza okwenziwa ngokwehlukana okwenziwa amanye amakhulula. Ngokuvumelana ne-postmortem, inqubo yavumela noma yimuphi umthetho ukuba uhambe emhlabeni jikelele ngesikhathi esisodwa ngoba imithetho ikhona ukuze imise ukuhlaselwa okubukhoma. Lo mthetho wawungesona isimo esiphuthumayo, kanti i-Quicksilver isawusunduzele emadolobheni angaphezu kuka-180 cishe ngemizuzwana emibili, kungekho ukuhlola kwe-CPU ku-CI ukukuwubamba.

blog.cloudflare.com · blog.cloudflare.com

Kungani i-Cloudflare yathatha imizuzu engu-27 ukuvala ingxenye ye-firewall enephutha?

Iphaneli yokulawula yangaphakathi yahlala ngemuva kwe-Cloudflare Access, eyahlala ngemuva kwe-Cloudflare, ngakho ukuphazamiseka kwanqanda indlela eya ku-kill switch. Amanye amakhodi okungena ayephelelwe isikhathi ngenxa yokungasetshenziswa, futhi ukudlula okungajwayelekile kwathatha cishe imizuzu emihlanu. Ukunqamula kwe-global WAF kwenziwa ngo-14:07 UTC, futhi ukuhamba kwezimoto kwase kujwayelekile futhi ngo-14:09.

blog.cloudflare.com · x.com

Ingabe amaqembu kufanele agcine izinjini ze-regex ezinokubuyela emuva ku-request-path code ngemuva kokuphazamiseka kwe-Cloudflare?

Isinqumo se-The Daily Diff kwaba i-SHIP IT, ngesixazululo se-Cloudflare. Ukuvikela kwe-CPU kwabuyiselwa, imithetho engu-3,868 yaphinde yafundwa, imithetho idlula ekusebenzeni okwenziwa ngokwehlukana, futhi injini ithuthela kwinye enezimvume zesikhathi esilinganiselwe. Iseluleko esisebenzayo salesi sigameko ukugwema izinhlobo ezifana ne-dot-star dot-star kunoma yini esebenza kuwo wonke isicelo nokugcina i-kill switch ingekho ohlelweni elilawulayo.

blog.cloudflare.com

Umbhalo obhaliwe ohunyushwe

Kuhunyushwe kusuka ekulandiseni kokuqala kwesiNgisi. Umsindo namazwibela atholakalayo alawulwa yi-YouTube.

0:00 Isisho esisodwa esivamile siqala ukusebenza kuyo yonke iseva ye-Cloudflare ngesikhathi esisodwa, futhi imizuzu engamashumi amabili nesikhombisa elandelayo izindawo ezisemva kwayo ziyikhasi elingu-502, okungukuthi, ngesikhathi sokuvikela, isilungiselelo esiqine kakhulu esingenzeka. Julayi 2, 2019, 13:42 UTC. I-Cloudflare ithumela kungakapheli amahora amabili: akulona uhlaselo, ukusatshalaliswa okubi, ukuhamba kwedatha kwehle ngo-82 ekhulwini. Ezinsukwini eziyishumi kamuva u-CTO John Graham-Cumming ushicilela ukuhlola okuphelele ngemuva kwesigameko, i-regex ifakiwe, futhi i-Hacker News iyanikeza amaphuzu angu-698,

0:26 okungukuthi uma kuphazamiseka kuyisikhathi sokubonga. Ukuthi kwenzeka kanjani, kungani kungenzeka, nokuthi ubani ngempela ohluleka. Lolu The Daily Diff, postmortem. 13:31. Isicelo sokuhlanganisa sihlanganiswa: umthetho omusha owodwa wokuvikela i-cross-site scripting, ngemodi yokulingisa, ngakho ayivimbi lutho. 13:37, izivivinyo ziyaphumelela; akukho okuqapha i-CPU. 13:42, umthetho uthunyelwa emadolobheni angu-180 ngemizuzwana emibili, ngoba imithetho ye-WAF yeqa izigaba zenja, ingulube nenyoni ezinye izinto ezikhishwa ngayo.

0:54 13:45, ikhasi lokuqala. 13:49, i-Hacker News inentambo ngesimo sekhasi, okusho namanje ukuthi zonke izinhlelo ziyasebenza. Umthetho uphela ngo-dot-star, dot-star, equals, dot-star: noma yini, bese noma yini, bese uphawu lokulingana. I-PCRE iqagela ngokuhaha, yehluleka, bese ibuyela emuva kuzo zonke ezinye izingxenye. u-x olingana no-x uthatha izinyathelo ezingu-23. Ama-x angamashumi amabili ngemuva kokulingana: 555.

1:15 Ama-x angamashumi amabili, ayikho uphawu lokulingana: izinyathelo ezingu-4,067 zokuthola lutho. Yisebenzise kuso sonke isicelo futhi yonke i-core iba kumakhulu ekhulwini, ingenza lutho, ngokuphelele. Izimbali ezimbili bekumele ziyibambe. Umkhawulo we-CPU emithethweni wasuswa ngephutha emasontweni ngaphambili, ekuhlelweni kabusha okuhloswe ukwenza i-WAF isebenzise i-CPU encane. Futhi inqubo ivumela noma yimuphi umthetho ukuthi weqe isiteji, ngoba imithetho ikhona ukuze imise ukuhlasela okusebenzayo, lokhu kwakungesona isimo esiphuthumayo, futhi kwahamba emhlabeni wonke noma kunjalo.

1:37 14:00, i-WAF ikhomba; akukho ukuhlasela. 14:02, omunye uhlongoza ukuqedwa komhlaba wonke: into eyodwa, ivaliwe, emhlabeni wonke. Inkinobho isemva kwe-Cloudflare Access. I-Cloudflare Access isemva kwe-Cloudflare. Amanye amakhredithi aphelelwe yisikhathi ngenxa yokungasetshenziswa, ngakho inethiwekhi esheshayo ku- inthanethi ichitha imizuzu emihlanu endleleni yokudlula okungazange kwenzelwe muntu. 14:07, yibulale. 14:09, ukuhamba kwedatha kujwayelekile. git blame: ukukhishwa ngesivinini esisodwa, emhlabeni wonke; i-CPU guard ehlukaniswe ngephutha;

2:04 injini ye-regex engenamkhawulo ophezulu. Hhayi unjiniyela owabhala umthetho: ukuhlola ngemuva kwesigameko kubala izimbangela eziyishumi nanye kanye amagama akekho. Ukusabalala kokulimala: imizuzu engu-27, u-82 ekhulwini wokuhamba kwedatha, u-100 ekhulwini we-CPU kuyo yonke i-core, kuyo yonke idolobha. I-dashboard ne-API kusemuva kwe-edge efanayo, ngakho amakhasimende awakwazi ngisho nokucisha yona. I-Hacker News, ngaphansi kokuhlola ngemuva kwesigameko: babenenkinga eyodwa, basebenzisa isisho esivamile, manje banezimbili. Ihlaya elidala. Lisahlanganisa.

2:28 Isinqumo, ngemuva kwesigameko: SHIP IT. I-CPU guard ibuyile, yonke imithetho engu-3,868 ifundwa ngesandla, imithetho idlula esiteji, futhi injini idlulela kwinjini enezikhathi zokuqondile izikhathi, eshicilelwe ngu-Ken Thompson ngo-1968. NgoMsombuluko: akukho dot-star dot-star kunoma yini esebenza ngokwesicelo, futhi gcina inkinobho yokucisha ingekho entweni eyibulalayo. Ngithumele isigameko ongakavunyelwa ukukhuluma ngaso, kumazwana, noma ku-the daily diff dot dev.

2:53 Futhi lowo umehluko wanamuhla. Ngingu-Niko wase-Axrisi. Hlanganisa ngokuzibopha.

Imithombo

  1. John Graham-Cumming, "Details of the Cloudflare outage on July 2, 2019" (Jul 12, 2019)blog.cloudflare.com
  2. Matthew Prince, "Cloudflare outage caused by bad software deploy (updated)" (Jul 2, 2019)blog.cloudflare.com
  3. Matthew Prince on X, Jul 2, 2019, 14:22 UTCx.com
  4. Matthew Prince on X, Jul 2, 2019, 14:36 UTC ("No evidence yet attack related")x.com
  5. Hacker News, Jul 2, 2019, 13:49 UTC — "Cloudflare Network Performance Issues" (631 points)news.ycombinator.com
  6. Hacker News, Jul 2, 2019 — "Cloudflare outage caused by bad software deploy" (348 points)news.ycombinator.com
  7. Hacker News, Jul 12, 2019 — "Details of the Cloudflare outage on July 2, 2019" (698 points)news.ycombinator.com
  8. TechCrunch, Jul 2, 2019techcrunch.com

Niko from Axrisi

Nikoloz Turazashvili · Vexrail · Axrisi

LinkedIn · dev.to · GitHub · X · Substack

Amavidiyo ahlobene