this post was submitted on 21 Jul 2024
340 points (98.0% liked)

Technology

59068 readers
3471 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 201 points 3 months ago (6 children)

No validation, in the driver or the updater software.

No validation or automated testing on publish.

No staged rollouts.

Just utterly irresponsible all around.

[–] [email protected] 81 points 3 months ago* (last edited 3 months ago) (2 children)

When I worked there six years ago, the company motto was "two feet on the gas pedal" because the CEO was a race car driver. I bailed after 10 months, giving up pre IPO shares. The management for my team was non existent, and I was on the build and release team. People were doing releases of manually. They've improved the automation some from what I here, but looks like the motto finally hit them.

I should also say their metrics were absolutely staggering. The log aggregator was doing something like 2 trillion requests a week. All backed by splunk. I never heard what they were paying, but it must have been fucking nuts.

[–] [email protected] 9 points 3 months ago* (last edited 3 months ago) (1 children)

Race car drivers definitely don't put both feet on the gas pedal though... Like, what?

[–] [email protected] 1 points 3 months ago* (last edited 3 months ago)

I would've preferred Colin McRae's classic in the same spirit: "when in doubt, flat out"

[–] [email protected] 1 points 3 months ago* (last edited 3 months ago)

The unfortunate thing is that, in the long run, that strategy will probably be super effective. Unless Europe (with the only internet regulations that actually have teeth) does something harsh enough, they will probably pay a few small fines over this at most. Cost of doing business and probably baked in already.

[–] [email protected] 44 points 3 months ago (2 children)

A coworker of mine has worked with CrowdStrike in the past; I haven't. He said that the releases he was familiar with from them in the past were all staged into groups and customers were encouraged to test internally before applying them; not sure if this is a different product or what, but it seems like a big step backwards of what he's saying is right.

[–] [email protected] 51 points 3 months ago* (last edited 3 months ago) (2 children)

I first dealt with them at least 10+ years ago and at the time they had no ability to do staged roll outs or targeted roll outs. We got updates when they said we did, no choice or control. We had to resort to updating our firewall to restrict the download endpoint and only open it in groups to do a phased update.

[–] [email protected] 12 points 3 months ago

Interesting! Sounds like they may have changed things a few times, or maybe my co-worker's memory has some gaps.

[–] [email protected] 2 points 3 months ago
[–] [email protected] 9 points 3 months ago (1 children)

Channel files are different from sensor updates, which you have no control over for version control. Sensor releases you have control over.

[–] [email protected] 1 points 3 months ago

Ah interesting, thanks!

[–] [email protected] 37 points 3 months ago

The idea of "security software" is ridiculous overall. You buy a software to fix security problems in Windows and it violates the original product by inserting code into kernel code. You lose support by the original product vendor. And you think you're secure, even the whole stuff makes you forget that IT should be always fit in solving security/restorability problems even when everything else fails.

[–] [email protected] 18 points 3 months ago

And on a Friday to make things worse

[–] [email protected] 2 points 3 months ago
[–] [email protected] 2 points 3 months ago

No staged rollouts.

I read somewhere that CS does allow for staged rollouts but some updates deliberately ignore them.